00000001:02000400:1.0F:1734256828.911250:0:4066:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: conf-sanity test_69 skipping SLOW test 69 00000001:02000400:0.0F:1734256829.604133:0:4229:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: == conf-sanity test 70a: start MDT0, then OST, then MDT1 ========================================================== 05:00:29 (1734256829) 00000001:02000400:1.0:1734256830.215687:0:4380:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: conf-sanity test_70a needs >= 2 MDTs 00000001:02000400:3.0F:1734256830.845038:0:4547:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: == conf-sanity test 70b: start OST, MDT1, MDT0 =========== 05:00:30 (1734256830) 00000001:02000400:1.0:1734256831.376082:0:4697:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: conf-sanity test_70b needs >= 2 MDTs 00000001:02000400:1.0:1734256832.006942:0:4865:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: == conf-sanity test 70c: stop MDT0, mkdir fail, create remote dir fail ========================================================== 05:00:31 (1734256831) 00000001:02000400:1.0:1734256832.583969:0:5015:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: conf-sanity test_70c needs >= 2 MDTs 00000001:02000400:3.0:1734256833.318832:0:5182:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: == conf-sanity test 70d: stop MDT1, mkdir succeed, create remote dir fail ========================================================== 05:00:32 (1734256832) 00000001:02000400:3.0:1734256833.795921:0:5332:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: conf-sanity test_70d needs >= 2 MDTs 00000001:02000400:1.0:1734256834.392297:0:5499:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: == conf-sanity test 72: test fast symlink with extents flag enabled ========================================================== 05:00:33 (1734256833) 00000001:02000400:1.0:1734256834.949824:0:5649:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: conf-sanity test_72 ldiskfs only test 00000001:02000400:3.0:1734256835.723492:0:5816:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: == conf-sanity test 73: failnode to update from mountdata properly ========================================================== 05:00:35 (1734256835) 00000400:00000010:1.0:1734256837.774823:0:5984:0:(lib-cpt.c:94:cfs_cpt_table_alloc()) alloc '(cptab)': 56 at ffff880130123e00. 00000400:00000010:1.0:1734256837.774829:0:5984:0:(lib-cpt.c:103:cfs_cpt_table_alloc()) alloc '(cptab->ctb_nodemask)': 128 at ffff8800b5851400. 00000400:00000010:1.0:1734256837.774831:0:5984:0:(lib-cpt.c:107:cfs_cpt_table_alloc()) alloc '(cptab->ctb_cpu2cpt)': 16 at ffff8800ab677310. 00000400:00000010:1.0:1734256837.774832:0:5984:0:(lib-cpt.c:114:cfs_cpt_table_alloc()) alloc '(cptab->ctb_node2cpt)': 4 at ffff8800ab7c2250. 00000400:00000010:1.0:1734256837.774833:0:5984:0:(lib-cpt.c:121:cfs_cpt_table_alloc()) alloc '(cptab->ctb_parts)': 32 at ffff8800b378efa0. 00000400:00000010:1.0:1734256837.774835:0:5984:0:(lib-cpt.c:133:cfs_cpt_table_alloc()) alloc '(part->cpt_nodemask)': 128 at ffff8800b5851480. 00000400:00000010:1.0:1734256837.774836:0:5984:0:(lib-cpt.c:137:cfs_cpt_table_alloc()) alloc '(part->cpt_distance)': 4 at ffff8800ab7c2350. 00000400:00000010:0.0:1734256838.539138:0:5984:0:(lock.c:44:cfs_percpt_lock_create()) alloc '(pcl)': 24 at ffff8800a8911760. 00000400:00000010:0.0:1734256838.539147:0:5984:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800a8911020. 00000400:00000010:0.0:1734256838.539151:0:5984:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff880130f68a00. 00000400:00000010:0.0:1734256838.539153:0:5984:0:(lock.c:44:cfs_percpt_lock_create()) alloc '(pcl)': 24 at ffff8800a8911820. 00000400:00000010:0.0:1734256838.539154:0:5984:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800a8911320. 00000400:00000010:0.0:1734256838.539155:0:5984:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff880130f68340. 00000400:00000200:0.0:1734256838.539201:0:5984:0:(api-ni.c:1018:lnet_register_lnd()) lo LND registered 00000400:00000200:3.0:1734256838.601354:0:5999:0:(api-ni.c:1018:lnet_register_lnd()) tcp LND registered 00000020:02000000:3.0:1734256838.647609:0:6011:0:(class_obd.c:744:obdclass_init()) Lustre: Build Version: 2.16.50_90_gf50dd6a 00000020:00000010:3.0:1734256838.650441:0:6011:0:(lustre_handles.c:168:class_handle_init()) kmalloced '(handle_hash)': 2097152 at ffff8800a9e00000. 00000001:00000010:3.0:1734256838.651189:0:6011:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800ab5d0480. 00000001:00000010:3.0:1734256838.651192:0:6011:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b605a580. 00000001:00000010:3.0:1734256838.651195:0:6011:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800ac421a00. 00000001:00000010:3.0:1734256838.651196:0:6011:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800ac420000. 00000001:00000010:3.0:1734256838.651198:0:6011:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800ac420e00. 00000001:00000010:3.0:1734256838.651200:0:6011:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800ac420600. 00000020:00000010:3.0:1734256838.651233:0:6011:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800ac421800. 00000020:00000010:3.0:1734256838.651236:0:6011:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800ac420400. 00000020:00000010:3.0:1734256838.651238:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa38c0. 00000020:00000010:3.0:1734256838.651245:0:6011:0:(cl_object.c:1099:cl_global_init()) kmalloced '(cl_envs)': 192 at ffff8800ab5d0cc0. 00000020:00000010:3.0:1734256838.651317:0:6011:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800ac421c00. 00000020:00000010:3.0:1734256838.651319:0:6011:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b6f9c200. 00000020:00000010:3.0:1734256838.651321:0:6011:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b6ee1300. 00000020:00000010:3.0:1734256838.651323:0:6011:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6f9da00. 00000020:00000010:3.0:1734256838.651326:0:6011:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6f9d400. 00000020:00000010:3.0:1734256838.651327:0:6011:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b6f9ce00. 00000020:00000010:3.0:1734256838.651328:0:6011:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b6ee1180. 00000020:00000010:3.0:1734256838.651330:0:6011:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6f9d200. 00000020:00000010:3.0:1734256838.651331:0:6011:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6f9c400. 00000020:00000010:3.0:1734256838.651333:0:6011:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b6f9d600. 00000020:00000010:3.0:1734256838.651334:0:6011:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b6ee10c0. 00000020:00000010:3.0:1734256838.651335:0:6011:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6f9d800. 00000020:00000010:3.0:1734256838.651337:0:6011:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6f9de00. 00000020:00000010:3.0:1734256838.651339:0:6011:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b6f9c600. 00000020:00000010:3.0:1734256838.651345:0:6011:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b6ee13c0. 00000020:00000010:3.0:1734256838.651346:0:6011:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6f9c000. 02000000:00000010:3.0:1734256838.651350:0:6011:0:(page_pools.c:1079:obd_pool_init()) kmalloced '(page_pools)': 120 at ffff88012aa25180. 02000000:00000010:3.0:1734256838.651352:0:6011:0:(page_pools.c:1083:obd_pool_init()) kmalloced '(pool_shrinkers)': 120 at ffff88012aa25480. 02000000:00000010:3.0:1734256838.651354:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b6f9c800. 02000000:00000010:3.0:1734256838.651356:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 1000 at ffff8800b41a5000. 02000000:00000010:3.0:1734256838.651358:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3680. 02000000:00000010:3.0:1734256838.651360:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b6f9cc00. 02000000:00000010:3.0:1734256838.651361:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 504 at ffff8800b6f9dc00. 02000000:00000010:3.0:1734256838.651363:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3300. 02000000:00000010:3.0:1734256838.651364:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b6f9d000. 02000000:00000010:3.0:1734256838.651366:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 256 at ffff8800b6316100. 02000000:00000010:3.0:1734256838.651367:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3140. 02000000:00000010:3.0:1734256838.651369:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612ba00. 02000000:00000010:3.0:1734256838.651370:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 128 at ffff88012aa25d80. 02000000:00000010:3.0:1734256838.651371:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa39c0. 02000000:00000010:3.0:1734256838.651373:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612b000. 02000000:00000010:3.0:1734256838.651374:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 64 at ffff88012aaa37c0. 02000000:00000010:3.0:1734256838.651375:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3d40. 02000000:00000010:3.0:1734256838.651377:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612ae00. 02000000:00000010:3.0:1734256838.651378:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 32 at ffff8800b605a540. 02000000:00000010:3.0:1734256838.651379:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3440. 02000000:00000010:3.0:1734256838.651381:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612ac00. 02000000:00000010:3.0:1734256838.651382:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 16 at ffff8800ab6e3090. 02000000:00000010:3.0:1734256838.651383:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3240. 02000000:00000010:3.0:1734256838.651385:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612aa00. 02000000:00000010:3.0:1734256838.651386:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 8 at ffff8801372b9ae8. 02000000:00000010:3.0:1734256838.651387:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3a80. 02000000:00000010:3.0:1734256838.651388:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612a800. 02000000:00000010:3.0:1734256838.651390:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 8 at ffff8801372b90f8. 02000000:00000010:3.0:1734256838.651393:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3dc0. 02000000:00000010:3.0:1734256838.651395:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612a600. 02000000:00000010:3.0:1734256838.651396:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 8 at ffff8801372b9950. 02000000:00000010:3.0:1734256838.651397:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3b40. 02000000:00000010:3.0:1734256838.651399:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612a400. 02000000:00000010:3.0:1734256838.651400:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 8 at ffff8801372b9eb0. 02000000:00000010:3.0:1734256838.651401:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3b80. 02000000:00000010:3.0:1734256838.651402:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612a200. 02000000:00000010:3.0:1734256838.651404:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 8 at ffff8801372b9b68. 02000000:00000010:3.0:1734256838.651405:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3400. 02000000:00000010:3.0:1734256838.651406:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612a000. 02000000:00000010:3.0:1734256838.651407:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 8 at ffff8801372b9db0. 02000000:00000010:3.0:1734256838.651409:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3a40. 02000000:00000010:3.0:1734256838.651410:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612be00. 02000000:00000010:3.0:1734256838.651411:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 8 at ffff8801372b9e88. 02000000:00000010:3.0:1734256838.651412:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3e80. 02000000:00000010:3.0:1734256838.651413:0:6011:0:(page_pools.c:1088:obd_pool_init()) kmalloced '(page_pools[pool_order])': 320 at ffff8800b612b800. 02000000:00000010:3.0:1734256838.651414:0:6011:0:(page_pools.c:1051:pool_ptrs_alloc()) kmalloced '(pool->opp_ptr_pages)': 8 at ffff8801372b98a8. 02000000:00000010:3.0:1734256838.651415:0:6011:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012aaa3580. 00000400:00000010:3.0:1734256838.712414:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a0a0. 00000400:00000010:3.0:1734256838.712425:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6b80. 00000100:00000010:3.0:1734256838.712429:0:6023:0:(service.c:3379:ptlrpc_hr_init()) kmalloced '(hrp->hrp_thrs)': 192 at ffff8800ab5d0780. 00000100:00000010:1.0:1734256838.712598:0:6024:0:(service.c:3020:ptlrpc_hr_main()) kmalloced '(env)': 56 at ffff8800b61833c0. 00000020:00000010:1.0:1734256838.712604:0:6024:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff88012ab8a400. 00000020:00000010:1.0:1734256838.712775:0:6024:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff88012ab8b000. 00000040:00000010:1.0:1734256838.712779:0:6024:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff88012ab8bc00. 00000020:00000010:1.0:1734256838.712782:0:6024:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff88012e1f7000. 00000020:00000010:1.0:1734256838.712785:0:6024:0:(lu_object.c:1919:lu_env_add_task()) kmalloced '(lei)': 40 at ffff8800b6183f80. 00000100:00000010:3.0:1734256838.712844:0:6025:0:(service.c:3020:ptlrpc_hr_main()) kmalloced '(env)': 56 at ffff8800b37c6100. 00000020:00000010:3.0:1734256838.712848:0:6025:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b612bc00. 00000020:00000010:3.0:1734256838.712850:0:6025:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b612b200. 00000040:00000010:3.0:1734256838.712852:0:6025:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b612b400. 00000020:00000010:3.0:1734256838.712854:0:6025:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff8800a9a23800. 00000020:00000010:3.0:1734256838.712856:0:6025:0:(lu_object.c:1919:lu_env_add_task()) kmalloced '(lei)': 40 at ffff8800b37c6f00. 00000100:00000200:3.0:1734256838.712964:0:6023:0:(events.c:609:ptlrpc_ni_init()) My pid is: 3039 00000400:00000010:3.0:1734256838.713116:0:6023:0:(api-ni.c:716:lnet_create_remote_nets_table()) alloc '(hash)': 1024 at ffff8800b41a6800. 00000400:00000010:3.0:1734256838.713119:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a1e0. 00000400:00000010:3.0:1734256838.713125:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 128 at ffff88012aa25780. 00000400:00000010:3.0:1734256838.713126:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a160. 00000400:00000010:3.0:1734256838.713128:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 128 at ffff88012aa25000. 00000400:00000010:3.0:1734256838.713132:0:6023:0:(peer.c:110:lnet_peer_tables_create()) alloc '(hash)': 8192 at ffff8800ab6ca000. 00000400:00000010:3.0:1734256838.713134:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a360. 00000400:00000010:3.0:1734256838.713136:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 128 at ffff88012aa25580. 00000400:00000010:3.0:1734256838.713139:0:6023:0:(lib-msg.c:1237:lnet_msg_container_setup()) alloc '(container->msc_finalizers)': 32 at ffff8800b605a280. 00000400:00000010:3.0:1734256838.713141:0:6023:0:(lib-msg.c:1247:lnet_msg_container_setup()) alloc '(container->msc_resenders)': 32 at ffff8800b605a1a0. 00000400:00000010:3.0:1734256838.713187:0:6023:0:(api-ni.c:1205:lnet_res_container_setup()) alloc '(rec->rec_lh_hash)': 65536 at ffffc90000840000. 00000400:00000010:3.0:1734256838.713196:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a300. 00000400:00000010:3.0:1734256838.713197:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6600. 00000400:00000010:3.0:1734256838.713235:0:6023:0:(api-ni.c:1205:lnet_res_container_setup()) alloc '(rec->rec_lh_hash)': 65536 at ffffc90000851000. 00000400:00000010:3.0:1734256838.713359:0:6023:0:(lib-ptl.c:866:lnet_portals_create()) alloc '(the_lnet.ln_portals)': 512 at ffff880137247800. 00000400:00000010:3.0:1734256838.713362:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee18a0. 00000400:00000010:3.0:1734256838.713364:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a180. 00000400:00000010:3.0:1734256838.713366:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6cc0. 00000400:00000010:3.0:1734256838.713369:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800ab6c8000. 00000400:00000010:3.0:1734256838.713371:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1420. 00000400:00000010:3.0:1734256838.713372:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a260. 00000400:00000010:3.0:1734256838.713374:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6a00. 00000400:00000010:3.0:1734256838.713377:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800ab6ce000. 00000400:00000010:3.0:1734256838.713379:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1f60. 00000400:00000010:3.0:1734256838.713380:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a140. 00000400:00000010:3.0:1734256838.713381:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6b40. 00000400:00000010:3.0:1734256838.713443:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800ab6cc000. 00000400:00000010:3.0:1734256838.713445:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1ea0. 00000400:00000010:3.0:1734256838.713447:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a120. 00000400:00000010:3.0:1734256838.713449:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6e00. 00000400:00000010:3.0:1734256838.713452:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012ff3e000. 00000400:00000010:3.0:1734256838.713454:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1cc0. 00000400:00000010:3.0:1734256838.713455:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a100. 00000400:00000010:3.0:1734256838.713456:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6580. 00000400:00000010:3.0:1734256838.713461:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012ff3c000. 00000400:00000010:3.0:1734256838.713463:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1060. 00000400:00000010:3.0:1734256838.713464:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a840. 00000400:00000010:3.0:1734256838.713465:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6940. 00000400:00000010:3.0:1734256838.713468:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012ff3a000. 00000400:00000010:3.0:1734256838.713470:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1ae0. 00000400:00000010:3.0:1734256838.713471:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a6a0. 00000400:00000010:3.0:1734256838.713472:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c62c0. 00000400:00000010:3.0:1734256838.713474:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012ff38000. 00000400:00000010:3.0:1734256838.713476:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee16c0. 00000400:00000010:3.0:1734256838.713477:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a500. 00000400:00000010:3.0:1734256838.713478:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6a40. 00000400:00000010:3.0:1734256838.713480:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012e2ae000. 00000400:00000010:3.0:1734256838.713482:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1360. 00000400:00000010:3.0:1734256838.713483:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a7a0. 00000400:00000010:3.0:1734256838.713484:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6440. 00000400:00000010:3.0:1734256838.713487:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012e2ac000. 00000400:00000010:3.0:1734256838.713488:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1720. 00000400:00000010:3.0:1734256838.713489:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aa40. 00000400:00000010:3.0:1734256838.713490:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6ac0. 00000400:00000010:3.0:1734256838.713493:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012e2aa000. 00000400:00000010:3.0:1734256838.713495:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1120. 00000400:00000010:3.0:1734256838.713496:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a7c0. 00000400:00000010:3.0:1734256838.713497:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6fc0. 00000400:00000010:3.0:1734256838.713500:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012e2a8000. 00000400:00000010:3.0:1734256838.713502:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1de0. 00000400:00000010:3.0:1734256838.713503:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aca0. 00000400:00000010:3.0:1734256838.713505:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6d00. 00000400:00000010:3.0:1734256838.713508:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012b01e000. 00000400:00000010:3.0:1734256838.713509:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1d20. 00000400:00000010:3.0:1734256838.713511:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605acc0. 00000400:00000010:3.0:1734256838.713512:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6900. 00000400:00000010:3.0:1734256838.713518:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012b01c000. 00000400:00000010:3.0:1734256838.713519:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee15a0. 00000400:00000010:3.0:1734256838.713521:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a660. 00000400:00000010:3.0:1734256838.713522:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6780. 00000400:00000010:3.0:1734256838.713525:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012b01a000. 00000400:00000010:3.0:1734256838.713526:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1840. 00000400:00000010:3.0:1734256838.713527:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a780. 00000400:00000010:3.0:1734256838.713528:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c67c0. 00000400:00000010:3.0:1734256838.713532:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012b018000. 00000400:00000010:3.0:1734256838.713533:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1a20. 00000400:00000010:3.0:1734256838.713534:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ad00. 00000400:00000010:3.0:1734256838.713536:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6300. 00000400:00000010:3.0:1734256838.713539:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a8c9e000. 00000400:00000010:3.0:1734256838.713541:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1ba0. 00000400:00000010:3.0:1734256838.713542:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a640. 00000400:00000010:3.0:1734256838.713543:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6380. 00000400:00000010:3.0:1734256838.713545:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a8c9c000. 00000400:00000010:3.0:1734256838.713547:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1a80. 00000400:00000010:3.0:1734256838.713548:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ace0. 00000400:00000010:3.0:1734256838.713549:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6280. 00000400:00000010:3.0:1734256838.713552:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a8c9a000. 00000400:00000010:3.0:1734256838.713553:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1c00. 00000400:00000010:3.0:1734256838.713554:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ab80. 00000400:00000010:3.0:1734256838.713555:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c63c0. 00000400:00000010:3.0:1734256838.713558:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a8c98000. 00000400:00000010:3.0:1734256838.713559:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1780. 00000400:00000010:3.0:1734256838.713560:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a7e0. 00000400:00000010:3.0:1734256838.713561:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6540. 00000400:00000010:3.0:1734256838.713565:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9bec000. 00000400:00000010:3.0:1734256838.713566:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1900. 00000400:00000010:3.0:1734256838.713567:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a880. 00000400:00000010:3.0:1734256838.713582:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6d40. 00000400:00000010:3.0:1734256838.713588:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9bea000. 00000400:00000010:3.0:1734256838.713590:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1960. 00000400:00000010:3.0:1734256838.713592:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a920. 00000400:00000010:3.0:1734256838.713593:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6140. 00000400:00000010:3.0:1734256838.713596:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9be8000. 00000400:00000010:3.0:1734256838.713597:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1000. 00000400:00000010:3.0:1734256838.713598:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a800. 00000400:00000010:3.0:1734256838.713600:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff8800b37c6240. 00000400:00000010:3.0:1734256838.713603:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9bee000. 00000400:00000010:3.0:1734256838.713604:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1660. 00000400:00000010:3.0:1734256838.713606:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ad20. 00000400:00000010:3.0:1734256838.713608:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6d40. 00000400:00000010:3.0:1734256838.713612:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9bfe000. 00000400:00000010:3.0:1734256838.713613:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1480. 00000400:00000010:3.0:1734256838.713614:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605adc0. 00000400:00000010:3.0:1734256838.713615:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6e40. 00000400:00000010:3.0:1734256838.713618:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9bfc000. 00000400:00000010:3.0:1734256838.713620:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1600. 00000400:00000010:3.0:1734256838.713621:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ab60. 00000400:00000010:3.0:1734256838.713622:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6480. 00000400:00000010:3.0:1734256838.713625:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9bfa000. 00000400:00000010:3.0:1734256838.713627:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1c60. 00000400:00000010:3.0:1734256838.713628:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ae00. 00000400:00000010:3.0:1734256838.713629:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6840. 00000400:00000010:3.0:1734256838.713632:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9bf8000. 00000400:00000010:3.0:1734256838.713634:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee19c0. 00000400:00000010:3.0:1734256838.713635:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a680. 00000400:00000010:3.0:1734256838.713636:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6a00. 00000400:00000010:3.0:1734256838.713639:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a91c6000. 00000400:00000010:3.0:1734256838.713641:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee17e0. 00000400:00000010:3.0:1734256838.713642:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a620. 00000400:00000010:3.0:1734256838.713643:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6bc0. 00000400:00000010:3.0:1734256838.713650:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a91c4000. 00000400:00000010:3.0:1734256838.713651:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1e40. 00000400:00000010:3.0:1734256838.713653:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a940. 00000400:00000010:3.0:1734256838.713654:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e63c0. 00000400:00000010:3.0:1734256838.713657:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a91c2000. 00000400:00000010:3.0:1734256838.713658:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee12a0. 00000400:00000010:3.0:1734256838.713659:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a8a0. 00000400:00000010:3.0:1734256838.713661:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6c80. 00000400:00000010:3.0:1734256838.713664:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a91c0000. 00000400:00000010:3.0:1734256838.713665:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1540. 00000400:00000010:3.0:1734256838.713666:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aa80. 00000400:00000010:3.0:1734256838.713667:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6000. 00000400:00000010:3.0:1734256838.713672:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800b36f6000. 00000400:00000010:3.0:1734256838.713673:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee1b40. 00000400:00000010:3.0:1734256838.713674:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a900. 00000400:00000010:3.0:1734256838.713675:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6880. 00000400:00000010:3.0:1734256838.713679:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800b36f4000. 00000400:00000010:3.0:1734256838.713681:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800b6ee11e0. 00000400:00000010:3.0:1734256838.713682:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a980. 00000400:00000010:3.0:1734256838.713683:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6040. 00000400:00000010:3.0:1734256838.713687:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800b36f2000. 00000400:00000010:3.0:1734256838.713689:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff88012aa65e40. 00000400:00000010:3.0:1734256838.713691:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a8c0. 00000400:00000010:3.0:1734256838.713692:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6280. 00000400:00000010:3.0:1734256838.713696:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800b36f0000. 00000400:00000010:3.0:1734256838.713698:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17300. 00000400:00000010:3.0:1734256838.713869:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aa60. 00000400:00000010:3.0:1734256838.713872:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e61c0. 00000400:00000010:3.0:1734256838.713876:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a90fe000. 00000400:00000010:3.0:1734256838.713878:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17a20. 00000400:00000010:3.0:1734256838.713879:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a9a0. 00000400:00000010:3.0:1734256838.713880:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e66c0. 00000400:00000010:3.0:1734256838.713887:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a90f8000. 00000400:00000010:3.0:1734256838.713888:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17f60. 00000400:00000010:3.0:1734256838.713890:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a8e0. 00000400:00000010:3.0:1734256838.713891:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6800. 00000400:00000010:3.0:1734256838.713894:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a90fa000. 00000400:00000010:3.0:1734256838.713896:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d171e0. 00000400:00000010:3.0:1734256838.713897:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ac60. 00000400:00000010:3.0:1734256838.713898:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6b00. 00000400:00000010:3.0:1734256838.713901:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a90fc000. 00000400:00000010:3.0:1734256838.713903:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17b40. 00000400:00000010:3.0:1734256838.713904:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ac20. 00000400:00000010:3.0:1734256838.713905:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6e80. 00000400:00000010:3.0:1734256838.713909:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a901e000. 00000400:00000010:3.0:1734256838.713911:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d173c0. 00000400:00000010:3.0:1734256838.713912:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605afe0. 00000400:00000010:3.0:1734256838.713913:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e67c0. 00000400:00000010:3.0:1734256838.713916:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a901c000. 00000400:00000010:3.0:1734256838.713917:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17900. 00000400:00000010:3.0:1734256838.713918:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ac00. 00000400:00000010:3.0:1734256838.713919:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6440. 00000400:00000010:3.0:1734256838.713922:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a901a000. 00000400:00000010:3.0:1734256838.713924:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17a80. 00000400:00000010:3.0:1734256838.713925:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605afc0. 00000400:00000010:3.0:1734256838.713926:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6dc0. 00000400:00000010:3.0:1734256838.713929:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9018000. 00000400:00000010:3.0:1734256838.713931:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d172a0. 00000400:00000010:3.0:1734256838.713932:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605abc0. 00000400:00000010:3.0:1734256838.713933:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6ec0. 00000400:00000010:3.0:1734256838.713937:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff880136b30000. 00000400:00000010:3.0:1734256838.713938:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17de0. 00000400:00000010:3.0:1734256838.713939:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ac40. 00000400:00000010:3.0:1734256838.713940:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6d80. 00000400:00000010:3.0:1734256838.713947:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff880136b32000. 00000400:00000010:3.0:1734256838.713949:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17360. 00000400:00000010:3.0:1734256838.713950:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ab40. 00000400:00000010:3.0:1734256838.713952:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6180. 00000400:00000010:3.0:1734256838.713955:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8801370fe000. 00000400:00000010:3.0:1734256838.713956:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17240. 00000400:00000010:3.0:1734256838.713957:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ada0. 00000400:00000010:3.0:1734256838.713959:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6380. 00000400:00000010:3.0:1734256838.713962:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8801370fc000. 00000400:00000010:3.0:1734256838.713963:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17060. 00000400:00000010:3.0:1734256838.713965:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aae0. 00000400:00000010:3.0:1734256838.713966:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6f80. 00000400:00000010:3.0:1734256838.713969:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012dc36000. 00000400:00000010:3.0:1734256838.713971:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17600. 00000400:00000010:3.0:1734256838.713972:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605abe0. 00000400:00000010:3.0:1734256838.713974:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6680. 00000400:00000010:3.0:1734256838.713977:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff88012dc30000. 00000400:00000010:3.0:1734256838.713978:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d176c0. 00000400:00000010:3.0:1734256838.713979:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ade0. 00000400:00000010:3.0:1734256838.713980:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6540. 00000400:00000010:3.0:1734256838.713983:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8801369de000. 00000400:00000010:3.0:1734256838.713985:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17720. 00000400:00000010:3.0:1734256838.713986:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aba0. 00000400:00000010:3.0:1734256838.713987:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6f00. 00000400:00000010:3.0:1734256838.713990:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8801369da000. 00000400:00000010:3.0:1734256838.713992:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17d80. 00000400:00000010:3.0:1734256838.713993:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ae20. 00000400:00000010:3.0:1734256838.713994:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6c00. 00000400:00000010:3.0:1734256838.714001:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a8ca0000. 00000400:00000010:3.0:1734256838.714003:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17120. 00000400:00000010:3.0:1734256838.714004:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aac0. 00000400:00000010:3.0:1734256838.714006:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6780. 00000400:00000010:3.0:1734256838.714011:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a8ca2000. 00000400:00000010:3.0:1734256838.714013:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d179c0. 00000400:00000010:3.0:1734256838.714014:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aa20. 00000400:00000010:3.0:1734256838.714015:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6b80. 00000400:00000010:3.0:1734256838.714018:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a8ca4000. 00000400:00000010:3.0:1734256838.714020:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17c00. 00000400:00000010:3.0:1734256838.714021:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605af80. 00000400:00000010:3.0:1734256838.714022:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6700. 00000400:00000010:3.0:1734256838.714025:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a8ca6000. 00000400:00000010:3.0:1734256838.714027:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17f00. 00000400:00000010:3.0:1734256838.714028:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605afa0. 00000400:00000010:3.0:1734256838.714029:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e68c0. 00000400:00000010:3.0:1734256838.714034:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800abff0000. 00000400:00000010:3.0:1734256838.714036:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17e40. 00000400:00000010:3.0:1734256838.714037:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aec0. 00000400:00000010:3.0:1734256838.714038:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e65c0. 00000400:00000010:3.0:1734256838.714041:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800abff2000. 00000400:00000010:3.0:1734256838.714042:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17cc0. 00000400:00000010:3.0:1734256838.714043:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605af60. 00000400:00000010:3.0:1734256838.714044:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6640. 00000400:00000010:3.0:1734256838.714047:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800abff4000. 00000400:00000010:3.0:1734256838.714048:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17d20. 00000400:00000010:3.0:1734256838.714049:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605af40. 00000400:00000010:3.0:1734256838.714050:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6a80. 00000400:00000010:3.0:1734256838.714053:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800abff6000. 00000400:00000010:3.0:1734256838.714054:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17180. 00000400:00000010:3.0:1734256838.714055:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605af20. 00000400:00000010:3.0:1734256838.714056:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6300. 00000400:00000010:3.0:1734256838.714061:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a9308000. 00000400:00000010:3.0:1734256838.714062:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17780. 00000400:00000010:3.0:1734256838.714063:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605af00. 00000400:00000010:3.0:1734256838.714064:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6ac0. 00000400:00000010:3.0:1734256838.714069:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a930a000. 00000400:00000010:3.0:1734256838.714071:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17660. 00000400:00000010:3.0:1734256838.714072:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aaa0. 00000400:00000010:3.0:1734256838.714073:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6b40. 00000400:00000010:3.0:1734256838.714076:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a930c000. 00000400:00000010:3.0:1734256838.714077:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17420. 00000400:00000010:3.0:1734256838.714078:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605aea0. 00000400:00000010:3.0:1734256838.714079:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6d00. 00000400:00000010:3.0:1734256838.714082:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800a930e000. 00000400:00000010:3.0:1734256838.714084:0:6023:0:(lib-ptl.c:873:lnet_portals_create()) alloc '(the_lnet.ln_portals[i])': 84 at ffff8800a8d17c60. 00000400:00000010:3.0:1734256838.714085:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ae80. 00000400:00000010:3.0:1734256838.714086:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6c40. 00000400:00000010:3.0:1734256838.714092:0:6023:0:(lib-ptl.c:817:lnet_ptl_setup()) alloc '(mhash)': 4112 at ffff8800ac460000. 00000400:00000010:3.0:1734256838.714095:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605ae60. 00000400:00000010:3.0:1734256838.714096:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6900. 00000400:00000010:3.0:1734256838.714098:0:6023:0:(config.c:328:lnet_net_alloc()) alloc '(net)': 176 at ffff8800ab5d0d80. 00000400:00000010:3.0:1734256838.714101:0:6023:0:(config.c:409:lnet_ni_alloc_common()) alloc '(ni)': 448 at ffff880137247e00. 00000400:00000010:3.0:1734256838.714102:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b605a9e0. 00000400:00000010:3.0:1734256838.714103:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6400. 00000400:00000010:3.0:1734256838.714105:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b5bf3800. 00000400:00000010:3.0:1734256838.714107:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6980. 00000400:00000010:3.0:1734256838.714110:0:6023:0:(config.c:573:lnet_parse_networks()) alloc '(tokens)': 4 at ffff8801372b98b8. 00000400:00000010:3.0:1734256838.714113:0:6023:0:(config.c:328:lnet_net_alloc()) alloc '(net)': 176 at ffff8800ab5d0180. 00000400:00000010:3.0:1734256838.714115:0:6023:0:(config.c:409:lnet_ni_alloc_common()) alloc '(ni)': 448 at ffff8800b605f600. 00000400:00000010:3.0:1734256838.714116:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b5bf3960. 00000400:00000010:3.0:1734256838.714117:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6340. 00000400:00000010:3.0:1734256838.714119:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b5bf3dc0. 00000400:00000010:3.0:1734256838.714120:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6940. 00000400:00000010:3.0:1734256838.714121:0:6023:0:(config.c:785:lnet_parse_networks()) kfreed 'tokens': 4 at ffff8801372b98b8. 00000400:00000010:3.0:1734256838.714131:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b5bf3420. 00000400:00000010:3.0:1734256838.714133:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 128 at ffff88012aa25900. 00000800:00000200:3.0:1734256838.714542:0:6023:0:(socklnd.c:2173:ksocknal_device_event()) devevent: status=NETDEV_REGISTER, iface=lo ifindex 1 state 0 00000800:00000200:3.0:1734256838.714545:0:6023:0:(socklnd.c:2173:ksocknal_device_event()) devevent: status=NETDEV_UP, iface=lo ifindex 1 state 0 00000800:00000200:3.0:1734256838.714549:0:6023:0:(socklnd.c:2173:ksocknal_device_event()) devevent: status=NETDEV_REGISTER, iface=eth0 ifindex 2 state 6 00000800:00000200:3.0:1734256838.714550:0:6023:0:(socklnd.c:2173:ksocknal_device_event()) devevent: status=NETDEV_UP, iface=eth0 ifindex 2 state 6 00000800:00000010:3.0:1734256838.714554:0:6023:0:(socklnd.c:2636:ksocknal_startup()) alloc '(net)': 208 at ffff8800b6316300. 00000400:00000010:3.0:1734256838.714561:0:6023:0:(config.c:382:lnet_ni_add_interface()) alloc '(ni->ni_interface)': 5 at ffff8801372b98b8. 00000800:00000010:1.0:1734256838.714919:0:6031:0:(socklnd_cb.c:1459:ksocknal_scheduler()) alloc '(rx_scratch_pgs)': 2048 at ffff88012e1f3000. 00000800:00000010:1.0:1734256838.714923:0:6031:0:(socklnd_cb.c:1466:ksocknal_scheduler()) alloc '(scratch_iov)': 4096 at ffff8800a9879000. 00000800:00000010:1.0:1734256838.714980:0:6032:0:(socklnd_cb.c:1459:ksocknal_scheduler()) alloc '(rx_scratch_pgs)': 2048 at ffff88012e1f7800. 00000800:00000010:1.0:1734256838.714983:0:6032:0:(socklnd_cb.c:1466:ksocknal_scheduler()) alloc '(scratch_iov)': 4096 at ffff8800a9878000. 00000400:00000200:3.0:1734256838.715011:0:6023:0:(config.c:1507:lnet_get_link_status()) device idx 1 get_link 2 00000800:00000010:1.0:1734256838.715013:0:6033:0:(socklnd_cb.c:1459:ksocknal_scheduler()) alloc '(rx_scratch_pgs)': 2048 at ffff88012e1f6800. 00000800:00000010:1.0:1734256838.715015:0:6033:0:(socklnd_cb.c:1466:ksocknal_scheduler()) alloc '(scratch_iov)': 4096 at ffff8800a987b000. 00000400:02000000:3.0:1734256838.715017:0:6023:0:(api-ni.c:2590:lnet_startup_lndni()) Added LNI 192.168.202.8@tcp [8/256/0/180] 00000400:02000000:1.0:1734256838.717131:0:6034:0:(acceptor.c:374:lnet_acceptor()) Accept secure, port 988 00000400:00000010:3.0:1734256838.718675:0:6023:0:(api-ni.c:1785:lnet_ping_buffer_alloc()) alloc '(pbuf)': 57 at ffff88012e9e6cc0. 00000400:00000010:3.0:1734256838.718682:0:6023:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16b00. 00000400:00000010:3.0:1734256838.718686:0:6023:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a4c8. 00000400:00000200:3.0:1734256838.718694:0:6023:0:(lib-ptl.c:920:LNetSetLazyPortal()) Setting portal 0 lazy 00000400:00000010:3.0:1734256838.718696:0:6023:0:(api-ni.c:1785:lnet_ping_buffer_alloc()) alloc '(pbuf)': 281 at ffff8800b605e800. 00000400:00000010:3.0:1734256838.718698:0:6023:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16b58. 00000400:00000010:3.0:1734256838.718700:0:6023:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000400:00000200:3.0:1734256838.718701:0:6023:0:(api-ni.c:2229:lnet_push_target_post()) posted push target ffff8800b605e800 00000400:00000200:3.0:1734256838.718703:0:6023:0:(api-ni.c:2186:lnet_push_target_resize()) nbytes 272 success 00000400:00000010:3.0:1734256838.718706:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b5bf3ea0. 00000400:00000010:3.0:1734256838.718710:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e60c0. 00000400:00000010:3.0:1734256838.718712:0:6023:0:(lib-cpt.c:1148:cfs_percpt_alloc()) alloc '(arr)': 24 at ffff8800b5bf3ca0. 00000400:00000010:3.0:1734256838.718713:0:6023:0:(lib-cpt.c:1158:cfs_percpt_alloc()) alloc '(arr->va_ptrs[i])': 64 at ffff88012e9e6100. 00000400:00000200:0.0:1734256838.718929:0:6023:0:(peer.c:4245:lnet_peer_discovery_start()) discovery start: 0 00000400:00000200:2.0F:1734256838.719000:0:6036:0:(peer.c:4067:lnet_peer_discovery()) started 00000100:00000010:0.0:1734256838.719031:0:6023:0:(ptlrpcd.c:815:ptlrpcd_init()) kmalloced '(ptlrpcds)': 8 at ffff88013685aa00. 00000100:00000010:3.0:1734256838.719135:0:6037:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800ab5d0300. 00000020:00000010:3.0:1734256838.719177:0:6037:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b605ee00. 00000020:00000010:3.0:1734256838.719181:0:6037:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b60e2200. 00000020:00000010:3.0:1734256838.719184:0:6037:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800a8d17ea0. 00000040:00000010:3.0:1734256838.719186:0:6037:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b60e3800. 00000020:00000010:3.0:1734256838.719188:0:6037:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff8800a9a20000. 00000020:00000010:3.0:1734256838.719190:0:6037:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b60e3a00. 00000100:00000010:0.0:1734256838.719197:0:6023:0:(ptlrpcd.c:912:ptlrpcd_init()) kmalloced '(pd)': 760 at ffff8800b61bb400. 00000100:00000010:0.0:1734256838.719201:0:6023:0:(ptlrpcd.c:603:ptlrpcd_partners()) kmalloced '(pc->pc_partners)': 8 at ffff88013685af08. 00000100:00000010:0.0:1734256838.719203:0:6023:0:(ptlrpcd.c:603:ptlrpcd_partners()) kmalloced '(pc->pc_partners)': 8 at ffff88013685aea8. 00000100:00000010:0.0:1734256838.719204:0:6023:0:(ptlrpcd.c:603:ptlrpcd_partners()) kmalloced '(pc->pc_partners)': 8 at ffff88013685a608. 00000100:00000010:0.0:1734256838.719206:0:6023:0:(ptlrpcd.c:603:ptlrpcd_partners()) kmalloced '(pc->pc_partners)': 8 at ffff88013685ac08. 00000100:00000010:3.0:1734256838.719328:0:6038:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800ab5d0540. 00000020:00000010:3.0:1734256838.719331:0:6038:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b60e2a00. 00000020:00000010:3.0:1734256838.719332:0:6038:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b60e3000. 00000020:00000010:3.0:1734256838.719334:0:6038:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800a8d17480. 00000040:00000010:3.0:1734256838.719335:0:6038:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b60e3e00. 00000020:00000010:3.0:1734256838.719337:0:6038:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff8800a9a22800. 00000020:00000010:3.0:1734256838.719339:0:6038:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b60e3c00. 00000100:00000010:3.0:1734256838.719412:0:6039:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800ab5d0900. 00000020:00000010:3.0:1734256838.719414:0:6039:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b60e2600. 00000020:00000010:3.0:1734256838.719416:0:6039:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b60e2c00. 00000020:00000010:3.0:1734256838.719417:0:6039:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800a8d17960. 00000040:00000010:3.0:1734256838.719419:0:6039:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b60e2800. 00000020:00000010:3.0:1734256838.719420:0:6039:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff8800a9a25800. 00000020:00000010:3.0:1734256838.719422:0:6039:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b60e3600. 00000100:00000010:3.0:1734256838.719497:0:6040:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800ab5d00c0. 00000020:00000010:3.0:1734256838.719499:0:6040:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b60e3400. 00000020:00000010:3.0:1734256838.719500:0:6040:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b60e2400. 00000020:00000010:3.0:1734256838.719502:0:6040:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800a8d178a0. 00000040:00000010:3.0:1734256838.719503:0:6040:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b60e3200. 00000020:00000010:3.0:1734256838.719505:0:6040:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff8800a9a20800. 00000020:00000010:3.0:1734256838.719506:0:6040:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b60e2e00. 00000100:00000010:3.0:1734256838.719613:0:6041:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800ab5d0000. 00000020:00000010:3.0:1734256838.719616:0:6041:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6d9a800. 00000020:00000010:3.0:1734256838.719618:0:6041:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800a9c3bc00. 00000020:00000010:3.0:1734256838.719620:0:6041:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800a8d174e0. 00000040:00000010:3.0:1734256838.719621:0:6041:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800a9c3ba00. 00000020:00000010:3.0:1734256838.719623:0:6041:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff8800a9a27800. 00000020:00000010:3.0:1734256838.719625:0:6041:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800a9c3b800. 00000100:00000010:0.0:1734256838.720009:0:6023:0:(nrs.c:1252:ptlrpc_nrs_policy_register()) kmalloced '(desc)': 72 at ffff88012a4f9240. 00000100:00000010:0.0:1734256838.720013:0:6023:0:(nrs.c:1252:ptlrpc_nrs_policy_register()) kmalloced '(desc)': 72 at ffff88012a4f9cc0. 00000100:00000010:0.0:1734256838.720015:0:6023:0:(nrs.c:1252:ptlrpc_nrs_policy_register()) kmalloced '(desc)': 72 at ffff88012a4f9420. 00000100:00000010:0.0:1734256838.720016:0:6023:0:(nrs.c:1252:ptlrpc_nrs_policy_register()) kmalloced '(desc)': 72 at ffff88012a4f9d20. 00000100:00000010:0.0:1734256838.720018:0:6023:0:(nrs.c:1252:ptlrpc_nrs_policy_register()) kmalloced '(desc)': 72 at ffff88012a4f9d80. 00000100:00000010:0.0:1734256838.720019:0:6023:0:(nrs.c:1252:ptlrpc_nrs_policy_register()) kmalloced '(desc)': 72 at ffff88012a4f9f60. 00000001:00000010:0.0:1734256838.720181:0:6023:0:(nodemap_handler.c:1918:nodemap_config_alloc()) kmalloced '(config)': 112 at ffff8800b3733e00. 00000001:00000010:0.0:1734256838.720185:0:6023:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800b6115a80. 00000001:00000010:0.0:1734256838.720188:0:6023:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 8 at ffff88013685ae38. 00000001:00000010:0.0:1734256838.720190:0:6023:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 136 at ffff8800b61150c0. 00000001:00000010:0.0:1734256838.720196:0:6023:0:(nodemap_handler.c:1274:nodemap_create()) kmalloced '(nodemap)': 4728 at ffff8800ac584000. 00000001:00000010:0.0:1734256838.720205:0:6023:0:(nodemap_lproc.c:1023:lprocfs_nodemap_register()) kmalloced '(nm_entry)': 48 at ffff88012a400780. 02000000:00000010:2.0:1734256838.753179:0:6053:0:(upcall_cache.c:549:upcall_cache_init()) alloc '(cache)': 1192 at ffff880136992800. 02000000:00000010:2.0:1734256838.753185:0:6053:0:(upcall_cache.c:557:upcall_cache_init()) alloc '(cache->uc_hashtable)': 1024 at ffff8800b580d400. 02000000:00000010:2.0:1734256838.753187:0:6053:0:(upcall_cache.c:549:upcall_cache_init()) alloc '(cache)': 1192 at ffff880136996800. 02000000:00000010:2.0:1734256838.753205:0:6053:0:(upcall_cache.c:557:upcall_cache_init()) alloc '(cache->uc_hashtable)': 16384 at ffffc90000862000. 00000020:00000010:3.0:1734256840.473951:0:6091:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff88012aa25200. 00000008:00000010:0.0:1734256840.531893:0:6103:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff88012dbfbb80. 00000100:00000010:0.0:1734256840.531898:0:6103:0:(client.c:666:ptlrpc_init_rq_pool()) kmalloced '(pool)': 56 at ffff88012dbfb5c0. 00000020:00000010:0.0:1734256840.531918:0:6103:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b3733000. 00000020:00000010:2.0:1734256840.587103:0:6115:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800a9ca4c80. 00000020:00000010:0.0:1734256840.626325:0:6127:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b3733a80. 00000020:00000010:3.0:1734256840.680019:0:6139:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b4156700. 00008000:02000000:2.0:1734256840.735876:0:6151:0:(echo_client.c:2587:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000020:00000010:2.0:1734256840.738178:0:6151:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800a9ca4f80. 00000020:00000010:2.0:1734256840.738415:0:6151:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800a9ca4480. 00000020:00000010:2.0:1734256840.860195:0:6172:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800a9ca4080. 00000020:00000010:1.0:1734256841.651699:0:6389:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b5851700. 00000020:00000010:1.0:1734256841.748409:0:6401:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b5851500. 00000020:00000010:0.0:1734256841.844471:0:6413:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b3733d80. 00000020:00000010:0.0:1734256841.844496:0:6413:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b3733400. 00000020:00000010:0.0:1734256841.899273:0:6425:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b3733500. 00000020:00000010:2.0:1734256841.958284:0:6437:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800a9ca4700. 00000020:00000010:3.0:1734256842.024101:0:6449:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b4156200. 00000020:00000010:1.0:1734256842.107744:0:6461:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b5851380. 00000020:00000010:1.0:1734256842.107775:0:6461:0:(genops.c:255:class_register_type()) kmalloced '(type)': 112 at ffff8800b5851d80. 00000020:00000010:3.0:1734256842.202766:0:6473:0:(cl_object.c:655:cl_env_new()) slab-alloced 'cle': 144 at ffff8800b614a240. 00000020:00000010:3.0:1734256842.202772:0:6473:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800a9c3ac00. 00000020:00000010:3.0:1734256842.202775:0:6473:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800a9c3aa00. 00000020:00000010:3.0:1734256842.202777:0:6473:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800a8d17000. 00000008:00000010:3.0:1734256842.202792:0:6473:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a9848000. 00020000:00000010:3.0:1734256842.202794:0:6473:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800ab5d0a80. 00008000:00000010:3.0:1734256842.202800:0:6473:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90000. 00000080:00000010:3.0:1734256842.202805:0:6473:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f5000. 00000080:00000010:3.0:1734256842.202810:0:6473:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0000. 00000020:00000010:3.0:1734256842.202814:0:6473:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800a9c3a800. 00000008:00000010:3.0:1734256842.202819:0:6473:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a887a000. 00020000:00000010:3.0:1734256842.202824:0:6473:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800a9908000. 00008000:00000010:3.0:1734256842.202826:0:6473:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff8801372b9e98. 00000080:00000010:3.0:1734256842.202830:0:6473:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800ac5f7000. 00000001:02000400:3.0:1734256853.129641:0:7006:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000001:02000400:3.0:1734256858.217712:0:7428:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 00000020:00000010:0.0:1734256858.331245:0:7464:0:(obd_mount.c:665:lustre_init_lsi()) kmalloced '(lsi)': 1216 at ffff88012a599000. 00000020:00000010:0.0:1734256858.331251:0:7464:0:(obd_mount.c:668:lustre_init_lsi()) kmalloced '(lsi->lsi_lmd)': 112 at ffff8800b3733b80. 00000020:00000010:0.0:1734256858.331256:0:7464:0:(obd_mount.c:1495:lmd_parse()) kmalloced '(lmd->lmd_params)': 4096 at ffff8800a8852000. 00000020:00000010:0.0:1734256858.331265:0:7464:0:(obd_mount.c:1692:lmd_parse()) kmalloced '(lmd->lmd_dev)': 28 at ffff8800a99fb080. 00000020:00000010:0.0:1734256858.331267:0:7464:0:(obd_mount.c:1748:lmd_parse()) kmalloced '(lmd->lmd_profile)': 14 at ffff8800ac7e68b0. 00000020:00000010:0.0:1734256858.331269:0:7464:0:(obd_mount.c:1787:lmd_parse()) kmalloced '(lmd->lmd_opts)': 17 at ffff8800a99fb360. 00000020:00000010:0.0:1734256858.331280:0:7464:0:(obd_mount.c:329:lustre_start_mgc()) kmalloced '(mgcname)': 23 at ffff8800a99fb400. 00000020:00000010:0.0:1734256858.331282:0:7464:0:(obd_mount.c:239:mgc_niduuid_create()) kmalloced '(*niduuid)': 32 at ffff8800a99fb580. 00000020:00000010:0.0:1734256858.331284:0:7464:0:(obd_mount.c:338:lustre_start_mgc()) kmalloced '(data)': 192 at ffff8800b3664f00. 00000020:00000010:0.0:1734256858.331290:0:7464:0:(obd_mount.c:172:do_lcfg()) kmalloced '(lcfg)': 96 at ffff88012a4f9480. 00000100:00000010:0.0:1734256858.331294:0:7464:0:(lustre_peer.c:89:class_add_uuid()) kmalloced '(data)': 704 at ffff8800b3529000. 00000400:00000010:0.0:1734256858.331305:0:7464:0:(peer.c:231:lnet_peer_alloc()) alloc '(lp)': 376 at ffff8800b5b24800. 00000400:00000200:0.0:1734256858.331309:0:7464:0:(peer.c:271:lnet_peer_alloc()) ffff8800b5b24800 nid 192.168.202.108@tcp 00000400:00000010:0.0:1734256858.331311:0:7464:0:(peer.c:195:lnet_peer_net_alloc()) alloc '(lpn)': 72 at ffff88012a4f9e40. 00000400:00000200:0.0:1734256858.331313:0:7464:0:(peer.c:204:lnet_peer_net_alloc()) ffff88012a4f9e40 net tcp 00000400:00000010:0.0:1734256858.331315:0:7464:0:(peer.c:139:lnet_peer_ni_alloc()) alloc '(lpni)': 384 at ffff8800b5b25600. 00000400:00000200:0.0:1734256858.331318:0:7464:0:(peer.c:185:lnet_peer_ni_alloc()) ffff8800b5b25600 nid 192.168.202.108@tcp 00000400:00000200:0.0:1734256858.331321:0:7464:0:(peer.c:1100:lnet_peer_ni_clr_non_mr_pref_nid()) peer 192.168.202.108@tcp: -2 00000400:00000200:0.0:1734256858.331325:0:7464:0:(peer.c:1659:lnet_peer_attach_peer_ni()) peer 192.168.202.108@tcp NID 192.168.202.108@tcp flags 0x100001 00000400:00000200:0.0:1734256858.331402:0:7464:0:(peer.c:2425:lnet_peer_queue_for_discovery()) Queue peer 192.168.202.108@tcp: 0 00000400:00000200:0.0:1734256858.331405:0:7464:0:(peer.c:2747:lnet_discover_peer_locked()) Discovery attempt # 1 00000400:00000200:0.0:1734256858.331407:0:7464:0:(peer.c:2787:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:0.0:1734256858.331409:0:7464:0:(peer.c:2796:lnet_discover_peer_locked()) peer 192.168.202.108@tcp NID 192.168.202.108@tcp: 0. pending discovery 00000020:00000010:0.0:1734256858.331412:0:7464:0:(obd_mount.c:178:do_lcfg()) kfreed 'lcfg': 96 at ffff88012a4f9480. 00000020:00000010:0.0:1734256858.331415:0:7464:0:(obd_mount.c:470:lustre_start_mgc()) kmalloced '(uuid)': 40 at ffff8800b5a9d840. 00000020:00000010:0.0:1734256858.331421:0:7464:0:(obd_mount.c:172:do_lcfg()) kmalloced '(lcfg)': 120 at ffff8800b3733780. 00000020:00000010:0.0:1734256858.331436:0:7464:0:(genops.c:70:obd_device_alloc()) slab-alloced 'obd': 5488 at ffff88012d078000. 00000020:00000010:0.0:1734256858.331441:0:7464:0:(genops.c:973:__class_new_export()) kmalloced '(export)': 1176 at ffff88012a59f800. 00000020:00000010:0.0:1734256858.331449:0:7464:0:(obd_mount.c:178:do_lcfg()) kfreed 'lcfg': 120 at ffff8800b3733780. 00000020:00000010:0.0:1734256858.331452:0:7464:0:(obd_mount.c:172:do_lcfg()) kmalloced '(lcfg)': 112 at ffff8800b3733780. 00000001:00000010:0.0:1734256858.331464:0:7464:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800b3664780. 00000001:00000010:0.0:1734256858.331467:0:7464:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800a99fb700. 00000001:00000010:0.0:1734256858.331470:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b5b24000. 00000001:00000010:0.0:1734256858.331475:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b5b25200. 00000001:00000010:0.0:1734256858.331477:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b5b25800. 00000001:00000010:0.0:1734256858.331479:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b5b24600. 00000001:00000010:0.0:1734256858.331481:0:7464:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800b3664b40. 00000001:00000010:0.0:1734256858.331483:0:7464:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800a99fb440. 00000001:00000010:0.0:1734256858.331485:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b5b24c00. 00000001:00000010:0.0:1734256858.331486:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b5b25000. 00000001:00000010:0.0:1734256858.331487:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b5b24e00. 00000001:00000010:0.0:1734256858.331489:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b5b25c00. 00010000:00000010:0.0:1734256858.331498:0:7464:0:(ldlm_lockd.c:3262:ldlm_setup()) kmalloced '(ldlm_state)': 32 at ffff8800a99fba60. 00000100:00000010:0.0:1734256858.331551:0:7464:0:(service.c:761:ptlrpc_register_service()) kmalloced '(service)': 320 at ffff88012a5c7c00. 00000100:00000010:0.0:1734256858.331555:0:7464:0:(service.c:819:ptlrpc_register_service()) kmalloced '(svcpt)': 800 at ffff8800b3528800. 00000100:00000010:0.0:1734256858.331566:0:7464:0:(service.c:650:ptlrpc_service_part_init()) kmalloced '(array->paa_reqs_array)': 12080 at ffff88012b534000. 00000100:00000010:0.0:1734256858.331601:0:7464:0:(service.c:658:ptlrpc_service_part_init()) kmalloced '(array->paa_reqs_count)': 3020 at ffff8800a8854000. 00000100:00000010:0.0:1734256858.331605:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b3528c00. 00000100:00000010:0.0:1734256858.331609:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff8800ac582000. 00000400:00000200:0.0:1734256858.331612:0:7464:0:(lib-ptl.c:920:LNetSetLazyPortal()) Setting portal 15 lazy 00000020:00000010:0.0:1734256858.331633:0:7464:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b3733600. 00000020:00000010:0.0:1734256858.331637:0:7464:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff8800a8855000. 00000100:00000010:0.0:1734256858.331672:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b3664cc0. 00000100:00000010:0.0:1734256858.331676:0:7464:0:(nrs_fifo.c:83:nrs_fifo_start()) kmalloced '(head)': 40 at ffff8800b5a9d700. 00000100:00000010:0.0:1734256858.331679:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b3664540. 00000100:00000010:0.0:1734256858.331682:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b36649c0. 00000100:00000010:0.0:1734256858.331684:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b3664900. 00000100:00000200:0.0:1734256858.331705:0:7464:0:(service.c:852:ptlrpc_register_service()) ldlm_cbd: Started, listening on portal 15 00000100:00000010:0.0:1734256858.331708:0:7464:0:(service.c:3260:ptlrpc_start_thread()) kmalloced '(thread)': 272 at ffff88012a5c6800. 00000400:00000200:2.0:1734256858.331800:0:6036:0:(peer.c:4014:lnet_peer_discovery_wait_for_work()) woken: 0 00000400:00000200:2.0:1734256858.331804:0:6036:0:(peer.c:4126:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100041 00000400:00000010:2.0:1734256858.331808:0:6036:0:(api-ni.c:1785:lnet_ping_buffer_alloc()) alloc '(pbuf)': 281 at ffff8800b364fc00. 00000400:00000010:2.0:1734256858.331812:0:6036:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000400:00000010:2.0:1734256858.331824:0:6036:0:(lib-lnet.h:469:lnet_rspt_alloc()) alloc 'rspt': 56 at ffff8800b62004d0. 00000400:00000200:2.0:1734256858.331827:0:6036:0:(lib-move.c:5498:LNetGet()) LNetGet -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.331842:0:6036:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.331846:0:6036:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.331849:0:6036:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.331851:0:6036:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.331853:0:6036:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.331856:0:6036:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1:1:256:4294967295] 192.168.202.108@tcp LPNI seq info [1:1:8:4294967295] 00000400:00000200:2.0:1734256858.331859:0:6036:0:(lib-move.c:1973:lnet_handle_send()) rspt_next_hop_nid = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.331865:0:6036:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : GET try# 0 00000800:00000200:2.0:1734256858.331870:0:6036:0:(socklnd_cb.c:1000:ksocknal_send()) sending 0 bytes in 0 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.331873:0:6036:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 232 at ffff8800b404c700. 00000800:00000010:2.0:1734256858.331879:0:6036:0:(socklnd.c:156:ksocknal_create_peer()) alloc '(peer_ni)': 184 at ffff8800b401fe40. 00000800:00000010:2.0:1734256858.331881:0:6036:0:(socklnd.c:105:ksocknal_create_conn_cb()) alloc '(conn_cb)': 192 at ffff8800b401f480. 00000800:00000200:2.0:1734256858.331884:0:6036:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (2) 00000800:00000200:2.1F:1734256858.331887:0:6036:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (2) 00000400:00000200:2.0:1734256858.331913:0:6036:0:(peer.c:3814:lnet_peer_send_ping()) peer 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.331915:0:6036:0:(peer.c:4148:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100241 rc 0 00000100:00000010:0.0:1734256858.332025:0:7465:0:(service.c:2818:ptlrpc_main()) kmalloced '(env)': 56 at ffff8800b5a9de80. 00000020:00000010:0.0:1734256858.332029:0:7465:0:(lu_object.c:1919:lu_env_add_task()) kmalloced '(lei)': 40 at ffff8800b5a9d380. 00000020:00000010:0.0:1734256858.332033:0:7465:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff88012a5c6200. 00000020:00000010:0.0:1734256858.332036:0:7465:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff88012a5c7600. 00000040:00000010:0.0:1734256858.332039:0:7465:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff88012a5c6a00. 00000020:00000010:0.0:1734256858.332042:0:7465:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff88012a59e000. 00000020:00000010:0.0:1734256858.332054:0:7465:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012f360000. 00000020:00000010:0.0:1734256858.332058:0:7465:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff88012a5c6600. 80000000:00000010:0.0:1734256858.332060:0:7465:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff88012a4f9480. 40000000:00000010:0.0:1734256858.332063:0:7465:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff8800b5a9d000. 00100000:00000010:0.0:1734256858.332066:0:7465:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff88012a59d000. 00040000:00000010:0.0:1734256858.332069:0:7465:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b34d4c00. 00040000:00000010:0.0:1734256858.332072:0:7465:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff88012a598800. 00040000:00000010:0.0:1734256858.332074:0:7465:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff88012a5c6400. 00000004:00000010:0.0:1734256858.332078:0:7465:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff88012a59c800. 00000004:00000010:0.0:1734256858.332081:0:7465:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800a8857000. 00000004:00000010:0.0:1734256858.332084:0:7465:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff88012a59a800. 00002000:00000010:0.0:1734256858.332088:0:7465:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff8800b352b800. 00000004:00000010:0.0:1734256858.332091:0:7465:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff8800b3529400. 00000100:00000200:0.0:1734256858.332094:0:7465:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_cbd: registering portal 15 00000400:00000010:0.0:1734256858.332099:0:7465:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441160. 00000400:00000010:0.0:1734256858.332102:0:7465:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b3664300. 00000100:00000010:0.0:1734256858.332107:0:7465:0:(service.c:2845:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff88012a599800. 00000100:00000200:0.0:1734256858.332122:0:7465:0:(service.c:2879:ptlrpc_main()) service thread 0 (#1) started 00000100:00000010:2.0:1734256858.332137:0:7464:0:(service.c:3260:ptlrpc_start_thread()) kmalloced '(thread)': 272 at ffff8800b364f400. 00000100:00000010:3.0:1734256858.332442:0:7466:0:(service.c:2818:ptlrpc_main()) kmalloced '(env)': 56 at ffff88012a508600. 00000020:00000010:3.0:1734256858.332446:0:7466:0:(lu_object.c:1919:lu_env_add_task()) kmalloced '(lei)': 40 at ffff88012a508200. 00000020:00000010:3.0:1734256858.332449:0:7466:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b5a3fc00. 00000020:00000010:3.0:1734256858.332451:0:7466:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b5a3ea00. 00000040:00000010:3.0:1734256858.332454:0:7466:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b5a3f600. 00000020:00000010:3.0:1734256858.332456:0:7466:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff8800b62e6000. 00000020:00000010:3.0:1734256858.332465:0:7466:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012bf68000. 00000020:00000010:3.0:1734256858.332468:0:7466:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800b5a3f800. 80000000:00000010:3.0:1734256858.332471:0:7466:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b35f1c60. 40000000:00000010:3.0:1734256858.332472:0:7466:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff88012a508fc0. 00100000:00000010:3.0:1734256858.332474:0:7466:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff8800b62e4800. 00040000:00000010:3.0:1734256858.332476:0:7466:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b37aee00. 00040000:00000010:3.0:1734256858.332478:0:7466:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff8800b62e0800. 00040000:00000010:3.0:1734256858.332480:0:7466:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800b5a3ec00. 00000004:00000010:3.0:1734256858.332482:0:7466:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff8800b62e7000. 00000004:00000010:3.0:1734256858.332485:0:7466:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800ab711000. 00000004:00000010:3.0:1734256858.332487:0:7466:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff8800b62e2800. 00002000:00000010:3.0:1734256858.332490:0:7466:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff88012a595800. 00000004:00000010:3.0:1734256858.332492:0:7466:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff88012a596400. 00000100:00000010:3.0:1734256858.332495:0:7466:0:(service.c:2845:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff8800a9a24800. 00000100:00000200:3.0:1734256858.332501:0:7466:0:(service.c:2879:ptlrpc_main()) service thread 1 (#2) started 00000100:00000010:2.0:1734256858.332593:0:7464:0:(service.c:761:ptlrpc_register_service()) kmalloced '(service)': 320 at ffff8800b364f600. 00000100:00000010:2.0:1734256858.332597:0:7464:0:(service.c:819:ptlrpc_register_service()) kmalloced '(svcpt)': 800 at ffff8800b580c400. 00000100:00000010:2.0:1734256858.332606:0:7464:0:(service.c:650:ptlrpc_service_part_init()) kmalloced '(array->paa_reqs_array)': 12080 at ffff880136400000. 00000100:00000010:2.0:1734256858.332611:0:7464:0:(service.c:658:ptlrpc_service_part_init()) kmalloced '(array->paa_reqs_count)': 3020 at ffff8800aab55000. 00000100:00000010:2.0:1734256858.332614:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b580f800. 00000100:00000010:2.0:1734256858.332618:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff8800aab68000. 00000100:00000010:2.0:1734256858.332619:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b580fc00. 00000100:00000010:2.0:1734256858.332622:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff8800aab6a000. 00000100:00000010:2.0:1734256858.332624:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b580f400. 00000100:00000010:2.0:1734256858.332627:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff8800aab6e000. 00000100:00000010:2.0:1734256858.332629:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b580e400. 00000100:00000010:2.0:1734256858.332632:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff8800aab6c000. 00000100:00000010:2.0:1734256858.332633:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b580f000. 00000100:00000010:2.0:1734256858.332643:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012bfc8000. 00000100:00000010:2.0:1734256858.332646:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b580e000. 00000100:00000010:2.0:1734256858.332648:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012bfca000. 00000100:00000010:2.0:1734256858.332651:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62c1000. 00000100:00000010:2.0:1734256858.332654:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012bfcc000. 00000100:00000010:2.0:1734256858.332655:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62c3c00. 00000100:00000010:2.0:1734256858.332658:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012bfce000. 00000100:00000010:2.0:1734256858.332660:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62c3400. 00000100:00000010:2.0:1734256858.332666:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012a578000. 00000100:00000010:2.0:1734256858.332668:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62c0800. 00000100:00000010:2.0:1734256858.332671:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012a57a000. 00000100:00000010:2.0:1734256858.332673:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b628f400. 00000100:00000010:2.0:1734256858.332676:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012a57c000. 00000100:00000010:2.0:1734256858.332677:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b628d400. 00000100:00000010:2.0:1734256858.332680:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012a57e000. 00000100:00000010:2.0:1734256858.332681:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b628dc00. 00000100:00000010:2.0:1734256858.332688:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b470000. 00000100:00000010:2.0:1734256858.332690:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62a9c00. 00000100:00000010:2.0:1734256858.332695:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b472000. 00000100:00000010:2.0:1734256858.332697:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62ab400. 00000100:00000010:2.0:1734256858.332700:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b474000. 00000100:00000010:2.0:1734256858.332702:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62a8400. 00000100:00000010:2.0:1734256858.332705:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b476000. 00000100:00000010:2.0:1734256858.332706:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62a9400. 00000100:00000010:2.0:1734256858.332713:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b250000. 00000100:00000010:2.0:1734256858.332715:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62a8c00. 00000100:00000010:2.0:1734256858.332718:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b252000. 00000100:00000010:2.0:1734256858.332719:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62a9000. 00000100:00000010:2.0:1734256858.332722:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b254000. 00000100:00000010:2.0:1734256858.332724:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62a8000. 00000100:00000010:2.0:1734256858.332726:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b256000. 00000100:00000010:2.0:1734256858.332728:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62a8800. 00000100:00000010:2.0:1734256858.332733:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b668000. 00000100:00000010:2.0:1734256858.332735:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62aac00. 00000100:00000010:2.0:1734256858.332738:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b66a000. 00000100:00000010:2.0:1734256858.332739:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62a9800. 00000100:00000010:2.0:1734256858.332741:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b66c000. 00000100:00000010:2.0:1734256858.332743:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62ab000. 00000100:00000010:2.0:1734256858.332746:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b66e000. 00000100:00000010:2.0:1734256858.332748:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62ab800. 00000100:00000010:2.0:1734256858.332753:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880136a48000. 00000100:00000010:2.0:1734256858.332755:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b62abc00. 00000100:00000010:2.0:1734256858.332757:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880136a4a000. 00000100:00000010:2.0:1734256858.332759:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59fa400. 00000100:00000010:2.0:1734256858.332761:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880136a4c000. 00000100:00000010:2.0:1734256858.332763:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59fa000. 00000100:00000010:2.0:1734256858.332765:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880136a4e000. 00000100:00000010:2.0:1734256858.332767:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59f9000. 00000100:00000010:2.0:1734256858.332773:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e340000. 00000100:00000010:2.0:1734256858.332777:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59f9c00. 00000100:00000010:2.0:1734256858.332780:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e342000. 00000100:00000010:2.0:1734256858.332782:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59f8800. 00000100:00000010:2.0:1734256858.332785:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e344000. 00000100:00000010:2.0:1734256858.332787:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59fa800. 00000100:00000010:2.0:1734256858.332790:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e346000. 00000100:00000010:2.0:1734256858.332792:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59fb400. 00000100:00000010:2.0:1734256858.332797:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e2c8000. 00000100:00000010:2.0:1734256858.332799:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59fbc00. 00000100:00000010:2.0:1734256858.332802:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e2ca000. 00000100:00000010:2.0:1734256858.332803:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59fb800. 00000100:00000010:2.0:1734256858.332806:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e2cc000. 00000100:00000010:2.0:1734256858.332808:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b59fac00. 00000100:00000010:2.0:1734256858.332810:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e2ce000. 00000100:00000010:2.0:1734256858.332812:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5e400. 00000100:00000010:2.0:1734256858.332818:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880136868000. 00000100:00000010:2.0:1734256858.332820:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5c400. 00000100:00000010:2.0:1734256858.332822:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88013686a000. 00000100:00000010:2.0:1734256858.332824:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5e000. 00000100:00000010:2.0:1734256858.332826:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88013686c000. 00000100:00000010:2.0:1734256858.332828:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5c800. 00000100:00000010:2.0:1734256858.332831:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88013686e000. 00000100:00000010:2.0:1734256858.332832:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5f800. 00000100:00000010:2.0:1734256858.332838:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880130910000. 00000100:00000010:2.0:1734256858.332840:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5cc00. 00000100:00000010:2.0:1734256858.332843:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880130912000. 00000100:00000010:2.0:1734256858.332845:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5dc00. 00000100:00000010:2.0:1734256858.332848:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880130914000. 00000100:00000010:2.0:1734256858.332850:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5f400. 00000100:00000010:2.0:1734256858.332852:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880130916000. 00000100:00000010:2.0:1734256858.332854:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5d400. 00000100:00000010:2.0:1734256858.332862:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff880130128000. 00000100:00000010:2.0:1734256858.332864:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5e800. 00000100:00000010:2.0:1734256858.332867:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88013012a000. 00000100:00000010:2.0:1734256858.332869:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5fc00. 00000100:00000010:2.0:1734256858.332871:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88013012c000. 00000100:00000010:2.0:1734256858.332873:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5f000. 00000100:00000010:2.0:1734256858.332876:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88013012e000. 00000100:00000010:2.0:1734256858.332877:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5c000. 00000100:00000010:2.0:1734256858.332883:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012d6a0000. 00000100:00000010:2.0:1734256858.332885:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5d000. 00000100:00000010:2.0:1734256858.332887:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012d6a2000. 00000100:00000010:2.0:1734256858.332889:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5d800. 00000100:00000010:2.0:1734256858.332892:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012d6a4000. 00000100:00000010:2.0:1734256858.332893:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800aab5ec00. 00000100:00000010:2.0:1734256858.332896:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012d6a6000. 00000100:00000010:2.0:1734256858.332899:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b6f46c00. 00000100:00000010:2.0:1734256858.332904:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e2e0000. 00000100:00000010:2.0:1734256858.332906:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b6f47c00. 00000100:00000010:2.0:1734256858.332909:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e2e2000. 00000100:00000010:2.0:1734256858.332910:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b6f46800. 00000100:00000010:2.0:1734256858.332913:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e2e4000. 00000100:00000010:2.0:1734256858.332915:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff8800b6f47000. 00000100:00000010:2.0:1734256858.332917:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012e2e6000. 00000100:00000010:2.0:1734256858.332920:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff88012a530800. 00000100:00000010:2.0:1734256858.332925:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b248000. 00000100:00000010:2.0:1734256858.332927:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff88012a530c00. 00000100:00000010:2.0:1734256858.332930:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b24a000. 00000100:00000010:2.0:1734256858.332932:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff88012a531800. 00000100:00000010:2.0:1734256858.332934:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b24c000. 00000100:00000010:2.0:1734256858.332936:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff88012a533c00. 00000100:00000010:2.0:1734256858.332939:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012b24e000. 00000100:00000010:2.0:1734256858.332943:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff88012a533800. 00000100:00000010:2.0:1734256858.332949:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012f830000. 00000100:00000010:2.0:1734256858.332951:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff88012a531000. 00000100:00000010:2.0:1734256858.332954:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012f832000. 00000100:00000010:2.0:1734256858.332956:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff88012a533000. 00000100:00000010:2.0:1734256858.332958:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012f834000. 00000100:00000010:2.0:1734256858.332960:0:7464:0:(service.c:83:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff88012a532c00. 00000100:00000010:2.0:1734256858.332963:0:7464:0:(service.c:93:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff88012f836000. 00000400:00000200:2.0:1734256858.332965:0:7464:0:(lib-ptl.c:920:LNetSetLazyPortal()) Setting portal 17 lazy 00000800:00000010:1.0:1734256858.332977:0:6026:0:(socklnd.c:923:ksocknal_create_conn()) alloc '(conn)': 4712 at ffff8800b351c000. 00000800:00000010:1.0:1734256858.332981:0:6026:0:(socklnd.c:950:ksocknal_create_conn()) alloc '(hello)': 144 at ffff8800aa802600. 00000800:00000010:1.0:1734256858.332984:0:6026:0:(socklnd_proto.c:567:ksocknal_send_hello_v2()) alloc '(hello4)': 56 at ffff88012e27ba40. 00000800:00000010:1.0:1734256858.332990:0:6026:0:(socklnd_proto.c:607:ksocknal_send_hello_v2()) kfreed 'hello4': 56 at ffff88012e27ba40. 00000020:00000010:2.0:1734256858.332997:0:7464:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800a9ca4680. 00000020:00000010:2.0:1734256858.333000:0:7464:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff8800aab54000. 00000100:00000010:2.0:1734256858.333054:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b401f3c0. 00000100:00000010:2.0:1734256858.333058:0:7464:0:(nrs_fifo.c:83:nrs_fifo_start()) kmalloced '(head)': 40 at ffff8800b6e322c0. 00000100:00000010:2.0:1734256858.333060:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b401f300. 00000100:00000010:2.0:1734256858.333744:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b401fb40. 00000100:00000010:2.0:1734256858.333751:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b401f540. 00000100:00000010:2.0:1734256858.333754:0:7464:0:(nrs.c:1047:nrs_svcpt_setup_locked()) kmalloced '(svcpt->scp_nrs_hp)': 112 at ffff8800a9ca4b00. 00000100:00000010:2.0:1734256858.333756:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b401f180. 00000100:00000010:2.0:1734256858.333758:0:7464:0:(nrs_fifo.c:83:nrs_fifo_start()) kmalloced '(head)': 40 at ffff8800b6e32780. 00000100:00000010:2.0:1734256858.333760:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b401fa80. 00000100:00000010:2.0:1734256858.333763:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b401f780. 00000100:00000010:2.0:1734256858.333765:0:7464:0:(nrs.c:820:nrs_policy_register()) kmalloced '(policy)': 152 at ffff8800b401fd80. 00000100:00000200:2.0:1734256858.333789:0:7464:0:(service.c:852:ptlrpc_register_service()) ldlm_canceld: Started, listening on portal 17 00000100:00000010:2.0:1734256858.333792:0:7464:0:(service.c:3260:ptlrpc_start_thread()) kmalloced '(thread)': 272 at ffff8800b364ee00. 00000800:00000200:0.1F:1734256858.335252:0:6026:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:0.1:1734256858.335269:0:6026:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.1:1734256858.335272:0:6026:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c700 type 2, nob 96 niov 1 nkiov 0 00000800:00000200:0.0:1734256858.335276:0:6026:0:(socklnd.c:1220:ksocknal_create_conn()) New conn 12345-192.168.202.108@tcp p 3.x 192.168.202.8 -> 192.168.202.108:988 incarnation:1734256845495200783 sched[0] 00000800:00000010:0.0:1734256858.335279:0:6026:0:(socklnd.c:1228:ksocknal_create_conn()) kfreed 'hello': 144 at ffff8800aa802600. 00000400:00000200:0.0:1734256858.335361:0:6026:0:(lib-socket.c:436:lnet_sock_connect()) Error -99 connecting 1023 -> 192.168.202.108:988 00000800:00000200:2.0:1734256858.335371:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256858.335375:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 232 at ffff8800b404c700. 00000400:00000200:2.0:1734256858.335378:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256858.335382:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: GET: OK 00000400:00000200:2.0:1734256858.335386:0:6032:0:(peer.c:3101:lnet_discovery_event_handler()) Received event: 5 00000400:00000200:2.0:1734256858.335388:0:6032:0:(peer.c:3053:lnet_discovery_event_send()) Ping Send to 192.168.202.108@tcp: 0 00000100:00000010:0.0:1734256858.335406:0:7467:0:(service.c:2818:ptlrpc_main()) kmalloced '(env)': 56 at ffff8800b5a9d980. 00000020:00000010:0.0:1734256858.335410:0:7467:0:(lu_object.c:1919:lu_env_add_task()) kmalloced '(lei)': 40 at ffff8800b5a9dd00. 00000020:00000010:0.0:1734256858.335474:0:7467:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff88012a5c7800. 00000020:00000010:0.0:1734256858.335477:0:7467:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff88012a5c6000. 00000020:00000010:0.0:1734256858.335480:0:7467:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff88012a4f9540. 00000040:00000010:0.0:1734256858.335482:0:7467:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff88012a5c7200. 00000020:00000010:0.0:1734256858.335485:0:7467:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff88012a59a000. 00000020:00000010:0.0:1734256858.335491:0:7467:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012f360508. 00000020:00000010:0.0:1734256858.335494:0:7467:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff88012a5c7400. 80000000:00000010:0.0:1734256858.335496:0:7467:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff88012a4f9000. 40000000:00000010:0.0:1734256858.335499:0:7467:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff8800b5a9d240. 00000008:00000010:0.0:1734256858.335510:0:7467:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff88012b8f8000. 00020000:00000010:0.0:1734256858.335520:0:7467:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b3664480. 00008000:00000010:0.0:1734256858.335529:0:7467:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff880139bf0000. 00100000:00000010:0.0:1734256858.335533:0:7467:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff88012a59d800. 00040000:00000010:0.0:1734256858.335536:0:7467:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b34d4f00. 00040000:00000010:0.0:1734256858.335539:0:7467:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff8800b6331000. 00040000:00000010:0.0:1734256858.335542:0:7467:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff88012a5c7e00. 00000004:00000010:0.0:1734256858.335545:0:7467:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff8800b6336000. 00000004:00000010:0.0:1734256858.335550:0:7467:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800a8856000. 00000004:00000010:0.0:1734256858.335553:0:7467:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff8800b6333800. 00002000:00000010:0.0:1734256858.335556:0:7467:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff8800b3528000. 00000004:00000010:0.0:1734256858.335559:0:7467:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff8800b352a800. 00000080:00000010:0.0:1734256858.335566:0:7467:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff88012b79c000. 00000080:00000010:0.0:1734256858.335602:0:7467:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff88012c4ac000. 00000100:00000200:0.0:1734256858.335606:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335611:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4411b8. 00000400:00000010:0.0:1734256858.335616:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b3664e40. 00000100:00000200:0.0:1734256858.335621:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335623:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441688. 00000400:00000010:0.0:1734256858.335624:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b3664840. 00000100:00000200:0.0:1734256858.335626:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335627:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441108. 00000400:00000010:0.0:1734256858.335629:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b3664600. 00000100:00000200:0.0:1734256858.335630:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335631:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441210. 00000400:00000010:0.0:1734256858.335633:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b36646c0. 00000100:00000200:0.0:1734256858.335634:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335635:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4412c0. 00000400:00000010:0.0:1734256858.335637:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b3664240. 00000100:00000200:0.0:1734256858.335638:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335639:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441268. 00000400:00000010:0.0:1734256858.335641:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8801372406c0. 00000100:00000200:0.0:1734256858.335643:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335644:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441630. 00000400:00000010:0.0:1734256858.335645:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff880137240b40. 00000100:00000200:0.0:1734256858.335647:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335652:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4416e0. 00000400:00000010:0.0:1734256858.335653:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff880137240a80. 00000100:00000200:0.0:1734256858.335655:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335656:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441738. 00000400:00000010:0.0:1734256858.335658:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff88012ab49cc0. 00000100:00000200:0.0:1734256858.335660:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335661:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4415d8. 00000400:00000010:0.0:1734256858.335663:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff88012ab49000. 00000100:00000200:0.0:1734256858.335664:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335666:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441840. 00000400:00000010:0.0:1734256858.335668:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b6115e40. 00000100:00000200:0.0:1734256858.335670:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335671:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441b00. 00000400:00000010:0.0:1734256858.335673:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90abd80. 00000100:00000200:0.0:1734256858.335674:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335675:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441b58. 00000400:00000010:0.0:1734256858.335676:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab780. 00000100:00000200:0.0:1734256858.335678:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335679:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441bb0. 00000400:00000010:0.0:1734256858.335680:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab480. 00000100:00000200:0.0:1734256858.335681:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335682:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441c08. 00000400:00000010:0.0:1734256858.335684:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90abb40. 00000100:00000200:0.0:1734256858.335685:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335685:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441c60. 00000400:00000010:0.0:1734256858.335687:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90abe40. 00000100:00000200:0.0:1734256858.335688:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335689:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441cb8. 00000400:00000010:0.0:1734256858.335690:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab000. 00000100:00000200:0.0:1734256858.335692:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335693:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441d10. 00000400:00000010:0.0:1734256858.335694:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab600. 00000100:00000200:0.0:1734256858.335696:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335696:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441d68. 00000400:00000010:0.0:1734256858.335697:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90abf00. 00000100:00000200:0.0:1734256858.335790:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335792:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441dc0. 00000400:00000010:0.0:1734256858.335793:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab180. 00000100:00000200:0.0:1734256858.335795:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335796:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441e18. 00000400:00000010:0.0:1734256858.335797:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab0c0. 00000100:00000200:0.0:1734256858.335799:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335800:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441e70. 00000400:00000010:0.0:1734256858.335802:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab900. 00000100:00000200:0.0:1734256858.335803:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335804:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441ec8. 00000400:00000010:0.0:1734256858.335805:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab9c0. 00000100:00000200:0.0:1734256858.335807:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335808:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441f20. 00000400:00000010:0.0:1734256858.335810:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab6c0. 00000100:00000200:0.0:1734256858.335811:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335812:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441f78. 00000400:00000010:0.0:1734256858.335813:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90abcc0. 00000100:00000200:0.0:1734256858.335815:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335816:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4419a0. 00000400:00000010:0.0:1734256858.335817:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab540. 00000100:00000200:0.0:1734256858.335819:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335819:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441948. 00000400:00000010:0.0:1734256858.335821:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab3c0. 00000100:00000200:0.0:1734256858.335822:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335823:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441790. 00000400:00000010:0.0:1734256858.335824:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab840. 00000100:00000200:0.0:1734256858.335826:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335827:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4418f0. 00000400:00000010:0.0:1734256858.335828:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab300. 00000100:00000200:0.0:1734256858.335829:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335831:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441528. 00000400:00000010:0.0:1734256858.335832:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90abc00. 00000100:00000200:0.0:1734256858.335833:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335834:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441580. 00000400:00000010:0.0:1734256858.335840:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90aba80. 00000100:00000200:0.0:1734256858.335843:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335844:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441478. 00000400:00000010:0.0:1734256858.335846:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800a90ab240. 00000100:00000200:0.0:1734256858.335847:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335848:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4414d0. 00000400:00000010:0.0:1734256858.335850:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b5902180. 00000100:00000200:0.0:1734256858.335852:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335853:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441420. 00000400:00000010:0.0:1734256858.335854:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b5902480. 00000100:00000200:0.0:1734256858.335856:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335857:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441318. 00000400:00000010:0.0:1734256858.335858:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b59023c0. 00000100:00000200:0.0:1734256858.335859:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335860:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4413c8. 00000400:00000010:0.0:1734256858.335926:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b5902cc0. 00000100:00000200:0.0:1734256858.335928:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335930:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441370. 00000400:00000010:0.0:1734256858.335931:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b5902240. 00000100:00000200:0.0:1734256858.335933:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335934:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4417e8. 00000400:00000010:0.0:1734256858.335935:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b5902000. 00000100:00000200:0.0:1734256858.335937:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335938:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4410b0. 00000400:00000010:0.0:1734256858.335939:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b59020c0. 00000100:00000200:0.0:1734256858.335940:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335942:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441000. 00000400:00000010:0.0:1734256858.335943:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b5902a80. 00000100:00000200:0.0:1734256858.335945:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335946:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441a50. 00000400:00000010:0.0:1734256858.335947:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b5902600. 00000100:00000200:0.0:1734256858.335948:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335949:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab4419f8. 00000400:00000010:0.0:1734256858.335951:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800b5902300. 00000400:00000200:1.0:1734256858.335951:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : REPLY - for me 00000100:00000200:0.0:1734256858.335952:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335957:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441058. 00000400:00000010:0.0:1734256858.335960:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6cc0. 00000100:00000200:0.0:1734256858.335962:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335963:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441898. 00000400:00000200:1.0:1734256858.335967:0:6033:0:(lib-move.c:4598:lnet_parse_reply()) 192.168.202.8@tcp: Reply from 12345-192.168.202.108@tcp of length 48/48 into md 0x9 00000400:00000010:0.0:1734256858.335975:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6f00. 00000100:00000200:0.0:1734256858.335977:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335978:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ab441aa8. 00000400:00000010:0.0:1734256858.335980:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c63c0. 00000400:00000200:1.0:1734256858.335980:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000200:0.0:1734256858.335981:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335983:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50a50. 00000400:00000200:1.0:1734256858.335983:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: REPLY: OK 00000400:00000010:0.0:1734256858.335984:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6900. 00000400:00000200:1.0:1734256858.335986:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:1.0:1734256858.335988:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000400:00000200:1.0:1734256858.335991:0:6033:0:(peer.c:3101:lnet_discovery_event_handler()) Received event: 3 00000100:00000200:0.0:1734256858.335992:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.335994:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50b00. 00000400:00000200:1.0:1734256858.335994:0:6033:0:(peer.c:2931:lnet_discovery_event_reply()) Peer 192.168.202.108@tcp has discovery enabled 00000400:00000010:0.0:1734256858.335995:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c60c0. 00000100:00000200:0.0:1734256858.335996:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000200:1.0:1734256858.335996:0:6033:0:(peer.c:2943:lnet_discovery_event_reply()) peer 192.168.202.108@tcp(ffff8800b5b24800) is MR 00000400:00000010:0.0:1734256858.335997:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50b58. 00000400:00000200:1.0:1734256858.335998:0:6033:0:(peer.c:3012:lnet_discovery_event_reply()) peer 192.168.202.108@tcp data present 1. state = 0x100241 00000400:00000200:1.0:1734256858.336001:0:6033:0:(peer.c:2425:lnet_peer_queue_for_discovery()) Queue peer 192.168.202.108@tcp: -114 00000400:00000010:0.0:1734256858.336002:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6300. 00000100:00000200:0.0:1734256858.336004:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336005:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50bb0. 00000400:00000010:0.0:1734256858.336006:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6b40. 00000100:00000200:0.0:1734256858.336008:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336009:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50c08. 00000400:00000010:0.0:1734256858.336010:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6240. 00000100:00000200:0.0:1734256858.336012:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336013:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50c60. 00000400:00000010:0.0:1734256858.336014:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6540. 00000100:00000200:0.0:1734256858.336016:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336017:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50cb8. 00000400:00000010:0.0:1734256858.336018:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6180. 00000100:00000200:0.0:1734256858.336019:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336020:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50d10. 00000400:00000010:0.0:1734256858.336022:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6600. 00000100:00000200:0.0:1734256858.336023:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336024:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50d68. 00000400:00000010:0.0:1734256858.336026:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6d80. 00000100:00000200:0.0:1734256858.336032:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336034:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50dc0. 00000400:00000010:0.0:1734256858.336036:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6480. 00000100:00000200:0.0:1734256858.336037:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336038:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50e18. 00000800:00000010:2.0:1734256858.336039:0:6026:0:(socklnd.c:923:ksocknal_create_conn()) alloc '(conn)': 4712 at ffff88012b900000. 00000400:00000010:0.0:1734256858.336040:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6000. 00000100:00000200:0.0:1734256858.336041:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336042:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50e70. 00000400:00000010:0.0:1734256858.336043:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6e40. 00000100:00000200:0.0:1734256858.336045:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336046:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50ec8. 00000800:00000010:2.0:1734256858.336046:0:6026:0:(socklnd.c:950:ksocknal_create_conn()) alloc '(hello)': 144 at ffff8800b401f240. 00000400:00000010:0.0:1734256858.336047:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c69c0. 00000100:00000200:0.0:1734256858.336049:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336050:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50f20. 00000400:00000010:0.0:1734256858.336051:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6840. 00000800:00000010:2.0:1734256858.336051:0:6026:0:(socklnd_proto.c:567:ksocknal_send_hello_v2()) alloc '(hello4)': 56 at ffff8800b6e32800. 00000100:00000200:0.0:1734256858.336053:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336054:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50f78. 00000400:00000010:0.0:1734256858.336055:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c66c0. 00000100:00000200:0.0:1734256858.336057:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000800:00000010:2.0:1734256858.336057:0:6026:0:(socklnd_proto.c:607:ksocknal_send_hello_v2()) kfreed 'hello4': 56 at ffff8800b6e32800. 00000400:00000010:0.0:1734256858.336058:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50630. 00000400:00000010:0.0:1734256858.336059:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6c00. 00000100:00000200:0.0:1734256858.336060:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336061:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50000. 00000400:00000010:0.0:1734256858.336063:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6a80. 00000100:00000200:0.0:1734256858.336064:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336065:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50058. 00000400:00000010:0.0:1734256858.336066:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800ab7c6780. 00000100:00000200:0.0:1734256858.336068:0:7467:0:(niobuf.c:1033:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:0.0:1734256858.336069:0:7467:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d500b0. 00000400:00000010:0.0:1734256858.336070:0:7467:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 152 at ffff8800aa83eb40. 00000100:00000010:0.0:1734256858.336072:0:7467:0:(service.c:2845:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff8800b6334000. 00000100:00000200:0.0:1734256858.336080:0:7467:0:(service.c:2879:ptlrpc_main()) service thread 0 (#1) started 00000400:00000200:3.0:1734256858.336100:0:6036:0:(peer.c:4014:lnet_peer_discovery_wait_for_work()) woken: 0 00000400:00000200:3.0:1734256858.336103:0:6036:0:(peer.c:4126:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x1000c1 00000400:00000010:3.0:1734256858.336108:0:6036:0:(peer.c:3282:lnet_peer_merge_data()) alloc '(curnis)': 40 at ffff88012a508980. 00000400:00000010:3.0:1734256858.336110:0:6036:0:(peer.c:3283:lnet_peer_merge_data()) alloc '(addnis)': 48 at ffff88012a508b40. 00000400:00000010:3.0:1734256858.336114:0:6036:0:(peer.c:3284:lnet_peer_merge_data()) alloc '(delnis)': 40 at ffff88012a5085c0. 00000400:00000010:3.0:1734256858.336118:0:6036:0:(peer.c:3430:lnet_peer_merge_data()) kfreed 'curnis': 40 at ffff88012a508980. 00000400:00000010:3.0:1734256858.336120:0:6036:0:(peer.c:3431:lnet_peer_merge_data()) kfreed 'addnis': 48 at ffff88012a508b40. 00000400:00000010:3.0:1734256858.336121:0:6036:0:(peer.c:3432:lnet_peer_merge_data()) kfreed 'delnis': 40 at ffff88012a5085c0. 00000400:00000010:3.0:1734256858.336122:0:6036:0:(api-ni.c:1799:lnet_ping_buffer_free()) kfreed 'pbuf': 281 at ffff8800b364fc00. 00000400:00000200:3.0:1734256858.336125:0:6036:0:(peer.c:3435:lnet_peer_merge_data()) peer 192.168.202.108@tcp (ffff8800b5b24800): 0 00000400:00000200:3.0:1734256858.336127:0:6036:0:(peer.c:3740:lnet_peer_data_present()) peer 192.168.202.108@tcp(ffff8800b5b24800): 0. state = 0x100141 00000400:00000200:3.0:1734256858.336129:0:6036:0:(peer.c:4148:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100141 rc 1 00000400:00000200:3.0:1734256858.336131:0:6036:0:(peer.c:4126:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100141 00000400:00000010:3.0:1734256858.336134:0:6036:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000400:00000010:3.0:1734256858.336141:0:6036:0:(lib-lnet.h:469:lnet_rspt_alloc()) alloc 'rspt': 56 at ffff8800b62881c0. 00000400:00000200:3.0:1734256858.336144:0:6036:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256858.336151:0:6036:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source Specified: 192.168.202.8@tcp to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256858.336156:0:6036:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [2:2:256:4294967295] 192.168.202.108@tcp LPNI seq info [2:2:8:4294967295] 00000400:00000200:3.0:1734256858.336159:0:6036:0:(lib-move.c:1973:lnet_handle_send()) rspt_next_hop_nid = 192.168.202.108@tcp 00000400:00000200:3.0:1734256858.336164:0:6036:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:192.168.202.8@tcp) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256858.336168:0:6036:0:(socklnd_cb.c:1000:ksocknal_send()) sending 48 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256858.336170:0:6036:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b37aef00. 00000800:00000200:3.0:1734256858.336173:0:6036:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (3) 00000800:00000200:3.0:1734256858.336177:0:6036:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256858.336179:0:6036:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b37aef00 type 1, nob 144 niov 1 nkiov 1 00000400:00000200:3.0:1734256858.336190:0:6036:0:(peer.c:3948:lnet_peer_send_push()) peer 192.168.202.108@tcp 00000400:00000200:3.0:1734256858.336191:0:6036:0:(peer.c:4148:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100541 rc 0 00000800:00000200:0.0:1734256858.336229:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.336231:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b37aef00. 00000400:00000200:0.0:1734256858.336234:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.336237:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000010:2.0:1734256858.336242:0:7464:0:(service.c:3260:ptlrpc_start_thread()) kmalloced '(thread)': 272 at ffff8800b364e800. 00000400:00000200:0.0:1734256858.336243:0:6032:0:(peer.c:3101:lnet_discovery_event_handler()) Received event: 5 00000400:00000200:0.0:1734256858.336245:0:6032:0:(peer.c:3053:lnet_discovery_event_send()) Push Send to 192.168.202.108@tcp: 0 00000100:00000010:3.0:1734256858.337081:0:7468:0:(service.c:2818:ptlrpc_main()) kmalloced '(env)': 56 at ffff88012a5085c0. 00000020:00000010:3.0:1734256858.337084:0:7468:0:(lu_object.c:1919:lu_env_add_task()) kmalloced '(lei)': 40 at ffff88012a508b40. 00000020:00000010:3.0:1734256858.337088:0:7468:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b5a3e600. 00000020:00000010:3.0:1734256858.337090:0:7468:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b5a3e800. 00000020:00000010:3.0:1734256858.337092:0:7468:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b35f1960. 00000040:00000010:3.0:1734256858.337094:0:7468:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b5a3fa00. 00000020:00000010:3.0:1734256858.337097:0:7468:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff8800a9a26800. 00000020:00000010:3.0:1734256858.337100:0:7468:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012bf68508. 00000020:00000010:3.0:1734256858.337106:0:7468:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800b5a3e200. 80000000:00000010:3.0:1734256858.337108:0:7468:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b35f1000. 40000000:00000010:3.0:1734256858.337110:0:7468:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff88012a508980. 00000008:00000010:3.0:1734256858.337113:0:7468:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a9848b28. 00020000:00000010:3.0:1734256858.337116:0:7468:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b6191480. 00008000:00000010:3.0:1734256858.337118:0:7468:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90388. 00100000:00000010:3.0:1734256858.337122:0:7468:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff8800b6383000. 00040000:00000010:3.0:1734256858.337124:0:7468:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b37ae700. 00040000:00000010:3.0:1734256858.337127:0:7468:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff88012bdfb800. 00040000:00000010:3.0:1734256858.337129:0:7468:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800b5a3e400. 00000004:00000010:3.0:1734256858.337132:0:7468:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff88012bdf9800. 00000004:00000010:3.0:1734256858.337135:0:7468:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800ab715000. 00000004:00000010:3.0:1734256858.337137:0:7468:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff88012bdf9000. 00002000:00000010:3.0:1734256858.337140:0:7468:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff88012a596800. 00000004:00000010:3.0:1734256858.337142:0:7468:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff88012a597000. 00000080:00000010:3.0:1734256858.337144:0:7468:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f50a8. 00000080:00000010:3.0:1734256858.337147:0:7468:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0248. 00000100:00000010:3.0:1734256858.337149:0:7468:0:(service.c:2845:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff88012bdf8800. 00000100:00000200:3.0:1734256858.337155:0:7468:0:(service.c:2879:ptlrpc_main()) service thread 1 (#2) started 00000400:00000200:0.0:1734256858.337175:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : ACK - for me 00000400:00000200:0.0:1734256858.337189:0:6031:0:(lib-move.c:4651:lnet_parse_ack()) 192.168.202.8@tcp: ACK from 12345-192.168.202.108@tcp into md 0x111 00000400:00000200:0.0:1734256858.337192:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000010:2.0:1734256858.337193:0:7464:0:(service.c:3260:ptlrpc_start_thread()) kmalloced '(thread)': 272 at ffff8800b364ec00. 00000400:00000200:0.0:1734256858.337194:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: ACK: OK 00000400:00000200:0.0:1734256858.337196:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734256858.337197:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000400:00000200:0.0:1734256858.337199:0:6031:0:(peer.c:3101:lnet_discovery_event_handler()) Received event: 4 00000400:00000200:0.0:1734256858.337201:0:6031:0:(peer.c:2819:lnet_discovery_event_ack()) peer 192.168.202.108@tcp ev->status 0 00000400:00000200:0.0:1734256858.337203:0:6031:0:(peer.c:2425:lnet_peer_queue_for_discovery()) Queue peer 192.168.202.108@tcp: -114 00000400:00000200:3.0:1734256858.337227:0:6036:0:(peer.c:4014:lnet_peer_discovery_wait_for_work()) woken: 0 00000400:00000200:3.0:1734256858.337230:0:6036:0:(peer.c:4126:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100141 00000400:00000200:3.0:1734256858.337233:0:6036:0:(peer.c:3870:lnet_peer_discovered()) peer 192.168.202.108@tcp 00000400:00000200:3.0:1734256858.337234:0:6036:0:(peer.c:4148:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100111 rc 0 00000400:00000200:3.0:1734256858.337236:0:6036:0:(peer.c:2441:lnet_peer_discovery_complete()) Discovery complete. Dequeue peer 192.168.202.108@tcp 00000800:00000200:0.1:1734256858.337700:0:6026:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 2, ksnr_connected 6 ksnr_max_conns 1 00000800:00000200:0.0:1734256858.337707:0:6026:0:(socklnd.c:1220:ksocknal_create_conn()) New conn 12345-192.168.202.108@tcp p 3.x 192.168.202.8 -> 192.168.202.108:988 incarnation:1734256845495200783 sched[0] 00000800:00000010:0.0:1734256858.337710:0:6026:0:(socklnd.c:1228:ksocknal_create_conn()) kfreed 'hello': 144 at ffff8800b401f240. 00000400:00000200:0.0:1734256858.337744:0:6026:0:(lib-socket.c:436:lnet_sock_connect()) Error -99 connecting 1023 -> 192.168.202.108:988 00000400:00000200:0.0:1734256858.337763:0:6026:0:(lib-socket.c:436:lnet_sock_connect()) Error -99 connecting 1022 -> 192.168.202.108:988 00000400:00000200:1.0:1734256858.337766:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734256858.337773:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 48 into portal 0 MB=0x8000000000000000 00000400:00000200:1.0:1734256858.337779:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 0 from 12345-192.168.202.108@tcp of length 48/48 into md 0x5 [1] + 0 00000400:00000010:1.0:1734256858.337783:0:6033:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16b58. 00000400:00000200:1.0:1734256858.337786:0:6033:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md ffff8800b610af68 00000400:00000200:1.0:1734256858.337806:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.337809:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256858.337812:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:1.0:1734256858.337813:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000400:00000200:1.0:1734256858.337815:0:6033:0:(api-ni.c:2239:lnet_push_target_event_handler()) type 2 status 0 unlinked 1 00000400:00000200:1.0:1734256858.337846:0:6033:0:(peer.c:2590:lnet_peer_push_event()) peer 192.168.202.108@tcp(ffff8800b5b24800) is MR 00000400:00000010:1.0:1734256858.337849:0:6033:0:(api-ni.c:1785:lnet_ping_buffer_alloc()) alloc '(pbuf)': 57 at ffff88012e27ba40. 00000400:00000200:1.0:1734256858.337851:0:6033:0:(peer.c:2664:lnet_peer_push_event()) Received Push 192.168.202.108@tcp 1 00000400:00000200:1.0:1734256858.337856:0:6033:0:(peer.c:2425:lnet_peer_queue_for_discovery()) Queue peer 192.168.202.108@tcp: 0 00000400:00000200:1.0:1734256858.337859:0:6033:0:(lib-md.c:96:lnet_cpt_of_md()) Couldn't resolve first page of md (null) with offset 0 00000400:00000200:1.0:1734256858.337863:0:6033:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source Specified: 192.168.202.8@tcp to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256858.337871:0:6033:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [3:3:256:4294967295] 192.168.202.108@tcp LPNI seq info [3:3:8:4294967295] 00000400:00000200:1.0:1734256858.337877:0:6033:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:192.168.202.8@tcp) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) 192.168.202.108@tcp : ACK try# 0 00000800:00000200:1.0:1734256858.337881:0:6033:0:(socklnd_cb.c:1000:ksocknal_send()) sending 0 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256858.337881:0:6036:0:(peer.c:4014:lnet_peer_discovery_wait_for_work()) woken: 0 00000800:00000010:1.0:1734256858.337882:0:6033:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734256858.337884:0:6033:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (4) 00000400:00000010:3.0:1734256858.337885:0:6036:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16bb0. 00000800:00000200:1.0:1734256858.337887:0:6033:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:3.0:1734256858.337888:0:6036:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a198. 00000800:00000200:1.0:1734256858.337889:0:6033:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 0, nob 96 niov 1 nkiov 0 00000400:00000200:3.0:1734256858.337891:0:6036:0:(api-ni.c:2229:lnet_push_target_post()) posted push target ffff8800b605e800 00000400:00000200:3.0:1734256858.337894:0:6036:0:(peer.c:4126:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x1000d1 00000400:00000010:3.0:1734256858.337897:0:6036:0:(peer.c:3282:lnet_peer_merge_data()) alloc '(curnis)': 40 at ffff88012a508d00. 00000400:00000010:3.0:1734256858.337898:0:6036:0:(peer.c:3283:lnet_peer_merge_data()) alloc '(addnis)': 48 at ffff88012a508300. 00000400:00000010:3.0:1734256858.337899:0:6036:0:(peer.c:3284:lnet_peer_merge_data()) alloc '(delnis)': 40 at ffff88012a508b80. 00000400:00000010:3.0:1734256858.337901:0:6036:0:(peer.c:3430:lnet_peer_merge_data()) kfreed 'curnis': 40 at ffff88012a508d00. 00000400:00000010:3.0:1734256858.337903:0:6036:0:(peer.c:3431:lnet_peer_merge_data()) kfreed 'addnis': 48 at ffff88012a508300. 00000400:00000010:3.0:1734256858.337907:0:6036:0:(peer.c:3432:lnet_peer_merge_data()) kfreed 'delnis': 40 at ffff88012a508b80. 00000400:00000010:3.0:1734256858.337909:0:6036:0:(api-ni.c:1799:lnet_ping_buffer_free()) kfreed 'pbuf': 57 at ffff88012e27ba40. 00000400:00000200:3.0:1734256858.337911:0:6036:0:(peer.c:3435:lnet_peer_merge_data()) peer 192.168.202.108@tcp (ffff8800b5b24800): 0 00000400:00000200:3.0:1734256858.337913:0:6036:0:(peer.c:3740:lnet_peer_data_present()) peer 192.168.202.108@tcp(ffff8800b5b24800): 0. state = 0x100151 00000400:00000200:3.0:1734256858.337915:0:6036:0:(peer.c:4148:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100151 rc 1 00000400:00000200:3.0:1734256858.337917:0:6036:0:(peer.c:4126:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100151 00000400:00000200:3.0:1734256858.337919:0:6036:0:(peer.c:3870:lnet_peer_discovered()) peer 192.168.202.108@tcp 00000800:00000200:1.0:1734256858.337920:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:3.0:1734256858.337920:0:6036:0:(peer.c:4148:lnet_peer_discovery()) peer 192.168.202.108@tcp(ffff8800b5b24800) state 0x100111 rc 0 00000800:00000010:1.0:1734256858.337922:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:3.0:1734256858.337922:0:6036:0:(peer.c:2441:lnet_peer_discovery_complete()) Discovery complete. Dequeue peer 192.168.202.108@tcp 00000400:00000200:1.0:1734256858.337924:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.337927:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: ACK: OK 00000800:00000010:0.0:1734256858.338077:0:6026:0:(socklnd.c:923:ksocknal_create_conn()) alloc '(conn)': 4712 at ffff8800ac580000. 00000800:00000010:0.0:1734256858.338080:0:6026:0:(socklnd.c:950:ksocknal_create_conn()) alloc '(hello)': 144 at ffff8800aa83ea80. 00000800:00000010:0.0:1734256858.338082:0:6026:0:(socklnd_proto.c:567:ksocknal_send_hello_v2()) alloc '(hello4)': 56 at ffff8800b6e37bc0. 00000800:00000010:0.0:1734256858.338085:0:6026:0:(socklnd_proto.c:607:ksocknal_send_hello_v2()) kfreed 'hello4': 56 at ffff8800b6e37bc0. 00000100:00000010:3.0:1734256858.338146:0:7469:0:(service.c:2818:ptlrpc_main()) kmalloced '(env)': 56 at ffff88012a508b80. 00000020:00000010:3.0:1734256858.338148:0:7469:0:(lu_object.c:1919:lu_env_add_task()) kmalloced '(lei)': 40 at ffff88012a508300. 00000020:00000010:3.0:1734256858.338151:0:7469:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b5a3e000. 00000020:00000010:3.0:1734256858.338153:0:7469:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b5a3fe00. 00000020:00000010:3.0:1734256858.338154:0:7469:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b35f1360. 00000040:00000010:3.0:1734256858.338157:0:7469:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b6fb7e00. 00000020:00000010:3.0:1734256858.338159:0:7469:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff88012bdfd800. 00000020:00000010:3.0:1734256858.338161:0:7469:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012bf68a10. 00000020:00000010:3.0:1734256858.338163:0:7469:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800b6fb7c00. 80000000:00000010:3.0:1734256858.338165:0:7469:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b35f1b40. 40000000:00000010:3.0:1734256858.338167:0:7469:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff88012a508d00. 00000008:00000010:3.0:1734256858.338169:0:7469:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a9849650. 00020000:00000010:3.0:1734256858.338171:0:7469:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b6191d80. 00008000:00000010:3.0:1734256858.338173:0:7469:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90710. 00100000:00000010:3.0:1734256858.338175:0:7469:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff88012bdfc000. 00040000:00000010:3.0:1734256858.338177:0:7469:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b37ae100. 00040000:00000010:3.0:1734256858.338179:0:7469:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff88012bdfe800. 00040000:00000010:3.0:1734256858.338181:0:7469:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800b6fb7a00. 00000004:00000010:3.0:1734256858.338183:0:7469:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff88012bdfe000. 00000004:00000010:3.0:1734256858.338185:0:7469:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800ab713000. 00000004:00000010:3.0:1734256858.338187:0:7469:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff88012bdfc800. 00002000:00000010:3.0:1734256858.338188:0:7469:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff88012a595c00. 00000004:00000010:3.0:1734256858.338190:0:7469:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff88012a594400. 00000080:00000010:3.0:1734256858.338192:0:7469:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f5150. 00000080:00000010:3.0:1734256858.338197:0:7469:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0490. 00000100:00000010:3.0:1734256858.338199:0:7469:0:(service.c:2845:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff88012bdfa800. 00000100:00000200:3.0:1734256858.338213:0:7469:0:(service.c:2879:ptlrpc_main()) service thread 2 (#3) started 00010000:00000010:2.0:1734256858.338243:0:7464:0:(ldlm_lockd.c:3372:ldlm_setup()) kmalloced '(blp)': 168 at ffff8800b401f840. 00010000:00000010:3.0:1734256858.339096:0:7470:0:(ldlm_lockd.c:3005:ldlm_bl_thread_main()) kmalloced '(env)': 56 at ffff88012a508740. 00000020:00000010:3.0:1734256858.339099:0:7470:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6fb7800. 00000020:00000010:3.0:1734256858.339101:0:7470:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b6fb7600. 00000020:00000010:3.0:1734256858.339104:0:7470:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff88012bdfb000. 00000020:00000010:3.0:1734256858.339106:0:7470:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012bf68f18. 00000020:00000010:3.0:1734256858.339108:0:7470:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800b6fb7400. 80000000:00000010:3.0:1734256858.339110:0:7470:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b35f18a0. 40000000:00000010:3.0:1734256858.339112:0:7470:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff88012a508d80. 00100000:00000010:3.0:1734256858.339114:0:7470:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff88012bdf8000. 00040000:00000010:3.0:1734256858.339116:0:7470:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b37aed00. 00040000:00000010:3.0:1734256858.339118:0:7470:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800b6fb7200. 00002000:00000010:3.0:1734256858.339121:0:7470:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff8800b60ad800. 00000020:00000010:3.0:1734256858.339123:0:7470:0:(lu_object.c:1919:lu_env_add_task()) kmalloced '(lei)': 40 at ffff88012a508a00. 00000800:00000200:0.1:1734256858.339284:0:6026:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 3, ksnr_connected e ksnr_max_conns 1 00000800:00000200:0.0:1734256858.339291:0:6026:0:(socklnd.c:1220:ksocknal_create_conn()) New conn 12345-192.168.202.108@tcp p 3.x 192.168.202.8 -> 192.168.202.108:988 incarnation:1734256845495200783 sched[0] 00000800:00000010:0.0:1734256858.339294:0:6026:0:(socklnd.c:1228:ksocknal_create_conn()) kfreed 'hello': 144 at ffff8800aa83ea80. 00010000:00000010:3.0:1734256858.339425:0:7471:0:(ldlm_lockd.c:3005:ldlm_bl_thread_main()) kmalloced '(env)': 56 at ffff88012a508000. 00000020:00000010:3.0:1734256858.339428:0:7471:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6fb7000. 00000020:00000010:3.0:1734256858.339429:0:7471:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b6fb6e00. 00000020:00000010:3.0:1734256858.339432:0:7471:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff88012bdfd000. 00000020:00000010:3.0:1734256858.339434:0:7471:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012bf69420. 00000020:00000010:3.0:1734256858.339435:0:7471:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800b6fb6c00. 80000000:00000010:3.0:1734256858.339437:0:7471:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b35f13c0. 40000000:00000010:3.0:1734256858.339438:0:7471:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff88012a508840. 00100000:00000010:3.0:1734256858.339440:0:7471:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff88012bdff000. 00040000:00000010:3.0:1734256858.339441:0:7471:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b37ae000. 00040000:00000010:3.0:1734256858.339443:0:7471:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800b6fb6a00. 00002000:00000010:3.0:1734256858.339445:0:7471:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff8800b60aec00. 00000020:00000010:3.0:1734256858.339447:0:7471:0:(lu_object.c:1919:lu_env_add_task()) kmalloced '(lei)': 40 at ffff88012a508880. 00010000:00000010:2.0:1734256858.339765:0:7464:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff8800b6e32800. 00010000:00000010:2.0:1734256858.339769:0:7464:0:(lustre_compat.h:704:ll_shrinker_create()) kmalloced '(shrinker)': 48 at ffff8800b6e32300. 00000020:00000010:2.0:1734256858.339784:0:7464:0:(genops.c:1192:class_new_import()) kmalloced '(imp)': 1680 at ffff880136991800. 00000100:00000200:2.0:1734256858.339796:0:7464:0:(events.c:572:ptlrpc_uuid_to_peer()) MGC192.168.202.108@tcp_0->12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.339800:0:7464:0:(peer.c:1500:LNetPrimaryNID()) NID 192.168.202.108@tcp primary NID 192.168.202.108@tcp rc 0 00000100:00000010:2.0:1734256858.339803:0:7464:0:(connection.c:93:ptlrpc_connection_get()) kmalloced '(conn)': 96 at ffff8800b58f4f60. 00010000:00000010:2.0:1734256858.339806:0:7464:0:(ldlm_lib.c:69:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff8800b58f4ea0. 00010000:00000010:2.0:1734256858.339810:0:7464:0:(ldlm_resource.c:935:ldlm_namespace_new()) kmalloced '(ns)': 760 at ffff88012a532400. 00000001:00000010:2.0:1734256858.339814:0:7464:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff8800b404c700. 00000001:00000010:2.0:1734256858.339817:0:7464:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 16 at ffff8800b61ca330. 00000001:00000010:2.0:1734256858.339819:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 200 at ffff8800b404c500. 00000001:00000010:2.0:1734256858.339821:0:7464:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 200 at ffff8800b404cc00. 00010000:00000010:2.0:1734256858.339823:0:7464:0:(ldlm_resource.c:957:ldlm_namespace_new()) kmalloced '(ns->ns_rs_buckets)': 176 at ffff8800b401f000. 00000020:00000010:2.0:1734256858.339868:0:7464:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800a9ca4280. 00000020:00000010:2.0:1734256858.339870:0:7464:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 32 at ffff8800b5863800. 00000020:00000010:2.0:1734256858.339916:0:7464:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800a9ca4380. 00000020:00000010:2.0:1734256858.339918:0:7464:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 352 at ffff8800b364f200. 00000040:00000010:2.0:1734256858.339931:0:7464:0:(llog_obd.c:44:llog_new_ctxt()) kmalloced '(ctxt)': 176 at ffff8800b401f600. 00000020:00000010:2.0:1734256858.340835:0:7464:0:(obd_mount.c:178:do_lcfg()) kfreed 'lcfg': 112 at ffff8800b3733780. 00000020:00000010:2.0:1734256858.340847:0:7464:0:(genops.c:973:__class_new_export()) kmalloced '(export)': 1176 at ffff880136993000. 00000400:00000200:2.0:1734256858.340858:0:7464:0:(peer.c:1541:LNetPeerDiscovered()) Peer NID 192.168.202.108@tcp is discovered: rc = 1 00000100:00000010:2.0:1734256858.340870:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734256858.340880:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012a530400. 00000020:00000010:2.0:1734256858.340904:0:7464:0:(obd_mount.c:571:lustre_start_mgc()) kfreed 'uuid': 40 at ffff8800b5a9d840. 00000020:00000010:2.0:1734256858.340906:0:7464:0:(obd_mount.c:572:lustre_start_mgc()) kfreed 'data': 192 at ffff8800b3664f00. 00000020:00000010:2.0:1734256858.340908:0:7464:0:(obd_mount.c:573:lustre_start_mgc()) kfreed 'mgcname': 23 at ffff8800a99fb400. 00000020:00000010:2.0:1734256858.340909:0:7464:0:(obd_mount.c:258:mgc_niduuid_destroy()) kfreed '*niduuid': 32 at ffff8800a99fb580. 00000080:00000010:2.0:1734256858.340915:0:7464:0:(llite_lib.c:1379:ll_fill_super()) kmalloced '(cfg)': 80 at ffff8800b58f4960. 00000080:00000010:2.0:1734256858.340917:0:7464:0:(llite_lib.c:104:ll_init_sbi()) kmalloced '(sbi)': 1056 at ffff880136990000. 00000020:00000010:3.0:1734256858.340935:0:6037:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012bf69928. 00000020:00000010:3.0:1734256858.340939:0:6037:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800b6fb6800. 80000000:00000010:3.0:1734256858.340941:0:6037:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b35f1660. 40000000:00000010:3.0:1734256858.340942:0:6037:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff88012a5086c0. 00000008:00000010:3.0:1734256858.340950:0:6037:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984a178. 00020000:00000010:3.0:1734256858.340953:0:6037:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b6191e40. 00008000:00000010:3.0:1734256858.340956:0:6037:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90a98. 00000020:00000010:2.0:1734256858.340958:0:7464:0:(cl_page.c:1153:cl_cache_init()) kmalloced '(cache)': 160 at ffff8800b401f0c0. 00100000:00000010:3.0:1734256858.340959:0:6037:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff88012bdff800. 00000080:00000010:2.0:1734256858.340960:0:7464:0:(llite_lib.c:138:ll_init_sbi()) kmalloced '(sbi->ll_foreign_symlink_prefix)': 6 at ffff88012abadcf0. 00000080:00000010:2.0:1734256858.340961:0:7464:0:(llite_lib.c:145:ll_init_sbi()) kmalloced '(sbi->ll_foreign_symlink_upcall)': 5 at ffff88012abadaf8. 00040000:00000010:3.0:1734256858.340961:0:6037:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b37ae200. 00040000:00000010:3.0:1734256858.340964:0:6037:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff88012bdfa000. 00040000:00000010:3.0:1734256858.340966:0:6037:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800b6fb6600. 00000004:00000010:3.0:1734256858.340969:0:6037:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff88013767f000. 00000004:00000010:3.0:1734256858.340973:0:6037:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800ab717000. 00000004:00000010:3.0:1734256858.340976:0:6037:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff88013767f800. 00002000:00000010:3.0:1734256858.340979:0:6037:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff8801372d3800. 00000004:00000010:3.0:1734256858.340982:0:6037:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff8801372d3000. 00000080:00000010:3.0:1734256858.340985:0:6037:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f51f8. 00000080:00000010:3.0:1734256858.340987:0:6037:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd06d8. 00000008:00000010:3.0:1734256858.340991:0:6037:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a887a160. 00020000:00000010:3.0:1734256858.340994:0:6037:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800a9908240. 00008000:00000010:3.0:1734256858.340995:0:6037:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff8801372b9af8. 00000080:00000010:3.0:1734256858.340998:0:6037:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800ac5f70f0. 02000000:00000010:3.0:1734256858.341014:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8801372d1000. 00000400:00000010:3.0:1734256858.341018:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256858.341023:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734256858.341027:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098162816, portal 25 00000400:00000010:3.0:1734256858.341030:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734256858.341032:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 26, xid 1818500098162816, offset 0 00000400:00000200:3.0:1734256858.341037:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256858.341044:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256858.341048:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256858.341052:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256858.341054:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256858.341056:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256858.341059:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [4:4:256:4294967295] 192.168.202.108@tcp LPNI seq info [4:4:8:4294967295] 00000400:00000200:3.0:1734256858.341066:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256858.341075:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256858.341078:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b37aec00. 00000800:00000200:3.0:1734256858.341083:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256858.341088:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256858.341091:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b37aec00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734256858.341753:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256858.341757:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b37aec00. 00000400:00000200:1.0:1734256858.341760:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.341764:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256858.341767:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:1.0:1734256858.341768:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:1.0:1734256858.341774:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098162816/t0(0) o250->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 520/544 e 0 to 0 dl 1734256868 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000020:00000010:2.0:1734256858.341782:0:7464:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800a9ca4980. 00000020:00000010:2.0:1734256858.341786:0:7464:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 1376 at ffff880136996000. 00000020:00000010:2.0:1734256858.341795:0:7464:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800a9ca4180. 00000020:00000010:2.0:1734256858.341797:0:7464:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 544 at ffff88012aa32800. 00000020:00000010:2.0:1734256858.341804:0:7464:0:(obd_mount.c:86:lustre_process_log()) kmalloced '(bufs)': 104 at ffff8800a9ca4200. 00000020:00000010:2.0:1734256858.341807:0:7464:0:(obd_mount.c:95:lustre_process_log()) kmalloced '(lcfg)': 176 at ffff8800b401fcc0. 10000000:00000010:2.0:1734256858.341811:0:7464:0:(mgc_request.c:197:do_config_log_add()) kmalloced '(cld)': 287 at ffff8800aa9bda00. 02000000:00000010:2.0:1734256858.341817:0:7464:0:(sec_config.c:558:sptlrpc_conf_get()) kmalloced '(conf)': 120 at ffff8800a9ca4000. 00000100:00000010:2.0:1734256858.341820:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.341826:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bd800. 00010000:00000010:2.0:1734256858.341839:0:7464:0:(ldlm_resource.c:1455:ldlm_resource_new()) slab-alloced 'res': 256 at ffff8800b404cd00. 00010000:00000010:2.0:1734256858.341848:0:7464:0:(ldlm_lock.c:435:ldlm_lock_new()) slab-alloced 'lock': 552 at ffff880130908000. 00000020:00000010:2.0:1734256858.341851:0:7464:0:(lprocfs_status.c:1222:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 64 at ffff8800b6e325c0. 00000100:00000010:2.0:1734256858.341862:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 00000400:00000200:2.0:1734256858.343941:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:2.0:1734256858.343956:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 25 MB=0x675ea8c600080 00000400:00000200:2.0:1734256858.343963:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 416/416 into md 0x119 [1] + 0 00000400:00000200:2.0:1734256858.343978:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256858.343981:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:2.0:1734256858.343989:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098162816/t0(0) o250->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 520/544 e 0 to 0 dl 1734256868 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256858.344058:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256858.344061:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:3.0:1734256858.344062:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734256858.344065:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098162816/t0(0) o250->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 520/544 e 0 to 0 dl 1734256868 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256858.344069:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098162816/t0(0) o250->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 520/544 e 0 to 0 dl 1734256868 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256858.344103:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8801372d1000. 02000000:00000010:3.0:1734256858.344108:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012a530400. 00000100:00000010:3.0:1734256858.344111:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 02000000:00000010:0.0:1734256858.344134:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b3529800. 00000400:00000010:0.0:1734256858.344137:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50108. 00000400:00000010:0.0:1734256858.344140:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:0.0:1734256858.344144:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098162944, portal 25 00000400:00000010:0.0:1734256858.344147:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000100:00000200:0.0:1734256858.344149:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1818500098162944, offset 0 00000400:00000200:0.0:1734256858.344153:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256858.344159:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256858.344163:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256858.344166:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256858.344173:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256858.344175:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256858.344177:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [5:5:256:4294967295] 192.168.202.108@tcp LPNI seq info [5:5:8:4294967295] 00000400:00000200:0.0:1734256858.344183:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256858.344187:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 328 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256858.344189:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734256858.344192:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256858.344197:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256858.344200:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 424 niov 1 nkiov 1 00000800:00000200:1.0:1734256858.344268:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256858.344270:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734256858.344272:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.344275:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256858.344277:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:1.0:1734256858.344278:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:1.0:1734256858.344282:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098162944/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.345989:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.345998:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 344 into portal 25 MB=0x675ea8c600100 00000400:00000200:0.0:1734256858.346003:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 344/344 into md 0x121 [1] + 224 00000400:00000200:0.0:1734256858.346016:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.346019:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.346024:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098162944/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.346114:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50108. 00000400:00000200:2.0:1734256858.346119:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:2.0:1734256858.346121:0:7464:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:2.0:1734256858.346125:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098162944/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.346141:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098162944/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.346155:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.346170:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b3529800. 02000000:00000010:2.0:1734256858.346173:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bd800. 00000100:00000010:2.0:1734256858.346175:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 10000000:00000010:2.0:1734256858.346185:0:7464:0:(mgc_request.c:1646:mgc_process_cfg_log()) kmalloced '(env)': 56 at ffff8800b6e32900. 00000020:00000010:2.0:1734256858.346188:0:7464:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800aa9bd800. 00000020:00000010:2.0:1734256858.346191:0:7464:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800aa9bd400. 00000040:00000010:2.0:1734256858.346194:0:7464:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800aa9bd200. 00000020:00000010:2.0:1734256858.346196:0:7464:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff880136994000. 00000020:00000010:2.0:1734256858.346198:0:7464:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800aa9bd000. 80000000:00000010:2.0:1734256858.346201:0:7464:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b58f49c0. 00040000:00000010:2.0:1734256858.346204:0:7464:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800aa9bce00. 20000000:00000010:2.0:1734256858.346207:0:7464:0:(mgs_handler.c:1475:mgs_key_init()) kmalloced '(value)': 392 at ffff8800aa9bcc00. 00000040:00000010:2.0:1734256858.346211:0:7464:0:(llog.c:62:llog_alloc_handle()) kmalloced '(loghandle)': 360 at ffff8800aa9bca00. 00000100:00000010:2.0:1734256858.346216:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.346223:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bc800. 00000100:00000010:2.0:1734256858.346232:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.346240:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734256858.346242:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c790. 00000400:00000010:2.0:1734256858.346245:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734256858.346248:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098163072, portal 25 00000400:00000010:2.0:1734256858.346251:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734256858.346252:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 512 bytes to portal 26, xid 1818500098163072, offset 0 00000400:00000200:2.0:1734256858.346256:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.346261:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.346264:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.346266:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.346268:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.346270:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.346277:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [6:6:256:4294967295] 192.168.202.108@tcp LPNI seq info [6:6:8:4294967295] 00000400:00000200:2.0:1734256858.346283:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256858.346286:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 512 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.346289:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404ce00. 00000800:00000200:2.0:1734256858.346292:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256858.346297:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256858.346299:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404ce00 type 1, nob 608 niov 1 nkiov 1 00000800:00000200:0.0:1734256858.346395:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.346398:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404ce00. 00000400:00000200:0.0:1734256858.346401:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.346404:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.346406:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734256858.346407:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734256858.346411:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098163072/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 512/272 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.348758:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.348770:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 272 into portal 25 MB=0x675ea8c600180 00000400:00000200:0.0:1734256858.348775:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 272/272 into md 0x129 [1] + 224 00000400:00000200:0.0:1734256858.348792:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.348796:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.348810:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098163072/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 512/272 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.348869:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c790. 00000400:00000200:2.0:1734256858.348874:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734256858.348875:0:7464:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734256858.348881:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098163072/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 512/272 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.348887:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098163072/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 512/272 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.348903:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.348909:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734256858.348911:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bc800. 00000100:00000010:2.0:1734256858.348914:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000040:00000010:2.0:1734256858.348918:0:7464:0:(llog.c:92:llog_free_handle()) kfreed 'loghandle': 360 at ffff8800aa9bca00. 00000020:00000010:2.0:1734256858.348924:0:7464:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800aa9bd400. 00000040:00000010:2.0:1734256858.348928:0:7464:0:(llog_obd.c:233:llog_key_fini()) kfreed 'info': 480 at ffff8800aa9bd200. 00000020:00000010:2.0:1734256858.348931:0:7464:0:(dt_object.c:53:dt_global_key_fini()) kfreed 'info': 1256 at ffff880136994000. 00000020:00000010:2.0:1734256858.348934:0:7464:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff8800aa9bd000. 80000000:00000010:2.0:1734256858.348937:0:7464:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff8800b58f49c0. 00040000:00000010:2.0:1734256858.348940:0:7464:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff8800aa9bce00. 20000000:00000010:2.0:1734256858.348943:0:7464:0:(mgs_handler.c:1475:mgs_key_fini()) kfreed 'info': 392 at ffff8800aa9bcc00. 00000020:00000010:2.0:1734256858.348946:0:7464:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800aa9bd800. 10000000:00000010:2.0:1734256858.348948:0:7464:0:(mgc_request.c:1694:mgc_process_cfg_log()) kfreed 'env': 56 at ffff8800b6e32900. 10000000:00000010:2.0:1734256858.348973:0:7464:0:(mgc_request.c:197:do_config_log_add()) kmalloced '(cld)': 279 at ffff8800aa9bd800. 10000000:00000010:2.0:1734256858.348977:0:7464:0:(mgc_request.c:197:do_config_log_add()) kmalloced '(cld)': 286 at ffff8800aa9bcc00. 10000000:00000010:2.0:1734256858.348980:0:7464:0:(mgc_request.c:197:do_config_log_add()) kmalloced '(cld)': 285 at ffff8800aa9bce00. 00000100:00000010:2.0:1734256858.348990:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.348997:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bd000. 00010000:00000010:2.0:1734256858.349006:0:7464:0:(ldlm_lock.c:435:ldlm_lock_new()) slab-alloced 'lock': 552 at ffff880130908240. 00000100:00000010:2.0:1734256858.349017:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.349026:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa31c00. 00000400:00000010:2.0:1734256858.349029:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c790. 00000400:00000010:2.0:1734256858.349032:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734256858.349035:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098163200, portal 25 00000400:00000010:2.0:1734256858.349037:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734256858.349039:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1818500098163200, offset 0 00000400:00000200:2.0:1734256858.349043:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.349049:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.349053:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.349056:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.349058:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.349059:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.349062:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [7:7:256:4294967295] 192.168.202.108@tcp LPNI seq info [7:7:8:4294967295] 00000400:00000200:2.0:1734256858.349068:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256858.349071:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 328 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.349074:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c800. 00000800:00000200:2.0:1734256858.349077:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256858.349082:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256858.349085:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c800 type 1, nob 424 niov 1 nkiov 1 00000800:00000200:1.0:1734256858.349189:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256858.349192:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c800. 00000400:00000200:1.0:1734256858.349195:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.349201:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256858.349208:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:1.0:1734256858.349209:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:1.0:1734256858.349213:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098163200/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.350145:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.350152:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 344 into portal 25 MB=0x675ea8c600200 00000400:00000200:0.0:1734256858.350156:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 344/344 into md 0x131 [1] + 224 00000400:00000200:0.0:1734256858.350167:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.350169:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.350174:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098163200/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.350285:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c790. 00000400:00000200:2.0:1734256858.350288:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734256858.350289:0:7464:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734256858.350293:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098163200/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.350300:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098163200/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.350311:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.350329:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa31c00. 02000000:00000010:2.0:1734256858.350334:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bd000. 00000100:00000010:2.0:1734256858.350336:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 10000000:00000010:2.0:1734256858.350339:0:7464:0:(mgc_request.c:1646:mgc_process_cfg_log()) kmalloced '(env)': 56 at ffff8800b6e32900. 00000020:00000010:2.0:1734256858.350366:0:7464:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800aa9bd000. 00000020:00000010:2.0:1734256858.350370:0:7464:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800aa9bd200. 00000040:00000010:2.0:1734256858.350372:0:7464:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800aa9bd400. 00000020:00000010:2.0:1734256858.350374:0:7464:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff880136994000. 00000020:00000010:2.0:1734256858.350377:0:7464:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800aa9bca00. 80000000:00000010:2.0:1734256858.350379:0:7464:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b58f49c0. 00040000:00000010:2.0:1734256858.350382:0:7464:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800aa9bc800. 20000000:00000010:2.0:1734256858.350384:0:7464:0:(mgs_handler.c:1475:mgs_key_init()) kmalloced '(value)': 392 at ffff8800aa9bc600. 00000040:00000010:2.0:1734256858.350388:0:7464:0:(llog.c:62:llog_alloc_handle()) kmalloced '(loghandle)': 360 at ffff8800aa9bc400. 00000100:00000010:2.0:1734256858.350391:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.350397:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bc200. 00000100:00000010:2.0:1734256858.350402:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.350408:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734256858.350410:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c790. 00000400:00000010:2.0:1734256858.350413:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734256858.350415:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098163328, portal 25 00000400:00000010:2.0:1734256858.350417:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734256858.350419:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 512 bytes to portal 26, xid 1818500098163328, offset 0 00000400:00000200:2.0:1734256858.350423:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.350427:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.350430:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.350432:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.350433:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.350435:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.350437:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [8:8:256:4294967295] 192.168.202.108@tcp LPNI seq info [8:8:8:4294967295] 00000400:00000200:2.0:1734256858.350442:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256858.350446:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 512 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.350452:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404cb00. 00000800:00000200:2.0:1734256858.350455:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256858.350459:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256858.350461:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404cb00 type 1, nob 608 niov 1 nkiov 1 00000800:00000200:0.0:1734256858.350551:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.350554:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404cb00. 00000400:00000200:0.0:1734256858.350556:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.350559:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.350561:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734256858.350562:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734256858.350565:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098163328/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 512/272 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.351657:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.351666:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 272 into portal 25 MB=0x675ea8c600280 00000400:00000200:0.0:1734256858.351670:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 272/272 into md 0x139 [1] + 224 00000400:00000200:0.0:1734256858.351681:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.351684:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.351689:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098163328/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 512/272 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.351777:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c790. 00000400:00000200:2.0:1734256858.351780:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734256858.351781:0:7464:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734256858.351785:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098163328/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 512/272 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.351792:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098163328/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 512/272 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.351804:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.351810:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734256858.351813:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bc200. 00000100:00000010:2.0:1734256858.351814:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000040:00000010:2.0:1734256858.351820:0:7464:0:(llog.c:407:llog_init_handle()) kmalloced '(llh)': 8192 at ffff88012b902000. 00000100:00000010:2.0:1734256858.351823:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.351828:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bc200. 00000100:00000010:2.0:1734256858.351832:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.351848:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff88012e368000. 00000400:00000010:2.0:1734256858.351851:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c790. 00000400:00000010:2.0:1734256858.351854:0:7464:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 184 at ffff8800b401fc00. 00000100:00000200:2.0:1734256858.351857:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1818500098163456, portal 25 00000400:00000010:2.0:1734256858.351860:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734256858.351861:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1818500098163456, offset 0 00000400:00000200:2.0:1734256858.351865:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.351870:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.351873:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.351875:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.351877:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.351879:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.351881:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [9:9:256:4294967295] 192.168.202.108@tcp LPNI seq info [9:9:8:4294967295] 00000400:00000200:2.0:1734256858.351891:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256858.351896:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.351898:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734256858.351901:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256858.351906:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256858.351908:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:0.0:1734256858.351993:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.351996:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734256858.351999:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.352002:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.352004:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734256858.352010:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734256858.352014:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098163456/t0(0) o503->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8416 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.353368:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.353376:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 8416 into portal 25 MB=0x675ea8c600300 00000400:00000200:0.0:1734256858.353380:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 8416/8416 into md 0x141 [4] + 224 00000400:00000200:0.0:1734256858.353399:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.353401:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.353406:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098163456/t0(0) o503->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8416 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.353444:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c790. 00000400:00000200:2.0:1734256858.353447:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b401fc00 00000400:00000010:2.0:1734256858.353448:0:7464:0:(lib-lnet.h:300:lnet_md_free()) kfreed 'md': 184 at ffff8800b401fc00. 00000100:00000200:2.0:1734256858.353451:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098163456/t0(0) o503->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8416 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.353455:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098163456/t0(0) o503->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8416 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.353464:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.353470:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff88012e368000. 02000000:00000010:2.0:1734256858.353480:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bc200. 00000100:00000010:2.0:1734256858.353482:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000040:00000010:2.0:1734256858.353488:0:7464:0:(llog.c:884:llog_process_or_fork()) kmalloced '(lpi)': 104 at ffff8800a9ca4c00. 00000020:00000010:3.0:1734256858.353717:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6fb6200. 00000020:00000010:3.0:1734256858.353721:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b6fb6000. 00000040:00000010:3.0:1734256858.353724:0:7477:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b6fb6400. 00000020:00000010:3.0:1734256858.353728:0:7477:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff88013767c800. 00000020:00000010:3.0:1734256858.353732:0:7477:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800aabb3e00. 80000000:00000010:3.0:1734256858.353735:0:7477:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b35f12a0. 00040000:00000010:3.0:1734256858.353742:0:7477:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b37aec00. 00040000:00000010:3.0:1734256858.353744:0:7477:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800aabb3c00. 20000000:00000010:3.0:1734256858.353746:0:7477:0:(mgs_handler.c:1475:mgs_key_init()) kmalloced '(value)': 392 at ffff8800aabb3a00. 00000040:00000010:3.0:1734256858.353876:0:7477:0:(llog.c:527:llog_process_thread()) kmalloced '(buf)': 8192 at ffff8800ac462000. 00000100:00000010:3.0:1734256858.353888:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b240000. 02000000:00000010:3.0:1734256858.353894:0:7477:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aabb3800. 00000100:00000010:3.0:1734256858.353901:0:7477:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b6191cc0. 02000000:00000010:3.0:1734256858.353916:0:7477:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff88012dbb0000. 00000400:00000010:3.0:1734256858.353919:0:7477:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256858.353922:0:7477:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 184 at ffff8800b6191840. 00000100:00000200:3.0:1734256858.353929:0:7477:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1818500098163584, portal 25 00000400:00000010:3.0:1734256858.353932:0:7477:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734256858.353934:0:7477:0:(niobuf.c:87:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1818500098163584, offset 0 00000400:00000200:3.0:1734256858.353938:0:7477:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256858.353943:0:7477:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256858.353946:0:7477:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256858.353948:0:7477:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256858.353951:0:7477:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256858.353953:0:7477:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256858.353955:0:7477:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [10:10:256:4294967295] 192.168.202.108@tcp LPNI seq info [10:10:8:4294967295] 00000400:00000200:3.0:1734256858.353961:0:7477:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256858.353965:0:7477:0:(socklnd_cb.c:1000:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256858.353967:0:7477:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b37aef00. 00000800:00000200:3.0:1734256858.353970:0:7477:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256858.353975:0:7477:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256858.353977:0:7477:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b37aef00 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:0.0:1734256858.354135:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.354137:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b37aef00. 00000400:00000200:0.0:1734256858.354139:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.354142:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.354144:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734256858.354145:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734256858.354149:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b240000 x1818500098163584/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.355448:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.355456:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 8472 into portal 25 MB=0x675ea8c600380 00000400:00000200:0.0:1734256858.355461:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 8472/8472 into md 0x149 [4] + 224 00000400:00000200:0.0:1734256858.355477:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.355480:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.355485:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b240000 x1818500098163584/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256858.355551:0:7477:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256858.355554:0:7477:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b6191840 00000400:00000010:3.0:1734256858.355555:0:7477:0:(lib-lnet.h:300:lnet_md_free()) kfreed 'md': 184 at ffff8800b6191840. 00000100:00000200:3.0:1734256858.355559:0:7477:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b240000 x1818500098163584/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256858.355565:0:7477:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b240000 x1818500098163584/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:3.0:1734256858.355602:0:7477:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b6191cc0. 02000000:00000010:3.0:1734256858.355608:0:7477:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff88012dbb0000. 02000000:00000010:3.0:1734256858.355616:0:7477:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aabb3800. 00000100:00000010:3.0:1734256858.355619:0:7477:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b240000. 00000020:00000010:3.0:1734256858.355629:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aea00. 00000020:00000010:3.0:1734256858.355632:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aea00. 00000020:00000010:3.0:1734256858.355635:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff88012a508940. 00000020:00000010:3.0:1734256858.355775:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 128 at ffff8800b4156f00. 00000020:00000010:3.0:1734256858.355790:0:7477:0:(genops.c:70:obd_device_alloc()) slab-alloced 'obd': 5488 at ffff880136bf8000. 00000020:00000010:3.0:1734256858.355795:0:7477:0:(genops.c:973:__class_new_export()) kmalloced '(export)': 1176 at ffff88013767c000. 00000020:00000010:3.0:1734256858.355881:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 128 at ffff8800b4156f00. 00000020:00000010:3.0:1734256858.355884:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff88012a508940. 00000020:00000010:3.0:1734256858.355887:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff88012a508940. 00000020:00000010:3.0:1734256858.355889:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 160 at ffff8800b6191cc0. 00000001:00000010:3.0:1734256858.356018:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800b6191840. 00000001:00000010:3.0:1734256858.356022:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b63125c0. 00000001:00000010:3.0:1734256858.356024:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb3800. 00000001:00000010:3.0:1734256858.356026:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb3600. 00000001:00000010:3.0:1734256858.356027:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb3400. 00000001:00000010:3.0:1734256858.356029:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb3200. 00000001:00000010:3.0:1734256858.356030:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800b6191600. 00000001:00000010:3.0:1734256858.356032:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b63124a0. 00000001:00000010:3.0:1734256858.356033:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb3000. 00000001:00000010:3.0:1734256858.356035:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb2e00. 00000001:00000010:3.0:1734256858.356036:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb2c00. 00000001:00000010:3.0:1734256858.356037:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb2a00. 00000020:00000010:3.0:1734256858.356040:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800aabb2800. 00000020:00000010:3.0:1734256858.356043:0:7477:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff8800b4156f00. 00000020:00000010:3.0:1734256858.356050:0:7477:0:(tgt_main.c:755:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff88012c101000. 00000008:00000010:3.0:1734256858.356054:0:7477:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a887a2c0. 00020000:00000010:3.0:1734256858.356057:0:7477:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800a9908480. 00008000:00000010:3.0:1734256858.356060:0:7477:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff8801372b9938. 00000080:00000010:3.0:1734256858.356064:0:7477:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800ac5f71e0. 00000020:00000010:3.0:1734256858.356067:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800aabb2600. 00000020:00000010:3.0:1734256858.356068:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800aabb2400. 00000020:00000010:3.0:1734256858.356071:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b35f1900. 00000008:00000010:3.0:1734256858.356074:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.356075:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b61916c0. 00008000:00000010:3.0:1734256858.356078:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.356083:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.356085:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0920. 00020000:00000010:3.0:1734256858.356089:0:7477:0:(lov_dev.c:612:lov_device_alloc()) kmalloced '(ld)': 560 at ffff8801376ec800. 00000020:00000010:3.0:1734256858.356099:0:7477:0:(lu_tgt_pool.c:73:lu_tgt_pool_init()) kmalloced '(op->op_array)': 8 at ffff8801372b9f40. 00020000:00000010:3.0:1734256858.356194:0:7477:0:(lov_dev.c:629:lov_device_alloc()) kmalloced '(ld->ld_md_tgts)': 4096 at ffff8800ab716000. 00020000:00000010:3.0:1734256858.356198:0:7477:0:(lov_dev.c:636:lov_device_alloc()) kmalloced '(ld->ld_lov->lov_mdc_tgts)': 4096 at ffff8800ab710000. 00000020:00000010:3.0:1734256858.356224:0:7477:0:(lu_object.c:1109:lu_site_init()) kmalloced '(s->ls_bkts)': 14336 at ffff880136a44000. 00000020:00000010:3.0:1734256858.356231:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b4156980. 00000020:00000010:3.0:1734256858.356234:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 192 at ffff8800b6191300. 00000020:00000010:3.0:1734256858.356238:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b35f1240. 00000040:00000010:3.0:1734256858.356241:0:7477:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800aabb2000. 00000020:00000010:3.0:1734256858.356247:0:7477:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff88012b760000. 00000020:00000010:3.0:1734256858.356250:0:7477:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012bf69e30. 00000020:00000010:3.0:1734256858.356254:0:7477:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800b58e7e00. 80000000:00000010:3.0:1734256858.356256:0:7477:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b35f1060. 40000000:00000010:3.0:1734256858.356258:0:7477:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff88012a5083c0. 00000008:00000010:3.0:1734256858.356260:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984b7c8. 00020000:00000010:3.0:1734256858.356262:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b6191a80. 00008000:00000010:3.0:1734256858.356264:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d911a8. 00100000:00000010:3.0:1734256858.356266:0:7477:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff88012b760800. 00040000:00000010:3.0:1734256858.356268:0:7477:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b37ae600. 00040000:00000010:3.0:1734256858.356271:0:7477:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff88012b761000. 00040000:00000010:3.0:1734256858.356273:0:7477:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800b58e7c00. 00000004:00000010:3.0:1734256858.356275:0:7477:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff88012b761800. 00000004:00000010:3.0:1734256858.356279:0:7477:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800b427f000. 00000004:00000010:3.0:1734256858.356282:0:7477:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff88012b762000. 00002000:00000010:3.0:1734256858.356285:0:7477:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff8801376ecc00. 00000004:00000010:3.0:1734256858.356287:0:7477:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff8801376f2400. 00000080:00000010:3.0:1734256858.356289:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f5348. 00000080:00000010:3.0:1734256858.356291:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0b68. 00000020:00000010:3.0:1734256858.356294:0:7477:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800aabb2400. 00000020:00000010:3.0:1734256858.356298:0:7477:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b35f1900. 00000008:00000010:3.0:1734256858.356310:0:7477:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.356312:0:7477:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff8800b61916c0. 00008000:00000010:3.0:1734256858.356314:0:7477:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.356317:0:7477:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.356318:0:7477:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a9bd0920. 00000020:00000010:3.0:1734256858.356320:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800aabb2600. 00000020:00000010:3.0:1734256858.356323:0:7477:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 128 at ffff8800b4156f00. 00000020:00000010:3.0:1734256858.356325:0:7477:0:(tgt_main.c:767:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff88012c101000. 00000008:00000010:3.0:1734256858.356327:0:7477:0:(osc_dev.c:125:osc_session_fini()) slab-freed '(info)': 352 at ffff8800a887a2c0. 00020000:00000010:3.0:1734256858.356329:0:7477:0:(lov_dev.c:137:lov_session_key_fini()) slab-freed '(info)': 576 at ffff8800a9908480. 00008000:00000010:3.0:1734256858.356330:0:7477:0:(echo_client.c:466:echo_session_key_fini()) slab-freed '(session)': 8 at ffff8801372b9938. 00000080:00000010:3.0:1734256858.356332:0:7477:0:(vvp_dev.c:124:vvp_session_key_fini()) slab-freed '(session)': 240 at ffff8800ac5f71e0. 00000020:00000010:3.0:1734256858.356334:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800aabb2800. 00000020:00000010:3.0:1734256858.356336:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 160 at ffff8800b6191cc0. 00000020:00000010:3.0:1734256858.356337:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff88012a508940. 00000020:00000010:3.0:1734256858.356341:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.356342:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.356344:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.356346:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.356347:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff88012a508940. 00000020:00000010:3.0:1734256858.356349:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 128 at ffff8800b4156f00. 00000020:00000010:3.0:1734256858.356353:0:7477:0:(genops.c:70:obd_device_alloc()) slab-alloced 'obd': 5488 at ffff880136bf9570. 00000020:00000010:3.0:1734256858.356356:0:7477:0:(genops.c:973:__class_new_export()) kmalloced '(export)': 1176 at ffff88012b762800. 00000020:00000010:3.0:1734256858.356361:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 128 at ffff8800b4156f00. 00000020:00000010:3.0:1734256858.356362:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff88012a508940. 00000020:00000010:3.0:1734256858.356363:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff88012a508940. 00000020:00000010:3.0:1734256858.356365:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 160 at ffff8800b6191cc0. 00000001:00000010:3.0:1734256858.356374:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800b61916c0. 00000001:00000010:3.0:1734256858.356376:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b6312600. 00000001:00000010:3.0:1734256858.356378:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e7a00. 00000001:00000010:3.0:1734256858.356379:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e7800. 00000001:00000010:3.0:1734256858.356381:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e7600. 00000001:00000010:3.0:1734256858.356386:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e7400. 00000001:00000010:3.0:1734256858.356388:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800b6191240. 00000001:00000010:3.0:1734256858.356389:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b6312880. 00000001:00000010:3.0:1734256858.356390:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e7200. 00000001:00000010:3.0:1734256858.356392:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e7000. 00000001:00000010:3.0:1734256858.356393:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e6e00. 00000001:00000010:3.0:1734256858.356394:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e6c00. 00000020:00000010:3.0:1734256858.356449:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b4156f00. 00000020:00000010:3.0:1734256858.356452:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 512 at ffff8800b58e6800. 80000000:00000010:3.0:1734256858.356458:0:7477:0:(fld_cache.c:41:fld_cache_init()) kmalloced '(cache)': 168 at ffff8800b6d77a80. 00000020:00000010:3.0:1734256858.356480:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 160 at ffff8800b6191cc0. 00000020:00000010:3.0:1734256858.356483:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff88012a508940. 00000020:00000010:3.0:1734256858.356486:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37ae300. 00000020:00000010:3.0:1734256858.356487:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37ae300. 00000020:00000010:3.0:1734256858.356490:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37ae300. 00000020:00000010:3.0:1734256858.356491:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37ae300. 00000020:00000010:3.0:1734256858.356493:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 96 at ffff8800b35f1900. 00000020:00000010:3.0:1734256858.356495:0:7477:0:(obd_config.c:1090:class_add_profile()) kmalloced '(lprof)': 48 at ffff88012a508940. 00000020:00000010:3.0:1734256858.356497:0:7477:0:(obd_config.c:1096:class_add_profile()) kmalloced '(lprof->lp_profile)': 14 at ffff8800ab6e3720. 00000020:00000010:3.0:1734256858.356498:0:7477:0:(obd_config.c:1102:class_add_profile()) kmalloced '(lprof->lp_dt)': 14 at ffff8800ab6e3000. 00000020:00000010:3.0:1734256858.356499:0:7477:0:(obd_config.c:1109:class_add_profile()) kmalloced '(lprof->lp_md)': 14 at ffff8800ab6e3700. 00000020:00000010:3.0:1734256858.356500:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 96 at ffff8800b35f1900. 00000020:00000010:3.0:1734256858.356502:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37ae300. 00000020:00000010:3.0:1734256858.356503:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37ae300. 00000020:00000010:3.0:1734256858.356506:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37ae300. 00000020:00000010:3.0:1734256858.356507:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37ae300. 00000020:00000010:3.0:1734256858.356509:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 64 at ffff88012a508d40. 00000100:00000010:3.0:1734256858.356512:0:7477:0:(lustre_peer.c:89:class_add_uuid()) kmalloced '(data)': 704 at ffff88012a538400. 00000400:00000200:3.0:1734256858.356518:0:7477:0:(peer.c:1757:lnet_peer_add()) peer 192.168.202.108@tcp NID flags 0x100001: -17 00000020:00000010:3.0:1734256858.356521:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 64 at ffff88012a508d40. 00000020:00000010:3.0:1734256858.356522:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff88012a508d40. 00000020:00000010:3.0:1734256858.356529:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff8800b6d77c00. 00000020:00000010:3.0:1734256858.356534:0:7477:0:(genops.c:70:obd_device_alloc()) slab-alloced 'obd': 5488 at ffff880136bfaae0. 00000020:00000010:3.0:1734256858.356536:0:7477:0:(genops.c:973:__class_new_export()) kmalloced '(export)': 1176 at ffff88012b763000. 00000020:00000010:3.0:1734256858.356679:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff8800b6d77c00. 00000020:00000010:3.0:1734256858.356682:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff88012a508d40. 00000020:00000010:3.0:1734256858.356686:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff88012a508d40. 00000020:00000010:3.0:1734256858.356688:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff8800b6d77c00. 00000001:00000010:3.0:1734256858.356698:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800b6d77480. 00000001:00000010:3.0:1734256858.356699:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b6312760. 00000001:00000010:3.0:1734256858.356701:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e6400. 00000001:00000010:3.0:1734256858.356703:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e6200. 00000001:00000010:3.0:1734256858.356704:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b58e6000. 00000001:00000010:3.0:1734256858.356706:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb2200. 00000001:00000010:3.0:1734256858.356708:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800b6d77300. 00000001:00000010:3.0:1734256858.356710:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b6312780. 00000001:00000010:3.0:1734256858.356711:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb2800. 00000001:00000010:3.0:1734256858.356712:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb2600. 00000001:00000010:3.0:1734256858.356714:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800aabb2400. 00000001:00000010:3.0:1734256858.356716:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3717e00. 00000020:00000010:3.0:1734256858.356719:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b3717c00. 00000020:00000010:3.0:1734256858.356721:0:7477:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff8800b4156080. 00000020:00000010:3.0:1734256858.356723:0:7477:0:(tgt_main.c:755:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff88012c101000. 00000008:00000010:3.0:1734256858.356725:0:7477:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a887a2c0. 00020000:00000010:3.0:1734256858.356726:0:7477:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800a9908480. 00008000:00000010:3.0:1734256858.356728:0:7477:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff8801372b9f50. 00000080:00000010:3.0:1734256858.356730:0:7477:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800ac5f71e0. 00000020:00000010:3.0:1734256858.356732:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b3717a00. 00000020:00000010:3.0:1734256858.356734:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b3717800. 00000020:00000010:3.0:1734256858.356735:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b35f1900. 00000008:00000010:3.0:1734256858.356737:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.356738:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b6d776c0. 00008000:00000010:3.0:1734256858.356740:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.356746:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.356747:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0920. 00000002:00000010:3.0:1734256858.356750:0:7477:0:(mdc_dev.c:1681:mdc_device_alloc()) kmalloced '(oc)': 104 at ffff8800b4156180. 00010000:00000010:3.0:1734256858.356758:0:7477:0:(ldlm_lib.c:482:client_obd_setup()) kmalloced '(cli->cl_mod_tag_bitmap)': 64 at ffff88012a508640. 00000020:00000010:3.0:1734256858.356762:0:7477:0:(genops.c:1192:class_new_import()) kmalloced '(imp)': 1680 at ffff88012b763800. 00000100:00000200:3.0:1734256858.356771:0:7477:0:(events.c:572:ptlrpc_uuid_to_peer()) 192.168.202.108@tcp->12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256858.356775:0:7477:0:(peer.c:1500:LNetPrimaryNID()) NID 192.168.202.108@tcp primary NID 192.168.202.108@tcp rc 0 00010000:00000010:3.0:1734256858.356778:0:7477:0:(ldlm_lib.c:69:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff8800b35f1cc0. 00010000:00000010:3.0:1734256858.356782:0:7477:0:(ldlm_resource.c:935:ldlm_namespace_new()) kmalloced '(ns)': 760 at ffff88012a53b400. 00000001:00000010:3.0:1734256858.356784:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff8800b37ae300. 00000001:00000010:3.0:1734256858.356786:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 256 at ffff8800b37ae400. 00000001:00000010:3.0:1734256858.356818:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000867000. 00000001:00000010:3.0:1734256858.356853:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000871000. 00000001:00000010:3.0:1734256858.356887:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc9000087b000. 00000001:00000010:3.0:1734256858.356926:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900008ec000. 00000001:00000010:3.0:1734256858.356961:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900008f6000. 00000001:00000010:3.0:1734256858.356996:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000900000. 00000001:00000010:3.0:1734256858.357037:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc9000090a000. 00000001:00000010:3.0:1734256858.357073:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000914000. 00000001:00000010:3.0:1734256858.357108:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc9000091e000. 00000001:00000010:3.0:1734256858.357240:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000928000. 00000001:00000010:3.0:1734256858.357274:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000932000. 00000001:00000010:3.0:1734256858.357305:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc9000093c000. 00000001:00000010:3.0:1734256858.357337:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000946000. 00000001:00000010:3.0:1734256858.357377:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000950000. 00000001:00000010:3.0:1734256858.357409:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc9000095a000. 00000001:00000010:3.0:1734256858.357444:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000964000. 00000001:00000010:3.0:1734256858.357484:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc9000096e000. 00000001:00000010:3.0:1734256858.357519:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000978000. 00000001:00000010:3.0:1734256858.357553:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000982000. 00000001:00000010:3.0:1734256858.357613:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc9000098c000. 00000001:00000010:3.0:1734256858.357653:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000996000. 00000001:00000010:3.0:1734256858.357688:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009a0000. 00000001:00000010:3.0:1734256858.357738:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009aa000. 00000001:00000010:3.0:1734256858.357857:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009b4000. 00000001:00000010:3.0:1734256858.357897:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009be000. 00000001:00000010:3.0:1734256858.357933:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009c8000. 00000001:00000010:3.0:1734256858.357971:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009d2000. 00000001:00000010:3.0:1734256858.358010:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009dc000. 00000001:00000010:3.0:1734256858.358045:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009e6000. 00000001:00000010:3.0:1734256858.358093:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009f0000. 00000001:00000010:3.0:1734256858.358131:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc900009fa000. 00000001:00000010:3.0:1734256858.358166:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32840 at ffffc90000a04000. 00010000:00000010:3.0:1734256858.358180:0:7477:0:(ldlm_resource.c:957:ldlm_namespace_new()) kmalloced '(ns->ns_rs_buckets)': 2816 at ffff8800b427d000. 00000020:00000010:3.0:1734256858.358215:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b6fc0280. 00000020:00000010:3.0:1734256858.358218:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 32 at ffff8800b6312800. 00000020:00000010:3.0:1734256858.358536:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b6fc0c80. 00000020:00000010:3.0:1734256858.358540:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 352 at ffff8800b3717600. 00000100:00000010:3.0:1734256858.358555:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b240000. 00000100:00000010:3.0:1734256858.358558:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b240380. 00000020:00000010:3.0:1734256858.358802:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b6fc0480. 00000020:00000010:3.0:1734256858.358806:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 512 at ffff8800b3717200. 00000020:00000010:3.0:1734256858.358820:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b6fc0f80. 00000020:00000010:3.0:1734256858.358822:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff88012aacb000. 00000040:00000010:3.0:1734256858.358833:0:7477:0:(llog_obd.c:44:llog_new_ctxt()) kmalloced '(ctxt)': 176 at ffff8800a886d300. 00000002:00000010:3.0:1734256858.358839:0:7477:0:(mdc_changelog.c:798:mdc_changelog_cdev_init()) kmalloced '(entry)': 944 at ffff88012a53b000. 00000020:00000010:3.0:1734256858.359272:0:7477:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800b3717800. 00000020:00000010:3.0:1734256858.359275:0:7477:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b35f1900. 00000008:00000010:3.0:1734256858.359279:0:7477:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.359283:0:7477:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff8800b6d776c0. 00008000:00000010:3.0:1734256858.359287:0:7477:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.359291:0:7477:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.359300:0:7477:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a9bd0920. 00000020:00000010:3.0:1734256858.359302:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800b3717a00. 00000020:00000010:3.0:1734256858.359307:0:7477:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 128 at ffff8800b4156080. 00000020:00000010:3.0:1734256858.359309:0:7477:0:(tgt_main.c:767:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff88012c101000. 00000008:00000010:3.0:1734256858.359313:0:7477:0:(osc_dev.c:125:osc_session_fini()) slab-freed '(info)': 352 at ffff8800a887a2c0. 00020000:00000010:3.0:1734256858.359314:0:7477:0:(lov_dev.c:137:lov_session_key_fini()) slab-freed '(info)': 576 at ffff8800a9908480. 00008000:00000010:3.0:1734256858.359316:0:7477:0:(echo_client.c:466:echo_session_key_fini()) slab-freed '(session)': 8 at ffff8801372b9f50. 00000080:00000010:3.0:1734256858.359319:0:7477:0:(vvp_dev.c:124:vvp_session_key_fini()) slab-freed '(session)': 240 at ffff8800ac5f71e0. 00000020:00000010:3.0:1734256858.359320:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800b3717c00. 00000020:00000010:3.0:1734256858.359324:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff8800b6d77c00. 00000020:00000010:3.0:1734256858.359326:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff88012a508d40. 00000020:00000010:3.0:1734256858.359333:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.359336:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 152 at ffff8800a886d0c0. 00800000:00000010:3.0:1734256858.359346:0:7477:0:(lmv_obd.c:423:lmv_add_target()) kmalloced '(tgt)': 376 at ffff8800b3717c00. 00020000:00000010:3.0:1734256858.359349:0:7477:0:(lu_tgt_descs.c:393:ltd_add_tgt()) kmalloced '(ltd->ltd_tgt_idx[index / (((1UL) << 12) / sizeof(void *))])': 4096 at ffff8800b5a1f000. 00000020:00000010:3.0:1734256858.359353:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b3717a00. 00000020:00000010:3.0:1734256858.359355:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b3717800. 00000020:00000010:3.0:1734256858.359357:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.359359:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.359361:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800a886de40. 00008000:00000010:3.0:1734256858.359363:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.359366:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.359367:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0920. 00000020:00000010:3.0:1734256858.359373:0:7477:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800b3717800. 00000020:00000010:3.0:1734256858.359375:0:7477:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.359376:0:7477:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.359378:0:7477:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff8800a886de40. 00008000:00000010:3.0:1734256858.359380:0:7477:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.359381:0:7477:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.359382:0:7477:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a9bd0920. 00000020:00000010:3.0:1734256858.359384:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800b3717a00. 00000020:00000010:3.0:1734256858.359385:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 152 at ffff8800a886d0c0. 00000020:00000010:3.0:1734256858.359390:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.359393:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aea00. 00000020:00000010:3.0:1734256858.359395:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aea00. 00000020:00000010:3.0:1734256858.359398:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aea00. 00000020:00000010:3.0:1734256858.359399:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aea00. 00000020:00000010:3.0:1734256858.359402:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aea00. 00000020:00000010:3.0:1734256858.359403:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aea00. 00000020:00000010:3.0:1734256858.359405:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 64 at ffff88012d6b6cc0. 00000100:00000010:3.0:1734256858.359409:0:7477:0:(lustre_peer.c:89:class_add_uuid()) kmalloced '(data)': 704 at ffff8801376a2800. 00000400:00000200:3.0:1734256858.359417:0:7477:0:(peer.c:1757:lnet_peer_add()) peer 192.168.202.108@tcp NID flags 0x100001: -17 00000100:00000010:3.0:1734256858.359420:0:7477:0:(lustre_peer.c:124:class_add_uuid()) kfreed 'data': 704 at ffff8801376a2800. 00000020:00000010:3.0:1734256858.359422:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 64 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.359425:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.359426:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff8800a886d0c0. 00000020:00000010:3.0:1734256858.359432:0:7477:0:(genops.c:70:obd_device_alloc()) slab-alloced 'obd': 5488 at ffff880136bfc050. 00000020:00000010:3.0:1734256858.359436:0:7477:0:(genops.c:973:__class_new_export()) kmalloced '(export)': 1176 at ffff88012b764000. 00000020:00000010:3.0:1734256858.359444:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff8800a886d0c0. 00000020:00000010:3.0:1734256858.359445:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.359447:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.359449:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff8800a886d0c0. 00000001:00000010:3.0:1734256858.359462:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800a886de40. 00000001:00000010:3.0:1734256858.359464:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b63127e0. 00000001:00000010:3.0:1734256858.359466:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3717a00. 00000001:00000010:3.0:1734256858.359468:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3717800. 00000001:00000010:3.0:1734256858.359469:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3717000. 00000001:00000010:3.0:1734256858.359471:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3716e00. 00000001:00000010:3.0:1734256858.359473:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800a886d9c0. 00000001:00000010:3.0:1734256858.359475:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b63126c0. 00000001:00000010:3.0:1734256858.359477:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3716c00. 00000001:00000010:3.0:1734256858.359479:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3716a00. 00000001:00000010:3.0:1734256858.359480:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3716800. 00000001:00000010:3.0:1734256858.359486:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3716600. 00000020:00000010:3.0:1734256858.359488:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b3716400. 00000020:00000010:3.0:1734256858.359490:0:7477:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff8800b6fc0d80. 00000020:00000010:3.0:1734256858.359492:0:7477:0:(tgt_main.c:755:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff88012c101000. 00000008:00000010:3.0:1734256858.359494:0:7477:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a887a2c0. 00020000:00000010:3.0:1734256858.359496:0:7477:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800a9908480. 00008000:00000010:3.0:1734256858.359498:0:7477:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff8801372b9f50. 00000080:00000010:3.0:1734256858.359500:0:7477:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800ac5f71e0. 00000020:00000010:3.0:1734256858.359502:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b3716200. 00000020:00000010:3.0:1734256858.359504:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b3716000. 00000020:00000010:3.0:1734256858.359505:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.359507:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.359509:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800a886d900. 00008000:00000010:3.0:1734256858.359510:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.359512:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.359513:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0920. 00000008:00000010:3.0:1734256858.359515:0:7477:0:(osc_dev.c:186:osc_device_alloc()) kmalloced '(osc)': 104 at ffff8800b6fc0100. 00000020:00000010:3.0:1734256858.359524:0:7477:0:(genops.c:1192:class_new_import()) kmalloced '(imp)': 1680 at ffff88012b764800. 00000100:00000200:3.0:1734256858.359536:0:7477:0:(events.c:572:ptlrpc_uuid_to_peer()) 192.168.202.108@tcp->12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256858.359540:0:7477:0:(peer.c:1500:LNetPrimaryNID()) NID 192.168.202.108@tcp primary NID 192.168.202.108@tcp rc 0 00010000:00000010:3.0:1734256858.359544:0:7477:0:(ldlm_lib.c:69:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff8800b3695ae0. 00010000:00000010:3.0:1734256858.359547:0:7477:0:(ldlm_resource.c:935:ldlm_namespace_new()) kmalloced '(ns)': 760 at ffff88012a5ca400. 00000001:00000010:3.0:1734256858.359549:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff8800b37aea00. 00000001:00000010:3.0:1734256858.359551:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 128 at ffff8800b6fc0300. 00000001:00000010:3.0:1734256858.359554:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ac464000. 00000001:00000010:3.0:1734256858.359558:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ac466000. 00000001:00000010:3.0:1734256858.359601:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ac770000. 00000001:00000010:3.0:1734256858.359606:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ac772000. 00000001:00000010:3.0:1734256858.359609:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ac774000. 00000001:00000010:3.0:1734256858.359613:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ac776000. 00000001:00000010:3.0:1734256858.359621:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a9be0000. 00000001:00000010:3.0:1734256858.359625:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a9be2000. 00000001:00000010:3.0:1734256858.359631:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a9be4000. 00000001:00000010:3.0:1734256858.359635:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a9be6000. 00000001:00000010:3.0:1734256858.359643:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ab5f8000. 00000001:00000010:3.0:1734256858.359648:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ab5fa000. 00000001:00000010:3.0:1734256858.359652:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ab5fc000. 00000001:00000010:3.0:1734256858.359660:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ab5fe000. 00000001:00000010:3.0:1734256858.359668:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800aabc8000. 00000001:00000010:3.0:1734256858.359673:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800aabca000. 00010000:00000010:3.0:1734256858.359677:0:7477:0:(ldlm_resource.c:957:ldlm_namespace_new()) kmalloced '(ns->ns_rs_buckets)': 1408 at ffff88012b765000. 00000020:00000010:3.0:1734256858.359710:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b6fc0d00. 00000020:00000010:3.0:1734256858.359712:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 32 at ffff8800b63124c0. 00000020:00000010:3.0:1734256858.359744:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b6fc0b00. 00000020:00000010:3.0:1734256858.359746:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 352 at ffff8800b3717400. 00000100:00000010:3.0:1734256858.359755:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b240700. 00000100:00000010:3.0:1734256858.359758:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b240a80. 00000020:00000010:3.0:1734256858.359879:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b6fc0680. 00000020:00000010:3.0:1734256858.359881:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff8800b61ff000. 00000100:00000010:3.0:1734256858.359892:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b240e00. 00000100:00000010:3.0:1734256858.360032:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800a9380000. 00000100:00000010:3.0:1734256858.360035:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b241180. 00000100:00000010:3.0:1734256858.360175:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800ac600000. 00000100:00000010:3.0:1734256858.360179:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b241500. 00000100:00000010:3.0:1734256858.360309:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800a8f00000. 00000100:00000010:3.0:1734256858.360312:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b241880. 00000100:00000010:3.0:1734256858.360450:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800a8e80000. 00000100:00000010:3.0:1734256858.360453:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b241c00. 00000100:00000010:3.0:1734256858.360619:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800a9100000. 00000100:00000010:3.0:1734256858.361074:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b241f80. 00000100:00000010:3.0:1734256858.361215:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800a8d80000. 00000100:00000010:3.0:1734256858.361217:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b242300. 00000100:00000010:3.0:1734256858.361343:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800abd80000. 00000100:00000010:3.0:1734256858.361347:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b242680. 00000100:00000010:3.0:1734256858.361488:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800abc80000. 00000100:00000010:3.0:1734256858.361491:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b242a00. 00000100:00000010:3.0:1734256858.361662:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800a8980000. 00000100:00000010:3.0:1734256858.361665:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b242d80. 00000100:00000010:3.0:1734256858.361798:0:7477:0:(client.c:636:ptlrpc_add_rqs_to_pool()) kmalloced '(msg)': 524288 at ffff8800a9200000. 00000020:00000010:3.0:1734256858.361803:0:7477:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800b3716000. 00000020:00000010:3.0:1734256858.361806:0:7477:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.361808:0:7477:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.361812:0:7477:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff8800a886d900. 00008000:00000010:3.0:1734256858.361815:0:7477:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.361819:0:7477:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.361822:0:7477:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a9bd0920. 00000020:00000010:3.0:1734256858.361824:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800b3716200. 00000020:00000010:3.0:1734256858.361828:0:7477:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 128 at ffff8800b6fc0d80. 00000020:00000010:3.0:1734256858.361832:0:7477:0:(tgt_main.c:767:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff88012c101000. 00000008:00000010:3.0:1734256858.361835:0:7477:0:(osc_dev.c:125:osc_session_fini()) slab-freed '(info)': 352 at ffff8800a887a2c0. 00020000:00000010:3.0:1734256858.361837:0:7477:0:(lov_dev.c:137:lov_session_key_fini()) slab-freed '(info)': 576 at ffff8800a9908480. 00008000:00000010:3.0:1734256858.361839:0:7477:0:(echo_client.c:466:echo_session_key_fini()) slab-freed '(session)': 8 at ffff8801372b9f50. 00000080:00000010:3.0:1734256858.361841:0:7477:0:(vvp_dev.c:124:vvp_session_key_fini()) slab-freed '(session)': 240 at ffff8800ac5f71e0. 00000020:00000010:3.0:1734256858.361842:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800b3716400. 00000020:00000010:3.0:1734256858.361846:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff8800a886d0c0. 00000020:00000010:3.0:1734256858.361848:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.361854:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.361857:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 120 at ffff8800b6fc0d80. 00000020:00000010:3.0:1734256858.361862:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b6d33400. 00000020:00000010:3.0:1734256858.361864:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b6d33200. 00000020:00000010:3.0:1734256858.361866:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.361868:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.361870:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800a9310d80. 00008000:00000010:3.0:1734256858.361871:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.361874:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.361878:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0920. 00020000:00000010:3.0:1734256858.361888:0:7477:0:(lov_obd.c:500:lov_add_target()) kmalloced '(newtgts)': 16 at ffff8800ab6e3910. 00020000:00000010:3.0:1734256858.361890:0:7477:0:(lov_obd.c:523:lov_add_target()) kmalloced '(tgt)': 376 at ffff8800b6d32600. 00020000:00000010:3.0:1734256858.361894:0:7477:0:(lov_dev.c:364:lov_expand_targets()) kmalloced '(newd)': 16 at ffff8800ab6e3e80. 00000020:00000010:3.0:1734256858.361896:0:7477:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800b6d33200. 00000020:00000010:3.0:1734256858.361897:0:7477:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.361899:0:7477:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.361901:0:7477:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff8800a9310d80. 00008000:00000010:3.0:1734256858.361902:0:7477:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.361904:0:7477:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.361905:0:7477:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a9bd0920. 00000020:00000010:3.0:1734256858.361906:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800b6d33400. 00000020:00000010:3.0:1734256858.361907:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 120 at ffff8800b6fc0d80. 00000020:00000010:3.0:1734256858.361908:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.361911:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361912:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361914:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361915:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361917:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361918:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361919:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361920:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361921:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361922:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b37aeb00. 00000020:00000010:3.0:1734256858.361923:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 64 at ffff88012d6b6cc0. 00000100:00000010:3.0:1734256858.361924:0:7477:0:(lustre_peer.c:89:class_add_uuid()) kmalloced '(data)': 704 at ffff88012a5c9800. 00000400:00000200:3.0:1734256858.361931:0:7477:0:(peer.c:1757:lnet_peer_add()) peer 192.168.202.108@tcp NID flags 0x100001: -17 00000100:00000010:3.0:1734256858.361933:0:7477:0:(lustre_peer.c:124:class_add_uuid()) kfreed 'data': 704 at ffff88012a5c9800. 00000020:00000010:3.0:1734256858.361934:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 64 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.361935:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.361937:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff8800a9310d80. 00000020:00000010:3.0:1734256858.361941:0:7477:0:(genops.c:70:obd_device_alloc()) slab-alloced 'obd': 5488 at ffff880136bfd5c0. 00000020:00000010:3.0:1734256858.361947:0:7477:0:(genops.c:973:__class_new_export()) kmalloced '(export)': 1176 at ffff88012b765800. 00000020:00000010:3.0:1734256858.361953:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff8800a9310d80. 00000020:00000010:3.0:1734256858.361955:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.361956:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.361957:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff8800a9310d80. 00000001:00000010:3.0:1734256858.361969:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800a9310840. 00000001:00000010:3.0:1734256858.361971:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b63123c0. 00000001:00000010:3.0:1734256858.361972:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b6d33400. 00000001:00000010:3.0:1734256858.361973:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b6d33200. 00000001:00000010:3.0:1734256858.361974:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b6d33600. 00000001:00000010:3.0:1734256858.361976:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3716400. 00000001:00000010:3.0:1734256858.361977:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 184 at ffff8800a9310300. 00000001:00000010:3.0:1734256858.361978:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff8800b63125e0. 00000001:00000010:3.0:1734256858.361979:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3716200. 00000001:00000010:3.0:1734256858.361980:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff8800b3716000. 00000001:00000010:3.0:1734256858.361981:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff88012a5b2a00. 00000001:00000010:3.0:1734256858.361982:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 328 at ffff88012a5b3600. 00000020:00000010:3.0:1734256858.361983:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff88012a5b2600. 00000020:00000010:3.0:1734256858.361985:0:7477:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff8800b6fc0d80. 00000020:00000010:3.0:1734256858.361986:0:7477:0:(tgt_main.c:755:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff88012c101000. 00000008:00000010:3.0:1734256858.361987:0:7477:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a887a2c0. 00020000:00000010:3.0:1734256858.361989:0:7477:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800a9908480. 00008000:00000010:3.0:1734256858.361990:0:7477:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff8801372b9f50. 00000080:00000010:3.0:1734256858.361991:0:7477:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800ac5f71e0. 00000020:00000010:3.0:1734256858.361992:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff88012a5b3a00. 00000020:00000010:3.0:1734256858.361993:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff88012a5b3800. 00000020:00000010:3.0:1734256858.361994:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.361995:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.361996:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800a9310900. 00008000:00000010:3.0:1734256858.361997:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.361998:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.361998:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0920. 00000008:00000010:3.0:1734256858.362002:0:7477:0:(osc_dev.c:186:osc_device_alloc()) kmalloced '(osc)': 104 at ffff8800b6fc0380. 00000020:00000010:3.0:1734256858.362009:0:7477:0:(genops.c:1192:class_new_import()) kmalloced '(imp)': 1680 at ffff88012b766000. 00000100:00000200:3.0:1734256858.362018:0:7477:0:(events.c:572:ptlrpc_uuid_to_peer()) 192.168.202.108@tcp->12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256858.362021:0:7477:0:(peer.c:1500:LNetPrimaryNID()) NID 192.168.202.108@tcp primary NID 192.168.202.108@tcp rc 0 00010000:00000010:3.0:1734256858.362024:0:7477:0:(ldlm_lib.c:69:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff8800b3695000. 00010000:00000010:3.0:1734256858.362026:0:7477:0:(ldlm_resource.c:935:ldlm_namespace_new()) kmalloced '(ns)': 760 at ffff8800b5805000. 00000001:00000010:3.0:1734256858.362027:0:7477:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff8800b37aeb00. 00000001:00000010:3.0:1734256858.362029:0:7477:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 128 at ffff8800b6fc0400. 00000001:00000010:3.0:1734256858.362031:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800aabcc000. 00000001:00000010:3.0:1734256858.362035:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800aabce000. 00000001:00000010:3.0:1734256858.362042:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800aabd8000. 00000001:00000010:3.0:1734256858.362046:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800aabda000. 00000001:00000010:3.0:1734256858.362048:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800aabdc000. 00000001:00000010:3.0:1734256858.362052:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800aabde000. 00000001:00000010:3.0:1734256858.362057:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ab428000. 00000001:00000010:3.0:1734256858.362061:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ab42a000. 00000001:00000010:3.0:1734256858.362064:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ab42c000. 00000001:00000010:3.0:1734256858.362067:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800ab42e000. 00000001:00000010:3.0:1734256858.362073:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a8c10000. 00000001:00000010:3.0:1734256858.362078:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a8c12000. 00000001:00000010:3.0:1734256858.362082:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a8c14000. 00000001:00000010:3.0:1734256858.362086:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a8c16000. 00000001:00000010:3.0:1734256858.362094:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a9d18000. 00000001:00000010:3.0:1734256858.362098:0:7477:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4168 at ffff8800a9d1a000. 00010000:00000010:3.0:1734256858.362102:0:7477:0:(ldlm_resource.c:957:ldlm_namespace_new()) kmalloced '(ns->ns_rs_buckets)': 1408 at ffff88012b766800. 00000020:00000010:3.0:1734256858.362137:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800b4156080. 00000020:00000010:3.0:1734256858.362139:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 32 at ffff8800b6312460. 00000020:00000010:3.0:1734256858.362175:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800ac753400. 00000020:00000010:3.0:1734256858.362177:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 352 at ffff88012a5b3c00. 00000100:00000010:3.0:1734256858.362187:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243100. 00000100:00000010:3.0:1734256858.362189:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243480. 00000020:00000010:3.0:1734256858.362300:0:7477:0:(lprocfs_status.c:1259:lprocfs_stats_alloc()) alloc '(stats)': 104 at ffff8800ac753200. 00000020:00000010:3.0:1734256858.362302:0:7477:0:(lprocfs_status.c:1272:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff8800b61fe000. 00000020:00000010:3.0:1734256858.362313:0:7477:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff88012a5b3800. 00000020:00000010:3.0:1734256858.362315:0:7477:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.362317:0:7477:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.362318:0:7477:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff8800a9310900. 00008000:00000010:3.0:1734256858.362320:0:7477:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.362322:0:7477:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.362323:0:7477:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a9bd0920. 00000020:00000010:3.0:1734256858.362325:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff88012a5b3a00. 00000020:00000010:3.0:1734256858.362327:0:7477:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 128 at ffff8800b6fc0d80. 00000020:00000010:3.0:1734256858.362329:0:7477:0:(tgt_main.c:767:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff88012c101000. 00000008:00000010:3.0:1734256858.362330:0:7477:0:(osc_dev.c:125:osc_session_fini()) slab-freed '(info)': 352 at ffff8800a887a2c0. 00020000:00000010:3.0:1734256858.362331:0:7477:0:(lov_dev.c:137:lov_session_key_fini()) slab-freed '(info)': 576 at ffff8800a9908480. 00008000:00000010:3.0:1734256858.362333:0:7477:0:(echo_client.c:466:echo_session_key_fini()) slab-freed '(session)': 8 at ffff8801372b9f50. 00000080:00000010:3.0:1734256858.362334:0:7477:0:(vvp_dev.c:124:vvp_session_key_fini()) slab-freed '(session)': 240 at ffff8800ac5f71e0. 00000020:00000010:3.0:1734256858.362336:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff88012a5b2600. 00000020:00000010:3.0:1734256858.362338:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff8800a9310d80. 00000020:00000010:3.0:1734256858.362339:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.362342:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.362344:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 120 at ffff8800ac753180. 00000020:00000010:3.0:1734256858.362347:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff88012a5b2600. 00000020:00000010:3.0:1734256858.362349:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff88012a5b3a00. 00000020:00000010:3.0:1734256858.362350:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.362351:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.362353:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff88012d6adb40. 00008000:00000010:3.0:1734256858.362354:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.362356:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.362357:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0920. 00020000:00000010:3.0:1734256858.362361:0:7477:0:(lov_obd.c:523:lov_add_target()) kmalloced '(tgt)': 376 at ffff88012a5b3800. 00000020:00000010:3.0:1734256858.362364:0:7477:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff88012a5b3a00. 00000020:00000010:3.0:1734256858.362365:0:7477:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b3695de0. 00000008:00000010:3.0:1734256858.362371:0:7477:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.362373:0:7477:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff88012d6adb40. 00008000:00000010:3.0:1734256858.362375:0:7477:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.362376:0:7477:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.362378:0:7477:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a9bd0920. 00000020:00000010:3.0:1734256858.362379:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff88012a5b2600. 00000020:00000010:3.0:1734256858.362381:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 120 at ffff8800ac753180. 00000020:00000010:3.0:1734256858.362382:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.362386:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b6e1bb00. 00000020:00000010:3.0:1734256858.362387:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b6e1bb00. 00000020:00000010:3.0:1734256858.362389:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b6e1bb00. 00000020:00000010:3.0:1734256858.362390:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b6e1bb00. 00000020:00000010:3.0:1734256858.362393:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b6e1bb00. 00000020:00000010:3.0:1734256858.362394:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b6e1bb00. 00000100:00000010:3.0:1734256858.362400:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734256858.362408:0:7477:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff88012a5b2600. 00000100:00000010:3.0:1734256858.362418:0:7477:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff88012d6adb40. 02000000:00000010:3.0:1734256858.362438:0:7477:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff8800b60f4000. 00000400:00000010:3.0:1734256858.362443:0:7477:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256858.362447:0:7477:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 184 at ffff88012d6ad3c0. 00000100:00000200:3.0:1734256858.362451:0:7477:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1818500098163712, portal 25 00000400:00000010:3.0:1734256858.362454:0:7477:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734256858.362455:0:7477:0:(niobuf.c:87:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1818500098163712, offset 0 00000400:00000200:3.0:1734256858.362459:0:7477:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256858.362465:0:7477:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256858.362469:0:7477:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256858.362471:0:7477:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256858.362473:0:7477:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256858.362474:0:7477:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256858.362476:0:7477:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [11:11:256:4294967295] 192.168.202.108@tcp LPNI seq info [11:11:8:4294967295] 00000400:00000200:3.0:1734256858.362481:0:7477:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256858.362488:0:7477:0:(socklnd_cb.c:1000:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256858.362490:0:7477:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b6e1bb00. 00000800:00000200:3.0:1734256858.362494:0:7477:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256858.362498:0:7477:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256858.362500:0:7477:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b6e1bb00 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:0.0:1734256858.362626:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.362629:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b6e1bb00. 00000400:00000200:0.0:1734256858.362632:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.362636:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.362639:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734256858.362645:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734256858.362651:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098163712/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.364039:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.364050:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 8472 into portal 25 MB=0x675ea8c600400 00000400:00000200:0.0:1734256858.364055:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 8472/8472 into md 0x151 [4] + 224 00000400:00000200:0.0:1734256858.364077:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.364081:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.364086:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098163712/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256858.364201:0:7477:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256858.364204:0:7477:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff88012d6ad3c0 00000400:00000010:3.0:1734256858.364206:0:7477:0:(lib-lnet.h:300:lnet_md_free()) kfreed 'md': 184 at ffff88012d6ad3c0. 00000100:00000200:3.0:1734256858.364211:0:7477:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098163712/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256858.364218:0:7477:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098163712/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:3.0:1734256858.364238:0:7477:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff88012d6adb40. 02000000:00000010:3.0:1734256858.364246:0:7477:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff8800b60f4000. 02000000:00000010:3.0:1734256858.364254:0:7477:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff88012a5b2600. 00000100:00000010:3.0:1734256858.364257:0:7477:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000020:00000010:3.0:1734256858.364267:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b6e1b500. 00000020:00000010:3.0:1734256858.364269:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b6e1b500. 00000020:00000010:3.0:1734256858.364272:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.364275:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 96 at ffff8800b3695de0. 00000020:00000010:3.0:1734256858.364280:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff88012a5b2600. 00000020:00000010:3.0:1734256858.364283:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff88012a5b3a00. 00000020:00000010:3.0:1734256858.364284:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b3695b40. 00000008:00000010:3.0:1734256858.364287:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.364290:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff88012d6adb40. 00008000:00000010:3.0:1734256858.364292:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.364296:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.364298:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0920. 00000100:02000400:3.0:1734256858.364304:0:7477:0:(recover.c:255:ptlrpc_set_import_active()) setting import lustre-OST0000_UUID INACTIVE by administrator request 00000020:00000010:3.0:1734256858.367167:0:7477:0:(cl_object.c:655:cl_env_new()) slab-alloced 'cle': 144 at ffff8800b614a2d0. 00000020:00000010:3.0:1734256858.367184:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff88012a5b2800. 00000020:00000010:3.0:1734256858.367188:0:7477:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b60e5e00. 00000020:00000010:3.0:1734256858.367191:0:7477:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b36952a0. 00000008:00000010:3.0:1734256858.367196:0:7477:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984c2f0. 00020000:00000010:3.0:1734256858.367198:0:7477:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff88012d6ad3c0. 00008000:00000010:3.0:1734256858.367201:0:7477:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d91530. 00000080:00000010:3.0:1734256858.367205:0:7477:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f53f0. 00000080:00000010:3.0:1734256858.367208:0:7477:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0db0. 00000020:00000010:3.0:1734256858.367210:0:7477:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b60e4800. 00000008:00000010:3.0:1734256858.367213:0:7477:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a887a2c0. 00020000:00000010:3.0:1734256858.367215:0:7477:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800a9908480. 00008000:00000010:3.0:1734256858.367218:0:7477:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff8801372b9f50. 00000080:00000010:3.0:1734256858.367220:0:7477:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800ac5f71e0. 00000020:00000010:3.0:1734256858.367293:0:7477:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff88012a5b3a00. 00000020:00000010:3.0:1734256858.367297:0:7477:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b3695b40. 00000008:00000010:3.0:1734256858.367300:0:7477:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.367303:0:7477:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff88012d6adb40. 00008000:00000010:3.0:1734256858.367306:0:7477:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800a9d90e20. 00000080:00000010:3.0:1734256858.367309:0:7477:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800ac5f52a0. 00000080:00000010:3.0:1734256858.367311:0:7477:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a9bd0920. 00000020:00000010:3.0:1734256858.367313:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff88012a5b2600. 00000020:00000010:3.0:1734256858.367316:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 96 at ffff8800b3695de0. 00000020:00000010:3.0:1734256858.367318:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.367326:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b6e1b500. 00000020:00000010:3.0:1734256858.367328:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b6e1b500. 00000020:00000010:3.0:1734256858.367333:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b6e1b500. 00000020:00000010:3.0:1734256858.367334:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b6e1b500. 00000020:00000010:3.0:1734256858.367336:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 56 at ffff88012d6b6cc0. 00000100:00000010:3.0:1734256858.367339:0:7477:0:(lustre_peer.c:89:class_add_uuid()) kmalloced '(data)': 704 at ffff8800b5804800. 00000400:00000010:3.0:1734256858.367347:0:7477:0:(peer.c:231:lnet_peer_alloc()) alloc '(lp)': 376 at ffff8800b60e5400. 00000400:00000200:3.0:1734256858.367353:0:7477:0:(peer.c:271:lnet_peer_alloc()) ffff8800b60e5400 nid 1.2.3.4@tcp 00000400:00000010:3.0:1734256858.367355:0:7477:0:(peer.c:195:lnet_peer_net_alloc()) alloc '(lpn)': 72 at ffff8800b3695de0. 00000400:00000200:3.0:1734256858.367367:0:7477:0:(peer.c:204:lnet_peer_net_alloc()) ffff8800b3695de0 net tcp 00000400:00000010:3.0:1734256858.367370:0:7477:0:(peer.c:139:lnet_peer_ni_alloc()) alloc '(lpni)': 384 at ffff8800b60e4c00. 00000400:00000200:3.0:1734256858.367372:0:7477:0:(peer.c:185:lnet_peer_ni_alloc()) ffff8800b60e4c00 nid 1.2.3.4@tcp 00000400:00000200:3.0:1734256858.367376:0:7477:0:(peer.c:1100:lnet_peer_ni_clr_non_mr_pref_nid()) peer 1.2.3.4@tcp: -2 00000400:00000200:3.0:1734256858.367379:0:7477:0:(peer.c:1659:lnet_peer_attach_peer_ni()) peer 1.2.3.4@tcp NID 1.2.3.4@tcp flags 0x100001 00000400:00000200:3.0:1734256858.367403:0:7477:0:(peer.c:2425:lnet_peer_queue_for_discovery()) Queue peer 1.2.3.4@tcp: 0 00000400:00000200:3.0:1734256858.367405:0:7477:0:(peer.c:2747:lnet_discover_peer_locked()) Discovery attempt # 1 00000400:00000200:3.0:1734256858.367406:0:7477:0:(peer.c:2787:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:3.0:1734256858.367407:0:7477:0:(peer.c:2796:lnet_discover_peer_locked()) peer 1.2.3.4@tcp NID 1.2.3.4@tcp: 0. pending discovery 00000020:00000010:3.0:1734256858.367409:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 56 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.367412:0:7477:0:(obd_config.c:1927:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.367414:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 96 at ffff8800b3695b40. 00000100:00000200:3.0:1734256858.367424:0:7477:0:(events.c:572:ptlrpc_uuid_to_peer()) 1.2.3.4@tcp->12345-1.2.3.4@tcp 00000400:00000200:3.0:1734256858.367427:0:7477:0:(peer.c:2425:lnet_peer_queue_for_discovery()) Queue peer 1.2.3.4@tcp: -114 00000400:00000200:3.0:1734256858.367427:0:7477:0:(peer.c:2747:lnet_discover_peer_locked()) Discovery attempt # 1 00000400:00000200:3.0:1734256858.367428:0:7477:0:(peer.c:2787:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:3.0:1734256858.367429:0:7477:0:(peer.c:2796:lnet_discover_peer_locked()) peer 1.2.3.4@tcp NID 1.2.3.4@tcp: 0. pending discovery 00000400:00000200:3.0:1734256858.367431:0:7477:0:(peer.c:1500:LNetPrimaryNID()) NID 1.2.3.4@tcp primary NID 1.2.3.4@tcp rc 0 00000100:00000010:3.0:1734256858.367433:0:7477:0:(connection.c:93:ptlrpc_connection_get()) kmalloced '(conn)': 96 at ffff8800b3695a80. 00010000:00000010:3.0:1734256858.367435:0:7477:0:(ldlm_lib.c:69:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff8800b36954e0. 00000400:00000200:0.0:1734256858.367437:0:6036:0:(peer.c:4014:lnet_peer_discovery_wait_for_work()) woken: 0 00000020:00000010:3.0:1734256858.367437:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 96 at ffff8800b3695b40. 00000020:00000010:3.0:1734256858.367438:0:7477:0:(obd_config.c:2019:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.367439:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b6e1b500. 00000020:00000010:3.0:1734256858.367440:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b6e1b500. 00000020:00000010:3.0:1734256858.367441:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b6e1b500. 00000400:00000200:0.0:1734256858.367442:0:6036:0:(peer.c:4126:lnet_peer_discovery()) peer 1.2.3.4@tcp(ffff8800b60e5400) state 0x100041 00000020:00000010:3.0:1734256858.367442:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b6e1b500. 00000020:00000010:3.0:1734256858.367443:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 56 at ffff88012d6b6cc0. 00000020:00000010:3.0:1734256858.367444:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 56 at ffff88012d6b6cc0. 00000400:00000010:0.0:1734256858.367446:0:6036:0:(api-ni.c:1785:lnet_ping_buffer_alloc()) alloc '(pbuf)': 281 at ffff8800a9c3b400. 00000100:00000010:3.0:1734256858.367450:0:7477:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 00000400:00000010:0.0:1734256858.367451:0:6036:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000400:00000010:0.0:1734256858.367457:0:6036:0:(lib-lnet.h:469:lnet_rspt_alloc()) alloc 'rspt': 56 at ffff8800ab6681f8. 02000000:00000010:3.0:1734256858.367457:0:7477:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800b60e5a00. 00000400:00000200:0.0:1734256858.367460:0:6036:0:(lib-move.c:5498:LNetGet()) LNetGet -> 12345-1.2.3.4@tcp 00000100:00000010:3.0:1734256858.367463:0:7477:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff88012d6adb40. 00000400:00000200:0.0:1734256858.367469:0:6036:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 1.2.3.4@tcp local destination 00000400:00000200:0.0:1734256858.367472:0:6036:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256858.367475:0:6036:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256858.367477:0:6036:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256858.367479:0:6036:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 1.2.3.4@tcp 02000000:00000010:3.0:1734256858.367481:0:7477:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff8800b60f4000. 00000400:00000200:0.0:1734256858.367482:0:6036:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [12:12:256:4294967295] 1.2.3.4@tcp LPNI seq info [1:1:8:4294967295] 00000400:00000200:0.0:1734256858.367485:0:6036:0:(lib-move.c:1973:lnet_handle_send()) rspt_next_hop_nid = 1.2.3.4@tcp 00000400:00000010:3.0:1734256858.367485:0:7477:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:0.0:1734256858.367489:0:6036:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 1.2.3.4@tcp(1.2.3.4@tcp:1.2.3.4@tcp) : GET try# 0 00000400:00000010:3.0:1734256858.367490:0:7477:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 184 at ffff88012d6adf00. 00000800:00000200:0.0:1734256858.367493:0:6036:0:(socklnd_cb.c:1000:ksocknal_send()) sending 0 bytes in 0 frags to 12345-1.2.3.4@tcp 00000100:00000200:3.0:1734256858.367493:0:7477:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1818500098163840, portal 25 00000800:00000010:0.0:1734256858.367495:0:6036:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 232 at ffff8800b34d4100. 00000400:00000010:3.0:1734256858.367495:0:7477:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734256858.367496:0:7477:0:(niobuf.c:87:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1818500098163840, offset 0 00000400:00000200:3.0:1734256858.367500:0:7477:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256858.367502:0:6036:0:(socklnd.c:156:ksocknal_create_peer()) alloc '(peer_ni)': 184 at ffff8800aa83ea80. 00000800:00000010:0.0:1734256858.367504:0:6036:0:(socklnd.c:105:ksocknal_create_conn_cb()) alloc '(conn_cb)': 192 at ffff8800aa83e240. 00000400:00000200:3.0:1734256858.367504:0:7477:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256858.367505:0:7477:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256858.367507:0:7477:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:0.0:1734256858.367508:0:6036:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800aa83ea80] -> 12345-1.2.3.4@tcp (2) 00000400:00000200:3.0:1734256858.367508:0:7477:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256858.367509:0:7477:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256858.367511:0:7477:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [13:13:255:4294967295] 192.168.202.108@tcp LPNI seq info [12:12:8:4294967295] 00000800:00000200:0.1:1734256858.367511:0:6036:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800aa83ea80] -> 12345-1.2.3.4@tcp (2) 00000400:00000200:3.0:1734256858.367515:0:7477:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256858.367517:0:7477:0:(socklnd_cb.c:1000:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256858.367518:0:7477:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b6e1b500. 00000400:00000200:0.0:1734256858.367552:0:6036:0:(peer.c:3814:lnet_peer_send_ping()) peer 1.2.3.4@tcp 00000800:00000200:3.0:1734256858.367552:0:7477:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734256858.367554:0:6036:0:(peer.c:4148:lnet_peer_discovery()) peer 1.2.3.4@tcp(ffff8800b60e5400) state 0x100241 rc 0 00000800:00000200:3.0:1734256858.367556:0:7477:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256858.367558:0:7477:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b6e1b500 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:0.0:1734256858.367916:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.367919:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b6e1b500. 00000400:00000200:0.0:1734256858.367921:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.367925:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.367928:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734256858.367930:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734256858.367935:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098163840/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.369276:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.369286:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 8472 into portal 25 MB=0x675ea8c600480 00000400:00000200:0.0:1734256858.369292:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 8472/8472 into md 0x15d [4] + 224 00000400:00000200:0.0:1734256858.369313:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.369317:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.369323:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098163840/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256858.369388:0:7477:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256858.369391:0:7477:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff88012d6adf00 00000400:00000010:3.0:1734256858.369393:0:7477:0:(lib-lnet.h:300:lnet_md_free()) kfreed 'md': 184 at ffff88012d6adf00. 00000100:00000200:3.0:1734256858.369397:0:7477:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098163840/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256858.369403:0:7477:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098163840/t0(0) o502->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8472 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:3.0:1734256858.369419:0:7477:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff88012d6adb40. 02000000:00000010:3.0:1734256858.369425:0:7477:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff8800b60f4000. 02000000:00000010:3.0:1734256858.369434:0:7477:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800b60e5a00. 00000100:00000010:3.0:1734256858.369439:0:7477:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000020:00000010:3.0:1734256858.369447:0:7477:0:(obd_config.c:1988:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff8800b6e1bd00. 00000020:00000010:3.0:1734256858.369450:0:7477:0:(obd_config.c:2017:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff8800b6e1bd00. 00000040:00000010:3.0:1734256858.369457:0:7477:0:(llog.c:829:llog_process_thread()) kfreed 'buf': 8192 at ffff8800ac462000. 00000020:00000010:3.0:1734256858.369462:0:7477:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800b6fb6000. 00000040:00000010:3.0:1734256858.369467:0:7477:0:(llog_obd.c:233:llog_key_fini()) kfreed 'info': 480 at ffff8800b6fb6400. 00000020:00000010:3.0:1734256858.369470:0:7477:0:(dt_object.c:53:dt_global_key_fini()) kfreed 'info': 1256 at ffff88013767c800. 00000020:00000010:3.0:1734256858.369475:0:7477:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff8800aabb3e00. 80000000:00000010:3.0:1734256858.369478:0:7477:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff8800b35f12a0. 00040000:00000010:3.0:1734256858.369481:0:7477:0:(lquota_lib.c:35:lquota_key_fini()) kfreed 'info': 240 at ffff8800b37aec00. 00040000:00000010:3.0:1734256858.369485:0:7477:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff8800aabb3c00. 20000000:00000010:3.0:1734256858.369488:0:7477:0:(mgs_handler.c:1475:mgs_key_fini()) kfreed 'info': 392 at ffff8800aabb3a00. 00000020:00000010:3.0:1734256858.369490:0:7477:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800b6fb6200. 00000040:00000010:2.0:1734256858.369531:0:7464:0:(llog.c:927:llog_process_or_fork()) kfreed 'lpi': 104 at ffff8800a9ca4c00. 00000040:00000010:2.0:1734256858.369538:0:7464:0:(llog.c:90:llog_free_handle()) kfreed 'loghandle->lgh_hdr': 8192 at ffff88012b902000. 00000040:00000010:2.0:1734256858.369555:0:7464:0:(llog.c:92:llog_free_handle()) kfreed 'loghandle': 360 at ffff8800aa9bc400. 00000020:00000010:2.0:1734256858.369559:0:7464:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800aa9bd200. 00000040:00000010:2.0:1734256858.369561:0:7464:0:(llog_obd.c:233:llog_key_fini()) kfreed 'info': 480 at ffff8800aa9bd400. 00000020:00000010:2.0:1734256858.369563:0:7464:0:(dt_object.c:53:dt_global_key_fini()) kfreed 'info': 1256 at ffff880136994000. 00000020:00000010:2.0:1734256858.369593:0:7464:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff8800aa9bca00. 80000000:00000010:2.0:1734256858.369596:0:7464:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff8800b58f49c0. 00040000:00000010:2.0:1734256858.369599:0:7464:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff8800aa9bc800. 20000000:00000010:2.0:1734256858.369601:0:7464:0:(mgs_handler.c:1475:mgs_key_fini()) kfreed 'info': 392 at ffff8800aa9bc600. 00000020:00000010:2.0:1734256858.369603:0:7464:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800aa9bd000. 10000000:00000010:2.0:1734256858.369605:0:7464:0:(mgc_request.c:1694:mgc_process_cfg_log()) kfreed 'env': 56 at ffff8800b6e32900. 00000100:00000010:2.0:1734256858.369630:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.369642:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bd000. 00010000:00000010:2.0:1734256858.369650:0:7464:0:(ldlm_resource.c:1455:ldlm_resource_new()) slab-alloced 'res': 256 at ffff8800b404ca00. 00010000:00000010:2.0:1734256858.369654:0:7464:0:(ldlm_lock.c:435:ldlm_lock_new()) slab-alloced 'lock': 552 at ffff880130908480. 00000100:00000010:2.0:1734256858.369664:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.369673:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa31c00. 00000400:00000010:2.0:1734256858.369676:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c790. 00000400:00000010:2.0:1734256858.369679:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734256858.369682:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098163968, portal 25 00000400:00000010:2.0:1734256858.369685:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734256858.369686:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1818500098163968, offset 0 00000400:00000200:2.0:1734256858.369691:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.369697:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.369700:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.369702:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.369704:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.369705:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.369707:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [14:14:255:4294967295] 192.168.202.108@tcp LPNI seq info [13:13:8:4294967295] 00000400:00000200:2.0:1734256858.369711:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256858.369713:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 328 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.369716:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734256858.369718:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256858.369722:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256858.369723:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 424 niov 1 nkiov 1 00000800:00000200:0.0:1734256858.369810:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.369813:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734256858.369815:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.369819:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.369821:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734256858.369822:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734256858.369826:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098163968/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.370758:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.370764:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 344 into portal 25 MB=0x675ea8c600500 00000400:00000200:0.0:1734256858.370767:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 344/344 into md 0x165 [1] + 224 00000400:00000200:0.0:1734256858.370775:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.370777:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.370780:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098163968/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.370832:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c790. 00000400:00000200:2.0:1734256858.370835:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:2.0:1734256858.370836:0:7464:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734256858.370840:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098163968/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.370847:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098163968/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.370856:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.370871:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa31c00. 02000000:00000010:2.0:1734256858.370875:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bd000. 00000100:00000010:2.0:1734256858.370877:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 10000000:00000010:2.0:1734256858.370881:0:7464:0:(mgc_request.c:1500:mgc_process_recover_log()) kmalloced '(pages)': 2048 at ffff880136994000. 00000100:00000010:2.0:1734256858.371280:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.371286:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bd000. 00000100:00000010:2.0:1734256858.371291:0:7464:0:(client.c:177:ptlrpc_new_bulk()) kmalloced '(desc)': 992 at ffff88012aa31c00. 00000100:00000010:2.0:1734256858.371294:0:7464:0:(client.c:182:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 4096 at ffff8800aab57000. 00000100:00000010:2.0:1734256858.371305:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 00000400:00000010:2.0:1734256858.371313:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c790. 00000400:00000010:2.0:1734256858.371317:0:7464:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 4216 at ffff88012b902000. 00000100:00000200:2.0:1734256858.371321:0:7464:0:(niobuf.c:432:ptlrpc_register_bulk()) Setup 1 bulk put-sink buffers: 256 pages 1048576 bytes, mbits x0x675ea8c600580-0x675ea8c600580, portal 33 02000000:00000010:2.0:1734256858.371324:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734256858.371326:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000010:2.0:1734256858.371328:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734256858.371330:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098164096, portal 25 00000400:00000010:2.0:1734256858.371332:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734256858.371333:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 304 bytes to portal 26, xid 1818500098164096, offset 0 00000400:00000200:2.0:1734256858.371337:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.371342:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.371344:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.371346:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.371349:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.371350:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.371352:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [15:15:255:4294967295] 192.168.202.108@tcp LPNI seq info [14:14:8:4294967295] 00000400:00000200:2.0:1734256858.371357:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256858.371361:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 304 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.371364:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734256858.371366:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256858.371371:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256858.371373:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 400 niov 1 nkiov 1 00000800:00000200:0.0:1734256858.371463:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.371465:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734256858.371468:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.371471:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.371473:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734256858.371475:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734256858.371481:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098164096/t0(0) o256->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 304/240 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256858.372642:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.372650:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 88 into portal 33 MB=0x675ea8c600580 00000400:00000200:0.0:1734256858.372655:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 21 from 12345-192.168.202.108@tcp of length 88/88 into md 0x16d [256] + 0 00000400:00000010:0.0:1734256858.372657:0:6033:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c790. 00000400:00000200:0.0:1734256858.372659:0:6033:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md ffff88012b902000 00000400:00000200:0.0:1734256858.372669:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.372673:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.372675:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff88012b902000 00000400:00000010:0.0:1734256858.372676:0:6033:0:(lib-lnet.h:300:lnet_md_free()) kfreed 'md': 4216 at ffff88012b902000. 00000100:00000200:0.0:1734256858.372680:0:6033:0:(events.c:211:client_bulk_callback()) event type 2, status 0, desc ffff88012aa31c00 00000400:00000200:0.0:1734256858.372729:0:6033:0:(lib-md.c:96:lnet_cpt_of_md()) Couldn't resolve first page of md (null) with offset 0 00000400:00000200:0.0:1734256858.372733:0:6033:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source Specified: 192.168.202.8@tcp to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256858.372737:0:6033:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [16:16:255:4294967295] 192.168.202.108@tcp LPNI seq info [15:15:8:4294967295] 00000400:00000200:0.0:1734256858.372743:0:6033:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:192.168.202.8@tcp) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) 192.168.202.108@tcp : ACK try# 0 00000800:00000200:0.0:1734256858.372747:0:6033:0:(socklnd_cb.c:1000:ksocknal_send()) sending 0 bytes in 256 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256858.372750:0:6033:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 4328 at ffff8800ac586000. 00000800:00000200:0.0:1734256858.372753:0:6033:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256858.372757:0:6033:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256858.372758:0:6033:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800ac586000 type 0, nob 96 niov 1 nkiov 0 00000800:00000200:0.0:1734256858.372880:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.372887:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 4328 at ffff8800ac586000. 00000400:00000200:0.0:1734256858.372889:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.372892:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: ACK: OK 00000400:00000200:0.0:1734256858.373866:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.373872:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 240 into portal 25 MB=0x675ea8c600580 00000400:00000200:0.0:1734256858.373876:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 240/240 into md 0x171 [1] + 224 00000400:00000200:0.0:1734256858.373887:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.373890:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.373896:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098164096/t0(0) o256->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 304/240 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.374001:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:2.0:1734256858.374004:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:2.0:1734256858.374005:0:7464:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734256858.374010:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098164096/t0(0) o256->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 304/240 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.374016:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098164096/t0(0) o256->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 304/240 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.374030:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 10000000:00000010:2.0:1734256858.374039:0:7464:0:(mgc_request.c:1221:mgc_apply_recover_logs()) kmalloced '(buf)': 4096 at ffff8800aab53000. 00000100:00000200:2.0:1734256858.374050:0:7464:0:(lustre_peer.c:194:class_add_nids_to_uuid()) Comparing with 1.2.3.4@tcp 00000100:00000200:2.0:1734256858.374052:0:7464:0:(lustre_peer.c:194:class_add_nids_to_uuid()) Comparing with 192.168.202.108@tcp 00000100:00000200:2.0:1734256858.374053:0:7464:0:(lustre_peer.c:201:class_add_nids_to_uuid()) Updating UUID '' 00000400:00000200:2.0:1734256858.374058:0:7464:0:(peer.c:1757:lnet_peer_add()) peer 192.168.202.108@tcp NID flags 0x100001: -17 10000000:00000010:2.0:1734256858.374063:0:7464:0:(mgc_request.c:1434:mgc_apply_recover_logs()) kmalloced '(lcfg)': 128 at ffff8800a9ca4c00. 00000020:00000010:2.0:1734256858.374069:0:7464:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800aa9bc800. 00000020:00000010:2.0:1734256858.374073:0:7464:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800aa9bca00. 00000020:00000010:2.0:1734256858.374075:0:7464:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b58f49c0. 00000008:00000010:2.0:1734256858.374087:0:7464:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800ac440000. 00020000:00000010:2.0:1734256858.374091:0:7464:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b401f900. 00008000:00000010:2.0:1734256858.374099:0:7464:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800b60f4000. 00000080:00000010:2.0:1734256858.374107:0:7464:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800b35e4000. 00000080:00000010:2.0:1734256858.374114:0:7464:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a90c8000. 00000020:00000010:2.0:1734256858.374200:0:7464:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800aa9bca00. 00000020:00000010:2.0:1734256858.374203:0:7464:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b58f49c0. 00000008:00000010:2.0:1734256858.374206:0:7464:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800ac440000. 00020000:00000010:2.0:1734256858.374208:0:7464:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff8800b401f900. 00008000:00000010:2.0:1734256858.374210:0:7464:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800b60f4000. 00000080:00000010:2.0:1734256858.374213:0:7464:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800b35e4000. 00000080:00000010:2.0:1734256858.374215:0:7464:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a90c8000. 00000020:00000010:2.0:1734256858.374221:0:7464:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800aa9bc800. 10000000:00000010:2.0:1734256858.374223:0:7464:0:(mgc_request.c:1450:mgc_apply_recover_logs()) kfreed 'lcfg': 128 at ffff8800a9ca4c00. 00000100:00000200:2.0:1734256858.374230:0:7464:0:(lustre_peer.c:194:class_add_nids_to_uuid()) Comparing with 1.2.3.4@tcp 00000100:00000200:2.0:1734256858.374235:0:7464:0:(lustre_peer.c:194:class_add_nids_to_uuid()) Comparing with 192.168.202.108@tcp 00000100:00000200:2.0:1734256858.374236:0:7464:0:(lustre_peer.c:201:class_add_nids_to_uuid()) Updating UUID '' 00000400:00000200:2.0:1734256858.374240:0:7464:0:(peer.c:1757:lnet_peer_add()) peer 192.168.202.108@tcp NID flags 0x100001: -17 10000000:00000010:2.0:1734256858.374243:0:7464:0:(mgc_request.c:1434:mgc_apply_recover_logs()) kmalloced '(lcfg)': 128 at ffff8800a9ca4c00. 00000020:00000010:2.0:1734256858.374246:0:7464:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800aa9bc800. 00000020:00000010:2.0:1734256858.374247:0:7464:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800aa9bca00. 00000020:00000010:2.0:1734256858.374249:0:7464:0:(cl_object.c:1060:cl_key_init()) kmalloced '(value)': 72 at ffff8800b58f49c0. 00000008:00000010:2.0:1734256858.374250:0:7464:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800ac440000. 00020000:00000010:2.0:1734256858.374252:0:7464:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b401f900. 00008000:00000010:2.0:1734256858.374253:0:7464:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800b60f4000. 00000080:00000010:2.0:1734256858.374255:0:7464:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800b35e4000. 00000080:00000010:2.0:1734256858.374256:0:7464:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a90c8000. 00000020:00000010:2.0:1734256858.374272:0:7464:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800aa9bca00. 00000020:00000010:2.0:1734256858.374274:0:7464:0:(cl_object.c:1060:cl_key_fini()) kfreed 'info': 72 at ffff8800b58f49c0. 00000008:00000010:2.0:1734256858.374275:0:7464:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff8800ac440000. 00020000:00000010:2.0:1734256858.374277:0:7464:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff8800b401f900. 00008000:00000010:2.0:1734256858.374278:0:7464:0:(echo_client.c:441:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff8800b60f4000. 00000080:00000010:2.0:1734256858.374279:0:7464:0:(vvp_dev.c:99:ll_thread_key_fini()) slab-freed '(lti)': 168 at ffff8800b35e4000. 00000080:00000010:2.0:1734256858.374281:0:7464:0:(vvp_dev.c:149:vvp_thread_key_fini()) slab-freed '(vti)': 584 at ffff8800a90c8000. 00000020:00000010:2.0:1734256858.374283:0:7464:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800aa9bc800. 10000000:00000010:2.0:1734256858.374284:0:7464:0:(mgc_request.c:1450:mgc_apply_recover_logs()) kfreed 'lcfg': 128 at ffff8800a9ca4c00. 10000000:00000010:2.0:1734256858.374286:0:7464:0:(mgc_request.c:1462:mgc_apply_recover_logs()) kfreed 'buf': 4096 at ffff8800aab53000. 02000000:00000010:2.0:1734256858.374289:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 00000100:00000010:2.0:1734256858.374307:0:7464:0:(client.c:322:ptlrpc_free_bulk()) kfreed 'desc->bd_vec': 4096 at ffff8800aab57000. 00000100:00000010:2.0:1734256858.374309:0:7464:0:(client.c:323:ptlrpc_free_bulk()) kfreed 'desc': 992 at ffff88012aa31c00. 02000000:00000010:2.0:1734256858.374313:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bd000. 00000100:00000010:2.0:1734256858.374315:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 10000000:00000010:2.0:1734256858.374786:0:7464:0:(mgc_request.c:1618:mgc_process_recover_log()) kfreed 'pages': 2048 at ffff880136994000. 00000100:00000010:2.0:1734256858.374816:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.374825:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bd000. 00010000:00000010:2.0:1734256858.375284:0:7464:0:(ldlm_resource.c:1455:ldlm_resource_new()) slab-alloced 'res': 256 at ffff8800b404c900. 00010000:00000010:2.0:1734256858.375290:0:7464:0:(ldlm_lock.c:435:ldlm_lock_new()) slab-alloced 'lock': 552 at ffff8801309086c0. 00000100:00000010:2.0:1734256858.375302:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.375321:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa31c00. 00000400:00000010:2.0:1734256858.375325:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000010:2.0:1734256858.375329:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734256858.375334:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098164224, portal 25 00000400:00000010:2.0:1734256858.375336:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734256858.375338:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1818500098164224, offset 0 00000400:00000200:2.0:1734256858.375342:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.375349:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.375353:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.375356:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.375359:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.375362:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.375364:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [17:17:255:4294967295] 192.168.202.108@tcp LPNI seq info [16:16:8:4294967295] 00000400:00000200:2.0:1734256858.375371:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256858.375374:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 328 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.375377:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734256858.375381:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256858.375386:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256858.375389:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 424 niov 1 nkiov 1 00000800:00000200:0.0:1734256858.375483:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256858.375487:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734256858.375490:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.375493:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256858.375496:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734256858.375498:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734256858.375503:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098164224/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734256858.377091:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734256858.377103:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 344 into portal 25 MB=0x675ea8c600600 00000400:00000200:1.0:1734256858.377109:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 344/344 into md 0x179 [1] + 224 00000400:00000200:1.0:1734256858.377121:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.377123:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:1.0:1734256858.377130:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098164224/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.377204:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:2.0:1734256858.377208:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:2.0:1734256858.377210:0:7464:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734256858.377214:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098164224/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.377222:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098164224/t0(0) o101->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 328/344 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.377238:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.377252:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa31c00. 02000000:00000010:2.0:1734256858.377258:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bd000. 00000100:00000010:2.0:1734256858.377260:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 10000000:00000010:2.0:1734256858.377265:0:7464:0:(mgc_request.c:1646:mgc_process_cfg_log()) kmalloced '(env)': 56 at ffff8800b6e32900. 00000020:00000010:2.0:1734256858.377271:0:7464:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800aa9bd000. 00000020:00000010:2.0:1734256858.377274:0:7464:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800aa9bc600. 00000040:00000010:2.0:1734256858.377277:0:7464:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800aa9bc800. 00000020:00000010:2.0:1734256858.377280:0:7464:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff880136994000. 00000020:00000010:2.0:1734256858.377282:0:7464:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800aa9bca00. 80000000:00000010:2.0:1734256858.377285:0:7464:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b58f49c0. 00040000:00000010:2.0:1734256858.377289:0:7464:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800aa9bd400. 20000000:00000010:2.0:1734256858.377292:0:7464:0:(mgs_handler.c:1475:mgs_key_init()) kmalloced '(value)': 392 at ffff8800aa9bd200. 00000040:00000010:2.0:1734256858.377297:0:7464:0:(llog.c:62:llog_alloc_handle()) kmalloced '(loghandle)': 360 at ffff8800aa9bc400. 00000100:00000010:2.0:1734256858.377301:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.377309:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bc200. 00000100:00000010:2.0:1734256858.377316:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.377324:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734256858.377326:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000010:2.0:1734256858.377329:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734256858.377332:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098164352, portal 25 00000400:00000010:2.0:1734256858.377334:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734256858.377335:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 504 bytes to portal 26, xid 1818500098164352, offset 0 00000400:00000200:2.0:1734256858.377338:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.377343:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.377347:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.377349:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.377351:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.377352:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.377354:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [18:18:255:4294967295] 192.168.202.108@tcp LPNI seq info [17:17:8:4294967295] 00000400:00000200:2.0:1734256858.377360:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256858.377363:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 504 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.377366:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734256858.377369:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256858.377373:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256858.377375:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 600 niov 1 nkiov 1 00000800:00000200:1.0:1734256858.377474:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256858.377477:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734256858.377480:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.377483:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256858.377485:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:1.0:1734256858.377486:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:1.0:1734256858.377490:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098164352/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 504/272 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000020:00000010:3.0:1734256858.378954:0:7479:0:(lproc_ptlrpc.c:1388:ldebugfs_import_seq_write()) kmalloced '(kbuf)': 35 at ffff880130e09300. 00000020:00000010:3.0:1734256858.378962:0:7479:0:(lproc_ptlrpc.c:1440:ldebugfs_import_seq_write()) kfreed 'kbuf': 35 at ffff880130e09300. 00000400:00000200:1.0:1734256858.379176:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734256858.379184:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 272 into portal 25 MB=0x675ea8c600680 00000400:00000200:1.0:1734256858.379190:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 272/272 into md 0x181 [1] + 224 00000400:00000200:1.0:1734256858.379202:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.379205:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:1.0:1734256858.379211:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098164352/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 504/272 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.379254:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:2.0:1734256858.379258:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:2.0:1734256858.379259:0:7464:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734256858.379264:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098164352/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 504/272 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.379269:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098164352/t0(0) o501->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 504/272 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.379283:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.379289:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734256858.379292:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bc200. 00000100:00000010:2.0:1734256858.379294:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000040:00000010:2.0:1734256858.379300:0:7464:0:(llog.c:407:llog_init_handle()) kmalloced '(llh)': 8192 at ffff88012b904000. 00000100:00000010:2.0:1734256858.379303:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.379308:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff8800aa9bc200. 00000100:00000010:2.0:1734256858.379314:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.379330:0:7464:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff8800abfe0000. 00000400:00000010:2.0:1734256858.379333:0:7464:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000010:2.0:1734256858.379337:0:7464:0:(lib-md.c:136:lnet_md_build()) alloc '(lmd)': 184 at ffff8800b401fc00. 00000100:00000200:2.0:1734256858.379340:0:7464:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1818500098164480, portal 25 00000400:00000010:2.0:1734256858.379343:0:7464:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734256858.379344:0:7464:0:(niobuf.c:87:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1818500098164480, offset 0 00000400:00000200:2.0:1734256858.379348:0:7464:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256858.379353:0:7464:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256858.379356:0:7464:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256858.379359:0:7464:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256858.379361:0:7464:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256858.379362:0:7464:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256858.379364:0:7464:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [19:19:255:4294967295] 192.168.202.108@tcp LPNI seq info [18:18:8:4294967295] 00000400:00000200:2.0:1734256858.379371:0:7464:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256858.379374:0:7464:0:(socklnd_cb.c:1000:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256858.379377:0:7464:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404cb00. 00000800:00000200:2.0:1734256858.379385:0:7464:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256858.379389:0:7464:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256858.379391:0:7464:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404cb00 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:1.0:1734256858.379465:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256858.379468:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404cb00. 00000400:00000200:1.0:1734256858.379471:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.379474:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256858.379479:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:1.0:1734256858.379481:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:1.0:1734256858.379486:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098164480/t0(0) o503->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8416 e 0 to 0 dl 1734256874 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000020:00000010:0.0:1734256858.379874:0:7478:0:(lproc_ptlrpc.c:1388:ldebugfs_import_seq_write()) kmalloced '(kbuf)': 35 at ffff8800ab4aecc0. 00000020:00000010:0.0:1734256858.379878:0:7478:0:(lproc_ptlrpc.c:1440:ldebugfs_import_seq_write()) kfreed 'kbuf': 35 at ffff8800ab4aecc0. 00000400:00000200:0.0:1734256858.380770:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256858.380777:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 8416 into portal 25 MB=0x675ea8c600700 00000400:00000200:0.0:1734256858.380782:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 8416/8416 into md 0x189 [4] + 224 00000400:00000200:0.0:1734256858.380799:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256858.380802:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256858.380807:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098164480/t0(0) o503->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8416 e 0 to 0 dl 1734256874 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256858.380871:0:7464:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:2.0:1734256858.380875:0:7464:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b401fc00 00000400:00000010:2.0:1734256858.380877:0:7464:0:(lib-lnet.h:300:lnet_md_free()) kfreed 'md': 184 at ffff8800b401fc00. 00000100:00000200:2.0:1734256858.380881:0:7464:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098164480/t0(0) o503->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8416 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256858.380887:0:7464:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098164480/t0(0) o503->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 272/8416 e 0 to 0 dl 1734256874 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734256858.380900:0:7464:0:(ptlrpc_internal.h:334:ptlrpc_reqset_put()) kfreed 'set': 144 at ffff8800b401f900. 02000000:00000010:2.0:1734256858.380906:0:7464:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff8800abfe0000. 02000000:00000010:2.0:1734256858.380914:0:7464:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at ffff8800aa9bc200. 00000100:00000010:2.0:1734256858.380917:0:7464:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000040:00000010:2.0:1734256858.380922:0:7464:0:(llog.c:884:llog_process_or_fork()) kmalloced '(lpi)': 104 at ffff8800a9ca4c00. 00000020:00000010:3.0:1734256858.381546:0:7480:0:(lu_object.c:1678:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff8800b60e5600. 00000020:00000010:3.0:1734256858.381552:0:7480:0:(lu_object.c:538:lu_global_key_init()) kmalloced '(value)': 512 at ffff8800b60e4a00. 00000040:00000010:3.0:1734256858.381554:0:7480:0:(llog_obd.c:233:llog_key_init()) kmalloced '(value)': 480 at ffff8800b60e4e00. 00000020:00000010:3.0:1734256858.381557:0:7480:0:(dt_object.c:52:dt_global_key_init()) kmalloced '(value)': 1256 at ffff88012b767000. 00000020:00000010:3.0:1734256858.381560:0:7480:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800b60e5a00. 80000000:00000010:3.0:1734256858.381563:0:7480:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b3695b40. 00040000:00000010:3.0:1734256858.381595:0:7480:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b6e1bb00. 00040000:00000010:3.0:1734256858.381599:0:7480:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800aabb3a00. 20000000:00000010:3.0:1734256858.381603:0:7480:0:(mgs_handler.c:1475:mgs_key_init()) kmalloced '(value)': 392 at ffff8800aabb3c00. 00000040:00000010:3.0:1734256858.381608:0:7480:0:(llog.c:527:llog_process_thread()) kmalloced '(buf)': 8192 at ffff8800a9d1c000. 00000040:00000010:3.0:1734256858.381935:0:7480:0:(llog.c:829:llog_process_thread()) kfreed 'buf': 8192 at ffff8800a9d1c000. 00000020:00000010:3.0:1734256858.381941:0:7480:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800b60e4a00. 00000040:00000010:3.0:1734256858.381945:0:7480:0:(llog_obd.c:233:llog_key_fini()) kfreed 'info': 480 at ffff8800b60e4e00. 00000020:00000010:3.0:1734256858.381947:0:7480:0:(dt_object.c:53:dt_global_key_fini()) kfreed 'info': 1256 at ffff88012b767000. 00000020:00000010:3.0:1734256858.381951:0:7480:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff8800b60e5a00. 80000000:00000010:3.0:1734256858.381953:0:7480:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff8800b3695b40. 00040000:00000010:3.0:1734256858.381956:0:7480:0:(lquota_lib.c:35:lquota_key_fini()) kfreed 'info': 240 at ffff8800b6e1bb00. 00040000:00000010:3.0:1734256858.381958:0:7480:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff8800aabb3a00. 20000000:00000010:3.0:1734256858.381960:0:7480:0:(mgs_handler.c:1475:mgs_key_fini()) kfreed 'info': 392 at ffff8800aabb3c00. 00000020:00000010:3.0:1734256858.381962:0:7480:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800b60e5600. 00000040:00000010:2.0:1734256858.382088:0:7464:0:(llog.c:927:llog_process_or_fork()) kfreed 'lpi': 104 at ffff8800a9ca4c00. 00000040:00000010:2.0:1734256858.382094:0:7464:0:(llog.c:90:llog_free_handle()) kfreed 'loghandle->lgh_hdr': 8192 at ffff88012b904000. 00000040:00000010:2.0:1734256858.382098:0:7464:0:(llog.c:92:llog_free_handle()) kfreed 'loghandle': 360 at ffff8800aa9bc400. 00000020:00000010:2.0:1734256858.382102:0:7464:0:(lu_object.c:538:lu_global_key_fini()) kfreed 'info': 512 at ffff8800aa9bc600. 00000040:00000010:2.0:1734256858.382103:0:7464:0:(llog_obd.c:233:llog_key_fini()) kfreed 'info': 480 at ffff8800aa9bc800. 00000020:00000010:2.0:1734256858.382105:0:7464:0:(dt_object.c:53:dt_global_key_fini()) kfreed 'info': 1256 at ffff880136994000. 00000020:00000010:2.0:1734256858.382108:0:7464:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff8800aa9bca00. 80000000:00000010:2.0:1734256858.382110:0:7464:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff8800b58f49c0. 00040000:00000010:2.0:1734256858.382112:0:7464:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff8800aa9bd400. 20000000:00000010:2.0:1734256858.382114:0:7464:0:(mgs_handler.c:1475:mgs_key_fini()) kfreed 'info': 392 at ffff8800aa9bd200. 00000020:00000010:2.0:1734256858.382115:0:7464:0:(lu_object.c:1611:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff8800aa9bd000. 10000000:00000010:2.0:1734256858.382118:0:7464:0:(mgc_request.c:1694:mgc_process_cfg_log()) kfreed 'env': 56 at ffff8800b6e32900. 00000020:00000010:2.0:1734256858.382138:0:7464:0:(obd_mount.c:101:lustre_process_log()) kfreed 'lcfg': 176 at ffff8800b401fcc0. 00000020:00000010:2.0:1734256858.382166:0:7464:0:(obd_mount.c:103:lustre_process_log()) kfreed 'bufs': 104 at ffff8800a9ca4200. 00000080:00000010:2.0:1734256858.382171:0:7464:0:(llite_lib.c:1481:ll_fill_super()) kmalloced '(dt)': 33 at ffff8800b6e32900. 00000080:00000010:2.0:1734256858.382174:0:7464:0:(llite_lib.c:1487:ll_fill_super()) kmalloced '(md)': 33 at ffff8800b6e32280. 00000080:00000010:2.0:1734256858.382179:0:7464:0:(llite_lib.c:330:client_common_fill_super()) kmalloced '(data)': 192 at ffff8800b401fcc0. 00000080:00000010:2.0:1734256858.382186:0:7464:0:(llite_lib.c:334:client_common_fill_super()) kmalloced '(osfs)': 144 at ffff8800b401f900. 00000020:00000010:2.0:1734256858.382191:0:7464:0:(genops.c:973:__class_new_export()) kmalloced '(export)': 1176 at ffff880136994000. 00000020:00000010:2.0:1734256858.382221:0:7464:0:(genops.c:973:__class_new_export()) kmalloced '(export)': 1176 at ffff880136991000. 00000400:00000200:2.0:1734256858.382232:0:7464:0:(peer.c:1541:LNetPeerDiscovered()) Peer NID 192.168.202.108@tcp is discovered: rc = 1 00000100:00000010:2.0:1734256858.382243:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734256858.382251:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa31c00. 40000000:00000010:2.0:1734256858.382287:0:7464:0:(fid_request.c:431:client_fid_init()) kmalloced '(cli->cl_seq)': 232 at ffff8800b404ce00. 40000000:00000010:2.0:1734256858.382289:0:7464:0:(fid_request.c:435:client_fid_init()) kmalloced '(prefix)': 133 at ffff8800b401fc00. 40000000:00000010:2.0:1734256858.382320:0:7464:0:(fid_request.c:443:client_fid_init()) kfreed 'prefix': 133 at ffff8800b401fc00. 80000000:00000010:2.0:1734256858.382323:0:7464:0:(fld_request.c:151:fld_client_add_target()) kmalloced '(target)': 40 at ffff8800b6e32b40. 02000000:00000010:3.0:1734256858.382359:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5805800. 00000400:00000010:3.0:1734256858.382366:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256858.382371:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256858.382374:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098164608, portal 10 00000020:00000010:3.0:1734256858.382379:0:6037:0:(lprocfs_status.c:1222:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff8800a9d1c000. 00000400:00000010:3.0:1734256858.382383:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734256858.382385:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098164608, offset 0 00000400:00000200:3.0:1734256858.382393:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00020000:00000010:2.0:1734256858.382395:0:7464:0:(lu_tgt_descs.c:124:lu_qos_add_tgt()) kmalloced '(svr)': 104 at ffff8800a9ca4200. 00000100:00000010:2.0:1734256858.382400:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18700. 00000400:00000200:3.0:1734256858.382400:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:2.0:1734256858.382404:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c200. 00000400:00000200:3.0:1734256858.382404:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256858.382407:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256858.382409:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256858.382411:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256858.382414:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [20:20:255:4294967295] 192.168.202.108@tcp LPNI seq info [19:19:8:4294967295] 00000400:00000200:3.0:1734256858.382421:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256858.382425:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256858.382428:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b6e1bb00. 00000800:00000200:3.0:1734256858.382431:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 40000000:00000010:2.0:1734256858.382433:0:7464:0:(fid_request.c:431:client_fid_init()) kmalloced '(cli->cl_seq)': 232 at ffff8800b404c800. 40000000:00000010:2.0:1734256858.382434:0:7464:0:(fid_request.c:435:client_fid_init()) kmalloced '(prefix)': 133 at ffff8800b401fc00. 00000800:00000200:3.0:1734256858.382437:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256858.382440:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b6e1bb00 type 1, nob 616 niov 1 nkiov 1 00000020:00000010:0.0:1734256858.382452:0:6039:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012f360a10. 00000020:00000010:0.0:1734256858.382456:0:6039:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800a9c3b000. 40000000:00000010:2.0:1734256858.382456:0:7464:0:(fid_request.c:443:client_fid_init()) kfreed 'prefix': 133 at ffff8800b401fc00. 80000000:00000010:0.0:1734256858.382459:0:6039:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff88012a4f94e0. 00800000:00000010:2.0:1734256858.382460:0:7464:0:(lmv_obd.c:1418:lmv_statfs()) kmalloced '(temp)': 144 at ffff8800b401fc00. 00000100:00000010:2.0:1734256858.382464:0:7464:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18a80. 02000000:00000010:2.0:1734256858.382467:0:7464:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404cb00. 40000000:00000010:0.0:1734256858.382469:0:6039:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff8800ab4ae000. 00000008:00000010:0.0:1734256858.382472:0:6039:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff88012b8f8b28. 00000100:00000010:2.0:1734256858.382472:0:7464:0:(client.c:1095:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff8800b401f240. 00020000:00000010:0.0:1734256858.382475:0:6039:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800aa83ed80. 00008000:00000010:0.0:1734256858.382478:0:6039:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff880139bf0388. 00100000:00000010:0.0:1734256858.382481:0:6039:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff8800b6336800. 00040000:00000010:0.0:1734256858.382484:0:6039:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b34d4b00. 00040000:00000010:0.0:1734256858.382486:0:6039:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff8800b6333000. 00040000:00000010:0.0:1734256858.382488:0:6039:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800a9c3b200. 00000004:00000010:0.0:1734256858.382491:0:6039:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff8800b6332000. 00000004:00000010:0.0:1734256858.382494:0:6039:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800a8851000. 00000004:00000010:0.0:1734256858.382497:0:6039:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff8800b6335000. 00002000:00000010:0.0:1734256858.382499:0:6039:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff8800b3529800. 00000004:00000010:0.0:1734256858.382502:0:6039:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff8800b352bc00. 00000080:00000010:0.0:1734256858.382504:0:6039:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff88012b79c0a8. 00000080:00000010:0.0:1734256858.382507:0:6039:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff88012c4ac248. 00000008:00000010:0.0:1734256858.382514:0:6039:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800b35ae000. 00020000:00000010:0.0:1734256858.382520:0:6039:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800b360c000. 00008000:00000010:0.0:1734256858.382522:0:6039:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff88013685aeb0. 00000080:00000010:0.0:1734256858.382526:0:6039:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800b375a000. 00000020:00000010:3.0:1734256858.382531:0:6038:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012bf6a338. 00000020:00000010:3.0:1734256858.382534:0:6038:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800aabb3c00. 80000000:00000010:3.0:1734256858.382535:0:6038:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b3695b40. 40000000:00000010:3.0:1734256858.382537:0:6038:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff880130e098c0. 00000008:00000010:3.0:1734256858.382539:0:6038:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984aca0. 00020000:00000010:3.0:1734256858.382542:0:6038:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff88012d6adf00. 00008000:00000010:3.0:1734256858.382544:0:6038:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d90e20. 00100000:00000010:3.0:1734256858.382546:0:6038:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff88012b767000. 00040000:00000010:3.0:1734256858.382548:0:6038:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b6e1bd00. 00040000:00000010:3.0:1734256858.382550:0:6038:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff88012b767800. 00040000:00000010:3.0:1734256858.382551:0:6038:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800aabb3a00. 00000004:00000010:3.0:1734256858.382553:0:6038:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff88013767c800. 00000004:00000010:3.0:1734256858.382560:0:6038:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800b61fd000. 00000004:00000010:3.0:1734256858.382566:0:6038:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff8800a9d98000. 00002000:00000010:3.0:1734256858.382594:0:6038:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff8800b5807c00. 00000004:00000010:3.0:1734256858.382596:0:6038:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff8800b5805400. 00000080:00000010:3.0:1734256858.382598:0:6038:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f52a0. 00000800:00000200:1.0:1734256858.382600:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000080:00000010:3.0:1734256858.382600:0:6038:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0920. 00000800:00000010:1.0:1734256858.382602:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b6e1bb00. 00000008:00000010:3.0:1734256858.382603:0:6038:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a887a420. 00000400:00000200:1.0:1734256858.382604:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00020000:00000010:3.0:1734256858.382605:0:6038:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800a99086c0. 00008000:00000010:3.0:1734256858.382607:0:6038:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff8801372b9e40. 00000400:00000200:1.0:1734256858.382608:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000080:00000010:3.0:1734256858.382609:0:6038:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800ac5f72d0. 00000400:00000200:1.0:1734256858.382610:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:1.0:1734256858.382611:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:1.0:1734256858.382616:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098164608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256868 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734256858.383646:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734256858.383655:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c600780 00000400:00000200:1.0:1734256858.383661:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x191 [1] + 0 00000400:00000200:1.0:1734256858.383673:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256858.383676:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:1.0:1734256858.383680:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098164608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256868 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256858.383797:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256858.383800:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256858.383801:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256858.383805:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098164608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256868 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256858.383811:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098164608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256868 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256858.383828:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5805800. 02000000:00000010:3.0:1734256858.383831:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa31c00. 00000100:00000010:3.0:1734256858.383835:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000020:00000010:2.0:1734256859.343735:0:3213:0:(lprocfs_status.c:1222:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 448 at ffff8800aa9bd000. 00000100:00000010:0.0:1734256863.387686:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734256863.387703:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734256863.387762:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734256863.387767:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b352b000. 00000020:00000010:3.0:1734256863.387800:0:6040:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff88012bf6a840. 02000000:00000010:0.0:1734256863.387804:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b352ac00. 00000020:00000010:3.0:1734256863.387807:0:6040:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800aabb3e00. 00000400:00000010:0.0:1734256863.387810:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50160. 80000000:00000010:3.0:1734256863.387810:0:6040:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b3695cc0. 40000000:00000010:3.0:1734256863.387813:0:6040:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff880130e09240. 00000400:00000010:0.0:1734256863.387815:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000008:00000010:3.0:1734256863.387817:0:6040:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800a984ce18. 00020000:00000010:3.0:1734256863.387820:0:6040:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff88012d6adb40. 00000100:00000200:0.0:1734256863.387821:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098165120, portal 10 00008000:00000010:3.0:1734256863.387825:0:6040:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800a9d918b8. 00000020:00000010:0.0:1734256863.387826:0:6037:0:(lprocfs_status.c:1222:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff8800ac586000. 00100000:00000010:3.0:1734256863.387828:0:6040:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff8800a9d98800. 00000400:00000010:0.0:1734256863.387831:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00040000:00000010:3.0:1734256863.387832:0:6040:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b6e1b500. 00000100:00000200:0.0:1734256863.387833:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098165120, offset 0 00040000:00000010:3.0:1734256863.387835:0:6040:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff8800a9d99000. 00040000:00000010:3.0:1734256863.387838:0:6040:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800b60e5600. 00000400:00000200:0.0:1734256863.387841:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000004:00000010:3.0:1734256863.387841:0:6040:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff8800a9d99800. 00000004:00000010:3.0:1734256863.387850:0:6040:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800b61fb000. 00000400:00000200:0.0:1734256863.387851:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000004:00000010:3.0:1734256863.387854:0:6040:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff8800a9d9a000. 00002000:00000010:3.0:1734256863.387856:0:6040:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff8800b5805800. 00000004:00000010:3.0:1734256863.387859:0:6040:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff8800b5805c00. 00000400:00000200:0.0:1734256863.387860:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000080:00000010:3.0:1734256863.387863:0:6040:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800ac5f5498. 00000400:00000200:0.0:1734256863.387864:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256863.387866:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000080:00000010:3.0:1734256863.387866:0:6040:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a9bd0ff8. 00000400:00000200:0.0:1734256863.387868:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000008:00000010:3.0:1734256863.387869:0:6040:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a887a580. 00000400:00000200:0.0:1734256863.387871:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [21:21:255:4294967295] 192.168.202.108@tcp LPNI seq info [20:20:8:4294967295] 00020000:00000010:3.0:1734256863.387872:0:6040:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff8800a9908900. 00008000:00000010:3.0:1734256863.387874:0:6040:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff8801372b9f90. 00000080:00000010:3.0:1734256863.387877:0:6040:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800ac5f73c0. 00000400:00000200:0.0:1734256863.387879:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256863.387883:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734256863.387885:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000800:00000010:0.0:1734256863.387886:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000400:00000010:3.0:1734256863.387889:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000800:00000200:0.0:1734256863.387891:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:3.0:1734256863.387892:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256863.387895:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098164992, portal 25 00000400:00000010:3.0:1734256863.387897:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000800:00000200:0.0:1734256863.387898:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:3.0:1734256863.387898:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098164992, offset 0 00000800:00000200:0.0:1734256863.387901:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734256863.387902:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256863.387907:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256863.387909:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256863.387911:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256863.387913:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256863.387914:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256863.387916:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [22:22:254:4294967295] 192.168.202.108@tcp LPNI seq info [21:21:7:4294967295] 00000400:00000200:3.0:1734256863.387921:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256863.387925:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256863.387927:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b6e1bb00. 00000800:00000200:3.0:1734256863.387929:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256863.387932:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256863.387934:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b6e1bb00 type 1, nob 320 niov 1 nkiov 1 00000020:00000010:2.0:1734256863.388016:0:6041:0:(tgt_main.c:718:tgt_key_init()) slab-alloced 'thread': 1288 at ffff8800ac760000. 00000800:00000200:1.0:1734256863.388017:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256863.388019:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000020:00000010:2.0:1734256863.388020:0:6041:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff8800aa9bd200. 80000000:00000010:2.0:1734256863.388022:0:6041:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff8800b58f49c0. 40000000:00000010:2.0:1734256863.388023:0:6041:0:(fid_handler.c:436:seq_key_init()) kmalloced '(value)': 48 at ffff8800b6e32180. 00000400:00000200:1.0:1734256863.388024:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000008:00000010:2.0:1734256863.388026:0:6041:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff8800ac440000. 00000400:00000200:1.0:1734256863.388028:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00020000:00000010:2.0:1734256863.388029:0:6041:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff8800b3664f00. 00000400:00000200:1.0:1734256863.388031:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00008000:00000010:2.0:1734256863.388031:0:6041:0:(echo_client.c:430:echo_thread_key_init()) slab-alloced 'info': 904 at ffff8800b60f4000. 00000400:00000010:1.0:1734256863.388033:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00100000:00000010:2.0:1734256863.388035:0:6041:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff880137706800. 00040000:00000010:2.0:1734256863.388037:0:6041:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 240 at ffff8800b404cf00. 00000100:00000200:1.0:1734256863.388039:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098165120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256873 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00040000:00000010:2.0:1734256863.388040:0:6041:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff8800aabf1800. 00040000:00000010:2.0:1734256863.388041:0:6041:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff8800aa9bd400. 00000004:00000010:2.0:1734256863.388047:0:6041:0:(mdd_device.c:2353:mdd_key_init()) kmalloced '(value)': 1864 at ffff8800aabf4000. 00000004:00000010:2.0:1734256863.388050:0:6041:0:(mdt_handler.c:8173:mdt_key_init()) kmalloced '(value)': 2568 at ffff8800aab53000. 00000004:00000010:2.0:1734256863.388052:0:6041:0:(lod_dev.c:2316:lod_key_init()) kmalloced '(value)': 1224 at ffff8800aabf2000. 00002000:00000010:2.0:1734256863.388055:0:6041:0:(ofd_dev.c:2901:ofd_key_init()) kmalloced '(value)': 816 at ffff88012aa33800. 00000004:00000010:2.0:1734256863.388057:0:6041:0:(osp_dev.c:1812:osp_key_init()) kmalloced '(value)': 616 at ffff88012aa31c00. 00000080:00000010:2.0:1734256863.388060:0:6041:0:(vvp_dev.c:87:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff8800b35e4000. 00000080:00000010:2.0:1734256863.388062:0:6041:0:(vvp_dev.c:138:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff8800a90c8000. 00000008:00000010:2.0:1734256863.388070:0:6041:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff8800a9008000. 00020000:00000010:2.0:1734256863.388072:0:6041:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff880130908900. 00008000:00000010:2.0:1734256863.388075:0:6041:0:(echo_client.c:455:echo_session_key_init()) slab-alloced 'session': 8 at ffff88012abada50. 00000080:00000010:2.0:1734256863.388080:0:6041:0:(vvp_dev.c:113:vvp_session_key_init()) slab-alloced 'session': 240 at ffff8800b4306000. 00000800:00000200:1.0:1734256863.388103:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256863.388105:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b6e1bb00. 00000400:00000200:1.0:1734256863.388107:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256863.388110:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256863.388117:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:1.0:1734256863.388119:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:1.0:1734256863.388122:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098164992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256879 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256863.389833:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256863.389844:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c600980 00000400:00000200:0.0:1734256863.389849:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x199 [1] + 0 00000400:00000200:0.0:1734256863.389855:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256863.389857:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256863.389863:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098165120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256873 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256863.390088:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000010:2.0:1734256863.390095:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50160. 00000400:00000200:2.0:1734256863.390099:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:2.0:1734256863.390100:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:2.0:1734256863.390105:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098165120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256873 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256863.390111:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098165120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256873 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000020:00000010:2.0:1734256863.390125:0:6037:0:(lprocfs_status.c:1222:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff88012b904000. 02000000:00000010:2.0:1734256863.390139:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b352ac00. 02000000:00000010:2.0:1734256863.390143:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b352b000. 00000100:00000010:2.0:1734256863.390146:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734256863.390293:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c600900 00000400:00000200:0.0:1734256863.390299:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a1 [1] + 224 00000400:00000200:0.0:1734256863.390314:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256863.390316:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256863.390320:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098164992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256879 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256863.390409:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256863.390412:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256863.390419:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256863.390424:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098164992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256879 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256863.390429:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098164992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256879 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256863.390439:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734256863.390442:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734256863.390443:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734256868.395813:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734256868.395833:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734256868.395881:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734256868.395899:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b3529c00. 02000000:00000010:0.0:1734256868.395938:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b352b000. 02000000:00000010:2.0:1734256868.395939:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:0.0:1734256868.395943:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d501b8. 00000400:00000010:2.0:1734256868.395944:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000010:0.0:1734256868.395949:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000400:00000010:2.0:1734256868.395949:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734256868.395954:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098165248, portal 25 00000400:00000010:2.0:1734256868.395957:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734256868.396024:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098165376, portal 10 00000100:00000200:2.0:1734256868.396024:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098165248, offset 0 00000400:00000010:0.0:1734256868.396029:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000400:00000200:2.0:1734256868.396031:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734256868.396035:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098165376, offset 0 00000400:00000200:0.0:1734256868.396040:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256868.396041:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256868.396045:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256868.396048:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256868.396056:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256868.396058:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256868.396060:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [23:23:255:4294967295] 192.168.202.108@tcp LPNI seq info [22:22:8:4294967295] 00000400:00000200:2.0:1734256868.396067:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256868.396073:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256868.396074:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734256868.396076:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734256868.396077:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256868.396079:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256868.396081:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734256868.396081:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734256868.396082:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256868.396084:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [24:24:254:4294967295] 192.168.202.108@tcp LPNI seq info [23:23:7:4294967295] 00000800:00000200:2.0:1734256868.396087:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734256868.396090:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256868.396090:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734256868.396093:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256868.396095:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000800:00000200:0.0:1734256868.396098:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256868.396102:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256868.396104:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734256868.396186:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256868.396190:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734256868.396194:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256868.396198:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256868.396201:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:1.0:1734256868.396202:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:1.0:1734256868.396208:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098165248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256884 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734256868.396266:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256868.396267:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734256868.396270:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256868.396272:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256868.396274:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:1.0:1734256868.396275:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:1.0:1734256868.396278:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098165376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256878 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256868.400815:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256868.400829:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c600a00 00000400:00000200:0.0:1734256868.400835:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a9 [1] + 224 00000400:00000200:0.0:1734256868.401441:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256868.401452:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256868.401461:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098165248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256884 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256868.401521:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256868.401526:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c600a80 00000400:00000200:0.0:1734256868.401537:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ad [1] + 0 00000400:00000200:0.0:1734256868.401546:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256868.401548:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256868.401552:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098165376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256878 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256868.401611:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:2.0:1734256868.401615:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734256868.401617:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734256868.401622:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098165248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256884 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256868.401629:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098165248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256884 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256868.401647:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734256868.401650:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734256868.401653:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:1.0:1734256868.406376:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d501b8. 00000400:00000200:1.0:1734256868.406389:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:1.0:1734256868.406391:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:1.0:1734256868.406402:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098165376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256878 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256868.406411:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098165376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256878 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000020:00000010:1.0:1734256868.406432:0:6037:0:(lprocfs_status.c:1222:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff8800b351e000. 02000000:00000010:1.0:1734256868.406451:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b352b000. 02000000:00000010:1.0:1734256868.406456:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b3529c00. 00000100:00000010:1.0:1734256868.406458:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734256873.403820:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734256873.403837:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 02000000:00000010:3.0:1734256873.404216:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734256873.404222:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256873.404228:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256873.404233:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098165504, portal 25 00000400:00000010:3.0:1734256873.404237:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734256873.404238:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098165504, offset 0 00000400:00000200:3.0:1734256873.404246:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256873.404256:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256873.404259:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256873.404263:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256873.404266:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256873.404267:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256873.404270:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [25:25:255:4294967295] 192.168.202.108@tcp LPNI seq info [24:24:8:4294967295] 00000400:00000200:3.0:1734256873.404276:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256873.404280:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256873.404284:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b6e1bb00. 00000800:00000200:3.0:1734256873.404289:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256873.404295:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256873.404299:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b6e1bb00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734256873.405315:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734256873.405325:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b61b9400. 00000800:00000200:0.0:1734256873.405415:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256873.405417:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b6e1bb00. 00000400:00000200:0.0:1734256873.405420:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256873.405425:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256873.405429:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734256873.405430:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734256873.405436:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098165504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256889 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256873.405538:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734256873.405542:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000010:2.0:1734256873.405546:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734256873.405549:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098165632, portal 10 00000400:00000010:2.0:1734256873.405553:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734256873.405554:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098165632, offset 0 00000400:00000200:2.0:1734256873.405558:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256873.405563:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256873.405566:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256873.405584:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256873.405586:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256873.405587:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256873.405600:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [26:26:255:4294967295] 192.168.202.108@tcp LPNI seq info [25:25:8:4294967295] 00000400:00000200:2.0:1734256873.405606:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256873.405610:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256873.405612:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734256873.405616:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256873.405621:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256873.405623:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734256873.405878:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256873.405881:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734256873.405883:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256873.405886:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256873.405888:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734256873.405889:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734256873.405893:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098165632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256883 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256873.416065:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256873.416081:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c600b80 00000400:00000200:0.0:1734256873.416088:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c1 [1] + 0 00000400:00000200:0.0:1734256873.416098:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256873.416102:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256873.416121:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098165632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256883 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256873.416158:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256873.416163:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c600b00 00000400:00000200:0.0:1734256873.416167:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b9 [1] + 224 00000400:00000200:0.0:1734256873.416178:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256873.416180:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256873.416184:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098165504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256889 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256873.416604:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256873.416608:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256873.416610:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256873.416614:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098165504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256889 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256873.416630:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098165504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256889 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256873.416648:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734256873.416653:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734256873.416656:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:2.0:1734256873.416934:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:2.0:1734256873.416938:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734256873.416939:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734256873.416944:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098165632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256883 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256873.416950:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098165632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256883 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256873.416965:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734256873.416968:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b61b9400. 00000100:00000010:2.0:1734256873.416971:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734256878.411684:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734256878.411703:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734256878.411760:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734256878.411765:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b3529c00. 02000000:00000010:3.0:1734256878.411798:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734256878.411806:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256878.411812:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256878.411817:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098165760, portal 25 00000400:00000010:3.0:1734256878.411821:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734256878.411822:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098165760, offset 0 00000400:00000200:3.0:1734256878.411829:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256878.411840:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256878.411845:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:2.0:1734256878.411847:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:3.0:1734256878.411848:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256878.411851:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:2.0:1734256878.411852:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000200:3.0:1734256878.411853:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:2.0:1734256878.411855:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000400:00000200:3.0:1734256878.411855:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [27:27:255:4294967295] 192.168.202.108@tcp LPNI seq info [26:26:8:4294967295] 00000100:00000200:2.0:1734256878.411857:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098165888, portal 10 00000400:00000010:2.0:1734256878.411862:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734256878.411863:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098165888, offset 0 00000400:00000200:3.0:1734256878.411867:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:2.0:1734256878.411868:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734256878.411872:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256878.411873:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256878.411875:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734256878.411875:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b6e1bb00. 00000400:00000200:2.0:1734256878.411877:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256878.411879:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734256878.411880:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734256878.411881:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256878.411883:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [28:28:254:4294967295] 192.168.202.108@tcp LPNI seq info [27:27:7:4294967295] 00000800:00000200:3.0:1734256878.411886:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256878.411889:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b6e1bb00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734256878.411898:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256878.411902:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256878.411906:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734256878.411909:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256878.411912:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256878.411914:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734256878.411974:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256878.411978:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b6e1bb00. 00000400:00000200:0.0:1734256878.411982:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256878.411986:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256878.411989:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734256878.411990:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734256878.411996:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098165760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256894 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734256878.412053:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256878.412055:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734256878.412058:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256878.412060:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256878.412062:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734256878.412063:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734256878.412066:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098165888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256888 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256878.417120:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256878.417144:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c600c00 00000400:00000200:0.0:1734256878.417150:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c9 [1] + 224 00000400:00000200:0.0:1734256878.417161:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256878.417164:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256878.417178:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098165760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256894 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256878.417532:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256878.417537:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c600c80 00000400:00000200:0.0:1734256878.417542:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d1 [1] + 0 00000400:00000200:0.0:1734256878.417552:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256878.417555:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256878.417560:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098165888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256888 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256878.417625:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:2.0:1734256878.417629:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734256878.417630:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734256878.417634:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098165888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256888 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256878.417639:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098165888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256888 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256878.417661:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734256878.417666:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b3529c00. 00000100:00000010:2.0:1734256878.417669:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:3.0:1734256878.417686:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256878.417690:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256878.417691:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256878.417696:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098165760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256894 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256878.417701:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098165760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256894 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256878.417717:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734256878.417721:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734256878.417722:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734256883.419679:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734256883.419699:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734256883.419756:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734256883.419762:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b352ac00. 02000000:00000010:0.0:1734256883.419800:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b3529c00. 00000400:00000010:0.0:1734256883.419806:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50210. 00000400:00000010:0.0:1734256883.419811:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000100:00000200:0.0:1734256883.419817:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098166144, portal 10 00000400:00000010:0.0:1734256883.419822:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734256883.419823:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098166144, offset 0 00000400:00000200:0.0:1734256883.419830:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256883.419840:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256883.419844:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256883.419847:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256883.419850:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256883.419851:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256883.419863:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [29:29:255:4294967295] 192.168.202.108@tcp LPNI seq info [28:28:8:4294967295] 00000400:00000200:0.0:1734256883.419871:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256883.419875:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256883.419878:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734256883.419883:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256883.419890:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256883.419893:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734256883.419929:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734256883.419934:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256883.419938:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256883.419941:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098166016, portal 25 00000400:00000010:3.0:1734256883.419944:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734256883.419945:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098166016, offset 0 00000400:00000200:3.0:1734256883.419951:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256883.419956:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256883.419958:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256883.419960:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256883.419962:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256883.419964:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256883.419966:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [30:30:254:4294967295] 192.168.202.108@tcp LPNI seq info [29:29:7:4294967295] 00000400:00000200:3.0:1734256883.419972:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256883.419976:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256883.419978:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b6e1bb00. 00000800:00000200:3.0:1734256883.419981:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256883.419986:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256883.419988:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b6e1bb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734256883.420019:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256883.420026:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734256883.420032:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256883.420039:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256883.420044:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:1.0:1734256883.420046:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:1.0:1734256883.420056:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098166144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256893 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734256883.420136:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256883.420139:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b6e1bb00. 00000400:00000200:1.0:1734256883.420141:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256883.420144:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256883.420147:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:1.0:1734256883.420148:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:1.0:1734256883.420152:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098166016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256899 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256883.423432:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256883.423454:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c600d80 00000400:00000200:0.0:1734256883.423463:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d9 [1] + 0 00000400:00000200:0.0:1734256883.423475:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256883.423478:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256883.423488:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098166144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256883.423670:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50210. 00000400:00000200:2.0:1734256883.423675:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:2.0:1734256883.423678:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:2.0:1734256883.423684:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098166144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256893 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256883.423690:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000100:00000200:2.0:1734256883.423690:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098166144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256893 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256883.423703:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c600d00 00000400:00000200:0.0:1734256883.423711:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e1 [1] + 224 02000000:00000010:2.0:1734256883.423724:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b3529c00. 02000000:00000010:2.0:1734256883.423729:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b352ac00. 00000100:00000010:2.0:1734256883.423734:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734256883.423737:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256883.423741:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256883.423750:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098166016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256899 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256883.424614:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256883.424620:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256883.424621:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256883.424627:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098166016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256899 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256883.424635:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098166016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256899 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256883.424655:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734256883.424668:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734256883.424671:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734256888.427688:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734256888.427707:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734256888.427769:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734256888.427775:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b3529c00. 02000000:00000010:2.0:1734256888.427816:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 02000000:00000010:0.0:1734256888.427823:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b352b000. 00000400:00000010:2.0:1734256888.427823:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000010:0.0:1734256888.427827:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50268. 00000400:00000010:2.0:1734256888.427829:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000400:00000010:0.0:1734256888.427830:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000100:00000200:2.0:1734256888.427834:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098166272, portal 25 00000100:00000200:0.0:1734256888.427843:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098166400, portal 10 00000400:00000010:2.0:1734256888.427844:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734256888.427846:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098166272, offset 0 00000400:00000010:0.0:1734256888.427849:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000400:00000200:2.0:1734256888.427853:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734256888.427863:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098166400, offset 0 00000400:00000200:2.0:1734256888.427864:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256888.427868:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256888.427868:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256888.427871:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256888.427874:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256888.427875:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256888.427878:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [31:31:255:4294967295] 192.168.202.108@tcp LPNI seq info [30:30:8:4294967295] 00000400:00000200:2.0:1734256888.427885:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256888.427890:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256888.427892:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734256888.427893:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734256888.427895:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256888.427897:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734256888.427898:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734256888.427899:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256888.427900:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256888.427902:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [32:32:254:4294967295] 192.168.202.108@tcp LPNI seq info [31:31:7:4294967295] 00000800:00000200:2.0:1734256888.427904:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256888.427907:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734256888.427908:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256888.427912:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256888.427914:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734256888.427918:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256888.427922:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256888.427924:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734256888.427990:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256888.427994:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734256888.427998:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256888.428002:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256888.428005:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:1.0:1734256888.428007:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:1.0:1734256888.428013:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098166272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256904 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734256888.428070:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256888.428072:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:1.0:1734256888.428074:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256888.428076:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256888.428078:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:1.0:1734256888.428079:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:1.0:1734256888.428082:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098166400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256898 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256888.429262:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256888.429272:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c600e00 00000400:00000200:0.0:1734256888.429277:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e9 [1] + 224 00000400:00000200:0.0:1734256888.429284:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256888.429285:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256888.429290:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098166272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256904 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256888.429316:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256888.429320:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c600e80 00000400:00000200:0.0:1734256888.429323:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ed [1] + 0 00000400:00000200:0.0:1734256888.429349:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256888.429352:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256888.429355:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098166400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256898 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256888.429357:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:2.0:1734256888.429361:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734256888.429362:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734256888.429366:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098166272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256904 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256888.429373:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098166272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256904 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256888.429389:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734256888.429392:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734256888.429395:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:1.0:1734256888.429435:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50268. 00000400:00000200:1.0:1734256888.429441:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:1.0:1734256888.429441:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:1.0:1734256888.429445:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098166400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256898 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256888.429448:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098166400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256898 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256888.429461:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b352b000. 02000000:00000010:1.0:1734256888.429463:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b3529c00. 00000100:00000010:1.0:1734256888.429465:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734256893.437001:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734256893.437018:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734256893.437692:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734256893.437701:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b352ac00. 02000000:00000010:0.0:1734256893.437737:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b3529c00. 00000400:00000010:0.0:1734256893.437742:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d502c0. 00000400:00000010:0.0:1734256893.437748:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734256893.437753:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098166656, portal 10 00000400:00000010:0.0:1734256893.437757:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734256893.437760:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098166656, offset 0 00000400:00000200:0.0:1734256893.437767:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256893.437777:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256893.437780:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256893.437784:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256893.437786:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256893.437788:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256893.437791:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [33:33:255:4294967295] 192.168.202.108@tcp LPNI seq info [32:32:8:4294967295] 00000400:00000200:0.0:1734256893.437798:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256893.437803:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256893.437805:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734256893.437810:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256893.437817:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256893.437821:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734256893.437901:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256893.437903:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:0.0:1734256893.437906:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256893.437909:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256893.437912:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:0.0:1734256893.437914:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734256893.437920:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098166656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256903 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256893.438016:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734256893.438020:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734256893.438023:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256893.438026:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098166528, portal 25 00000400:00000010:1.0:1734256893.438028:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734256893.438029:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098166528, offset 0 00000400:00000200:1.0:1734256893.438033:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256893.438037:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256893.438039:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256893.438041:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256893.438042:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256893.438044:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256893.438046:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [34:34:255:4294967295] 192.168.202.108@tcp LPNI seq info [33:33:8:4294967295] 00000400:00000200:1.0:1734256893.438052:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256893.438055:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734256893.438058:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734256893.438060:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734256893.438063:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734256893.438065:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734256893.438121:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256893.438123:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734256893.438126:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256893.438128:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256893.438131:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734256893.438132:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734256893.438135:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098166528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256909 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256893.445479:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256893.445495:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c600f80 00000400:00000200:0.0:1734256893.445503:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f9 [1] + 0 00000400:00000200:0.0:1734256893.445520:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256893.445525:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256893.445533:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098166656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256903 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256893.445633:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d502c0. 00000400:00000200:2.0:1734256893.445644:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:2.0:1734256893.445646:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:2.0:1734256893.445656:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098166656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256903 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256893.445665:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098166656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256903 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256893.445707:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b3529c00. 02000000:00000010:2.0:1734256893.445712:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b352ac00. 00000100:00000010:2.0:1734256893.445716:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734256893.447012:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256893.447020:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c600f00 00000400:00000200:0.0:1734256893.447025:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x201 [1] + 224 00000400:00000200:0.0:1734256893.447036:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256893.447039:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256893.447045:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098166528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256909 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734256893.447110:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734256893.447114:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256893.447122:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256893.447128:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098166528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256909 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256893.447135:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098166528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256909 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256893.447156:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734256893.447160:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734256893.447163:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734256898.443675:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734256898.443693:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734256898.443748:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734256898.443754:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b352ac00. 02000000:00000010:1.0:1734256898.443797:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734256898.443803:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734256898.443807:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256898.443812:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098166784, portal 25 00000400:00000010:1.0:1734256898.443816:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734256898.443818:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098166784, offset 0 00000400:00000200:1.0:1734256898.443828:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734256898.443836:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:1.0:1734256898.443840:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734256898.443840:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000010:2.0:1734256898.443843:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000400:00000200:1.0:1734256898.443845:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:2.0:1734256898.443845:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098166912, portal 10 00000400:00000200:1.0:1734256898.443848:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:2.0:1734256898.443848:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734256898.443849:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098166912, offset 0 00000400:00000200:1.0:1734256898.443851:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256898.443853:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256898.443853:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256898.443856:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [35:35:255:4294967295] 192.168.202.108@tcp LPNI seq info [34:34:8:4294967295] 00000400:00000200:1.0:1734256898.443864:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256898.443868:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256898.443868:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256898.443871:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734256898.443872:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000400:00000200:2.0:1734256898.443872:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256898.443874:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256898.443875:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734256898.443876:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734256898.443876:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [36:36:254:4294967295] 192.168.202.108@tcp LPNI seq info [35:35:7:4294967295] 00000400:00000200:2.0:1734256898.443880:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256898.443881:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256898.443882:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734256898.443883:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:2.0:1734256898.443885:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734256898.443887:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256898.443889:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256898.443891:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734256898.443941:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256898.443944:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734256898.443955:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256898.443958:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256898.443960:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:0.0:1734256898.443961:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734256898.443966:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098166784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256914 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734256898.444010:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256898.444012:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734256898.444013:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256898.444015:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256898.444016:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:0.0:1734256898.444016:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734256898.444018:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098166912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256908 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256898.445511:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256898.445521:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601000 00000400:00000200:0.0:1734256898.445527:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x209 [1] + 224 00000400:00000200:0.0:1734256898.445535:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256898.445550:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256898.445561:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098166784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256914 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256898.445606:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256898.445610:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601080 00000400:00000200:0.0:1734256898.445613:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x211 [1] + 0 00000400:00000200:0.0:1734256898.445626:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:1.0:1734256898.445627:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:0.0:1734256898.445629:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256898.445631:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256898.445632:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256898.445636:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098166784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256914 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734256898.445640:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098166912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256908 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256898.445649:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098166784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256914 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256898.445666:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734256898.445671:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734256898.445674:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:2.0:1734256898.445703:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:2.0:1734256898.445707:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734256898.445708:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734256898.445712:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098166912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256908 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256898.445720:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098166912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256908 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256898.445743:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734256898.445747:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b352ac00. 00000100:00000010:2.0:1734256898.445749:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734256903.451688:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734256903.451729:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734256903.451788:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734256903.451794:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b3529c00. 02000000:00000010:0.0:1734256903.451827:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b352b000. 02000000:00000010:2.0:1734256903.451828:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:0.0:1734256903.451833:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50318. 00000400:00000010:2.0:1734256903.451833:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c840. 00000400:00000010:0.0:1734256903.451838:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000400:00000010:2.0:1734256903.451838:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:0.0:1734256903.451843:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098167168, portal 10 00000400:00000010:0.0:1734256903.451847:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000100:00000200:2.0:1734256903.451849:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098167040, portal 25 00000100:00000200:0.0:1734256903.451850:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098167168, offset 0 00000400:00000010:2.0:1734256903.451852:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000400:00000200:0.0:1734256903.451856:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734256903.451859:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098167040, offset 0 00000400:00000200:2.0:1734256903.451864:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256903.451866:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256903.451870:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256903.451874:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256903.451876:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256903.451878:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256903.451880:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [37:37:255:4294967295] 192.168.202.108@tcp LPNI seq info [36:36:8:4294967295] 00000400:00000200:0.0:1734256903.451887:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256903.451892:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256903.451893:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734256903.451895:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000400:00000200:2.0:1734256903.451895:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256903.451897:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256903.451899:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:0.0:1734256903.451900:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734256903.451901:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256903.451903:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [38:38:254:4294967295] 192.168.202.108@tcp LPNI seq info [37:37:7:4294967295] 00000800:00000200:0.0:1734256903.451906:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734256903.451908:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256903.451909:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734256903.451911:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256903.451914:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734256903.451917:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256903.451920:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256903.451922:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734256903.453664:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256903.453669:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734256903.453675:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256903.453680:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256903.453684:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:1.0:1734256903.453685:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:1.0:1734256903.453692:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098167168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256913 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734256903.453765:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256903.453767:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734256903.453770:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256903.453773:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256903.453775:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:1.0:1734256903.453776:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:1.0:1734256903.453780:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098167040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256919 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256903.458467:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256903.458484:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601180 00000400:00000200:0.0:1734256903.458491:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x219 [1] + 0 00000400:00000200:0.0:1734256903.458500:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256903.458504:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256903.458512:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098167168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256913 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256903.458551:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256903.458566:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601100 00000400:00000200:0.0:1734256903.458592:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x21d [1] + 224 00000400:00000010:2.0:1734256903.458598:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50318. 00000400:00000200:2.0:1734256903.458603:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:2.0:1734256903.458604:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000400:00000200:0.0:1734256903.458607:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000200:2.0:1734256903.458609:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098167168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256913 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256903.458610:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256903.458614:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098167040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256919 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256903.458615:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098167168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256913 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256903.458647:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b352b000. 02000000:00000010:2.0:1734256903.458651:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b3529c00. 00000100:00000010:2.0:1734256903.458654:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:3.0:1734256903.458673:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c840. 00000400:00000200:3.0:1734256903.458678:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:3.0:1734256903.458679:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:3.0:1734256903.458684:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098167040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256919 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256903.458691:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098167040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256919 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256903.458702:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:3.0:1734256903.458704:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734256903.458706:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734256908.459715:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734256908.459740:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734256908.459807:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734256908.459814:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734256908.459864:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734256908.459872:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50370. 00000400:00000010:0.0:1734256908.459878:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000100:00000200:0.0:1734256908.459886:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098167424, portal 10 00000400:00000010:0.0:1734256908.459892:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734256908.459894:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098167424, offset 0 00000400:00000200:0.0:1734256908.459903:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256908.459918:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256908.459923:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256908.459927:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256908.459930:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256908.459932:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256908.459935:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [39:39:255:4294967295] 192.168.202.108@tcp LPNI seq info [38:38:8:4294967295] 00000400:00000200:0.0:1734256908.459944:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:2.0:1734256908.459944:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000800:00000200:0.0:1734256908.459949:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256908.459952:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000400:00000010:2.0:1734256908.459955:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c898. 00000800:00000200:0.0:1734256908.459958:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:2.0:1734256908.459960:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000800:00000200:0.0:1734256908.459965:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:2.0:1734256908.459966:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098167296, portal 25 00000800:00000200:0.0:1734256908.459969:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 00000400:00000010:2.0:1734256908.459969:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734256908.459971:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098167296, offset 0 00000400:00000200:2.0:1734256908.459978:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256908.459989:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256908.459993:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256908.459996:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256908.459998:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256908.460000:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256908.460003:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [40:40:254:4294967295] 192.168.202.108@tcp LPNI seq info [39:39:7:4294967295] 00000400:00000200:2.0:1734256908.460009:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256908.460014:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256908.460017:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734256908.460022:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256908.460028:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256908.460031:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734256908.460098:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256908.460102:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734256908.460107:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256908.460111:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256908.460115:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:1.0:1734256908.460117:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:1.0:1734256908.460123:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098167424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256918 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734256908.460202:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256908.460204:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734256908.460211:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256908.460214:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256908.460216:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:1.0:1734256908.460217:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:1.0:1734256908.460221:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098167296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256924 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256908.462643:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256908.462660:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601280 00000400:00000200:0.0:1734256908.462759:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x229 [1] + 0 00000400:00000200:0.0:1734256908.462771:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256908.462774:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256908.462783:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098167424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256918 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256908.462820:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256908.462825:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601200 00000400:00000200:0.0:1734256908.462829:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x231 [1] + 224 00000400:00000200:0.0:1734256908.462843:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256908.462846:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256908.462850:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098167296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256924 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256908.462879:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50370. 00000400:00000200:2.0:1734256908.462884:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:2.0:1734256908.462886:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:2.0:1734256908.462890:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098167424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256918 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256908.462897:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098167424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256918 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256908.462937:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 00000400:00000010:3.0:1734256908.462940:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c898. 02000000:00000010:2.0:1734256908.462941:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000400:00000200:3.0:1734256908.462943:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000100:00000010:2.0:1734256908.462945:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:3.0:1734256908.462945:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:3.0:1734256908.462950:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098167296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256924 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256908.462956:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098167296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256924 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256908.462971:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:3.0:1734256908.462974:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734256908.462976:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734256913.467689:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734256913.467707:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734256913.467759:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734256913.467764:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734256913.467872:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734256913.467880:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256913.467885:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256913.467891:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098167552, portal 25 00000400:00000010:3.0:1734256913.467894:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734256913.467896:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098167552, offset 0 00000400:00000200:3.0:1734256913.467903:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256913.467913:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256913.467917:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256913.467931:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256913.467933:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256913.467935:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256913.467938:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [41:41:255:4294967295] 192.168.202.108@tcp LPNI seq info [40:40:8:4294967295] 00000400:00000200:3.0:1734256913.467945:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256913.467950:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256913.467954:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b6e1bb00. 00000800:00000200:3.0:1734256913.467958:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256913.467964:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256913.467967:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b6e1bb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734256913.468072:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734256913.468075:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b6e1bb00. 00000400:00000200:3.0:1734256913.468078:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734256913.468082:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734256913.468088:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734256913.468090:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734256913.468096:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098167552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256929 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256913.468245:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734256913.468250:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734256913.468253:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256913.468256:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098167680, portal 10 00000400:00000010:2.0:1734256913.468259:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734256913.468261:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098167680, offset 0 00000400:00000200:2.0:1734256913.468268:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256913.468273:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256913.468275:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256913.468277:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256913.468278:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256913.468280:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256913.468282:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [42:42:255:4294967295] 192.168.202.108@tcp LPNI seq info [41:41:8:4294967295] 00000400:00000200:2.0:1734256913.468287:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256913.468291:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256913.468293:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734256913.468295:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256913.468299:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256913.468301:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734256913.468395:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256913.468400:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734256913.468402:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256913.468405:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256913.468407:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:1.0:1734256913.468408:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:1.0:1734256913.468412:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098167680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256923 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256913.470241:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256913.470254:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601300 00000400:00000200:0.0:1734256913.470260:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x239 [1] + 224 00000400:00000200:0.0:1734256913.470268:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256913.470271:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256913.470278:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098167552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256929 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256913.470308:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256913.470312:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601380 00000400:00000200:0.0:1734256913.470315:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x241 [1] + 0 00000400:00000200:0.0:1734256913.470336:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256913.470339:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256913.470342:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098167680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256923 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256913.470598:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256913.470601:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256913.470603:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256913.470607:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098167552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256929 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256913.470613:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098167552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256929 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256913.470631:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734256913.470635:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734256913.470638:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:2.0:1734256913.470776:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256913.470780:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256913.470781:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256913.470785:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098167680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256923 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256913.470790:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098167680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256923 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256913.470813:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734256913.470816:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734256913.470819:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:0.0:1734256913.726787:0:6035:0:(lib-lnet.h:476:lnet_rspt_free()) free 'rspt': 56 at ffff8800b62004d0. 00000400:00000010:0.0:1734256913.726798:0:6035:0:(lib-lnet.h:476:lnet_rspt_free()) free 'rspt': 56 at ffff8800b62881c0. 00000800:00000100:2.0:1734256915.724684:0:6030:0:(socklnd_cb.c:423:ksocknal_txlist_done()) Deleting packet type 2 len 0 0@<0:0>->1.2.3.4@tcp 00000800:00000010:2.0:1734256915.724689:0:6030:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 232 at ffff8800b34d4100. 00000400:00000200:2.0:1734256915.724695:0:6030:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = -110, hstatus = 10 00000400:00000200:2.0:1734256915.724699:0:6030:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->1.2.3.4@tcp: GET: NETWORK_TIMEOUT 00000400:00000200:2.0:1734256915.724706:0:6030:0:(peer.c:3101:lnet_discovery_event_handler()) Received event: 5 00000400:00000200:2.0:1734256915.724708:0:6030:0:(peer.c:3053:lnet_discovery_event_send()) Ping Send to 1.2.3.4@tcp: 1 00000400:00000200:2.0:1734256915.724712:0:6030:0:(peer.c:2425:lnet_peer_queue_for_discovery()) Queue peer 1.2.3.4@tcp: -114 00000400:00000200:0.0:1734256915.725338:0:6036:0:(peer.c:4014:lnet_peer_discovery_wait_for_work()) woken: 0 00000400:00000200:0.0:1734256915.725342:0:6036:0:(peer.c:4126:lnet_peer_discovery()) peer 1.2.3.4@tcp(ffff8800b60e5400) state 0x100841 00000400:00000200:0.0:1734256915.725348:0:6036:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:0.0:1734256915.725350:0:6036:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000400:00000200:0.0:1734256915.725353:0:6036:0:(peer.c:3101:lnet_discovery_event_handler()) Received event: 6 00000400:00000200:0.0:1734256915.725355:0:6036:0:(peer.c:2425:lnet_peer_queue_for_discovery()) Queue peer 1.2.3.4@tcp: -114 00000400:00000010:0.0:1734256915.725357:0:6036:0:(api-ni.c:1799:lnet_ping_buffer_free()) kfreed 'pbuf': 281 at ffff8800a9c3b400. 00000400:00000200:0.0:1734256915.725361:0:6036:0:(peer.c:3773:lnet_peer_ping_failed()) peer 1.2.3.4@tcp:-110 00000400:00000200:0.0:1734256915.725363:0:6036:0:(peer.c:4148:lnet_peer_discovery()) peer 1.2.3.4@tcp(ffff8800b60e5400) state 0x102041 rc -110 00000400:00000200:0.0:1734256915.725365:0:6036:0:(peer.c:2441:lnet_peer_discovery_complete()) Discovery complete. Dequeue peer 1.2.3.4@tcp 00000100:00000010:0.0:1734256918.475711:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734256918.475729:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734256918.475782:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734256918.475787:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734256918.475870:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 02000000:00000010:2.0:1734256918.475870:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:1.0:1734256918.475876:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:2.0:1734256918.475876:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:1.0:1734256918.475882:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:2.0:1734256918.475882:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256918.475888:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098167936, portal 10 00000100:00000200:1.0:1734256918.475890:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098167808, portal 25 00000400:00000010:1.0:1734256918.475893:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734256918.475899:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098167808, offset 0 00000400:00000200:1.0:1734256918.475906:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256918.475916:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256918.475920:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256918.475923:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256918.475926:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256918.475927:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256918.475930:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [43:43:256:4294967295] 192.168.202.108@tcp LPNI seq info [42:42:8:4294967295] 00000400:00000200:1.0:1734256918.475937:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256918.475941:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734256918.475944:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734256918.475948:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734256918.475962:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734256918.475965:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734256918.476063:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734256918.476066:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:3.0:1734256918.476069:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734256918.476077:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734256918.476080:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:3.0:1734256918.476109:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:3.0:1734256918.476116:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098167808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256934 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256918.476160:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734256918.476163:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098167936, offset 0 00000400:00000200:2.0:1734256918.476171:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256918.476176:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256918.476178:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256918.476180:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256918.476182:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256918.476183:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256918.476185:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [44:44:256:4294967295] 192.168.202.108@tcp LPNI seq info [43:43:8:4294967295] 00000400:00000200:2.0:1734256918.476191:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256918.476195:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256918.476198:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734256918.476200:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256918.476204:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256918.476206:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734256918.476343:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256918.476346:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734256918.476348:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256918.476352:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256918.476354:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:1.0:1734256918.476355:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:1.0:1734256918.476358:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098167936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256928 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256918.477599:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256918.477610:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601400 00000400:00000200:0.0:1734256918.477616:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x24d [1] + 224 00000400:00000200:0.0:1734256918.477624:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256918.477627:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256918.477633:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098167808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256934 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256918.477664:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256918.477669:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601480 00000400:00000200:0.0:1734256918.477672:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x249 [1] + 0 00000400:00000200:0.0:1734256918.477690:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256918.477693:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256918.477697:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098167936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256928 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256918.477750:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256918.477757:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256918.477758:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256918.477762:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098167936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256928 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256918.477768:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098167936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256928 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256918.477789:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734256918.477793:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734256918.477797:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:1.0:1734256918.477833:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734256918.477837:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256918.477838:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256918.477841:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098167808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256934 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256918.477847:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098167808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256934 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256918.477858:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734256918.477860:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734256918.477862:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734256923.483734:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734256923.483758:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734256923.484456:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734256923.484465:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734256923.484482:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734256923.484490:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734256923.484497:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256923.484504:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098168064, portal 25 00000400:00000010:2.0:1734256923.484509:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734256923.484510:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098168064, offset 0 00000400:00000200:2.0:1734256923.484519:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256923.484534:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256923.484539:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256923.484543:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256923.484546:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256923.484549:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256923.484552:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [45:45:256:4294967295] 192.168.202.108@tcp LPNI seq info [44:44:8:4294967295] 00000400:00000200:2.0:1734256923.484560:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256923.484566:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256923.484588:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734256923.484594:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256923.484602:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256923.484606:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:0.0:1734256923.484613:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734256923.484617:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d503c8. 00000400:00000010:0.0:1734256923.484620:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734256923.484623:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098168192, portal 10 00000400:00000010:0.0:1734256923.484627:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:0.0:1734256923.484628:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098168192, offset 0 00000400:00000200:0.0:1734256923.484632:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256923.484636:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256923.484639:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256923.484640:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256923.484642:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256923.484643:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256923.484645:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [46:46:255:4294967295] 192.168.202.108@tcp LPNI seq info [45:45:7:4294967295] 00000400:00000200:0.0:1734256923.484650:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256923.484652:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256923.484654:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734256923.484656:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256923.484659:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256923.484660:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734256923.484717:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256923.484720:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:2.0:1734256923.484722:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256923.484740:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734256923.484743:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:2.0:1734256923.484745:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734256923.484750:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098168064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256939 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734256923.484780:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256923.484786:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:2.0:1734256923.484788:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256923.484791:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734256923.484793:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:2.0:1734256923.484794:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:2.0:1734256923.484797:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098168192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256933 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256923.488189:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256923.488209:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601500 00000400:00000200:0.0:1734256923.488217:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x259 [1] + 224 00000400:00000200:0.0:1734256923.488247:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256923.488252:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256923.488262:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098168064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256939 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256923.488495:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256923.488500:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256923.488502:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256923.488507:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098168064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256939 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256923.488515:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098168064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256939 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256923.488537:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734256923.488542:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734256923.488545:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:0.0:1734256923.490229:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256923.490243:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601580 00000400:00000200:0.0:1734256923.490249:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x261 [1] + 0 00000400:00000200:0.0:1734256923.490261:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256923.490264:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256923.490272:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098168192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256933 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256923.490886:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d503c8. 00000400:00000200:2.0:1734256923.490892:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:2.0:1734256923.490893:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:2.0:1734256923.490899:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098168192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256933 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256923.490906:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098168192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256933 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256923.490932:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734256923.490943:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734256923.490946:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734256928.491660:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734256928.491678:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734256928.491729:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734256928.491735:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734256928.491772:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734256928.491778:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50420. 00000400:00000010:0.0:1734256928.491784:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000100:00000200:0.0:1734256928.491789:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098168448, portal 10 00000400:00000010:0.0:1734256928.491794:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734256928.491796:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098168448, offset 0 00000400:00000200:0.0:1734256928.491803:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256928.491814:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256928.491818:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256928.491821:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256928.491824:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256928.491825:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256928.491827:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [47:47:256:4294967295] 192.168.202.108@tcp LPNI seq info [46:46:8:4294967295] 00000400:00000200:0.0:1734256928.491835:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256928.491854:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256928.491857:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734256928.491861:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256928.491868:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256928.491871:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734256928.491959:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256928.491962:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:0.0:1734256928.491964:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256928.491968:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256928.491970:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:0.0:1734256928.491972:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734256928.491977:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098168448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256938 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256928.492193:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734256928.492197:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734256928.492199:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256928.492202:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098168320, portal 25 00000400:00000010:2.0:1734256928.492204:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734256928.492205:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098168320, offset 0 00000400:00000200:2.0:1734256928.492209:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256928.492213:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256928.492215:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256928.492217:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256928.492218:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256928.492220:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256928.492221:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [48:48:256:4294967295] 192.168.202.108@tcp LPNI seq info [47:47:8:4294967295] 00000400:00000200:2.0:1734256928.492227:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256928.492229:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256928.492231:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734256928.492233:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256928.492236:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256928.492238:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734256928.492560:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256928.492562:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734256928.492565:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256928.492582:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256928.492584:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734256928.492585:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734256928.492588:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098168320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256944 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256928.495442:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256928.495457:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601600 00000400:00000200:0.0:1734256928.495464:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x271 [1] + 224 00000400:00000200:0.0:1734256928.495473:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256928.495476:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256928.495484:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098168320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256944 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256928.495516:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256928.495520:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601680 00000400:00000200:0.0:1734256928.495533:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x269 [1] + 0 00000400:00000200:0.0:1734256928.495543:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256928.495545:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256928.495549:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098168448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256938 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734256928.495641:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50420. 00000400:00000200:1.0:1734256928.495651:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:1.0:1734256928.495653:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:1.0:1734256928.495662:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098168448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256938 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256928.495671:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098168448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256938 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256928.495702:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:1.0:1734256928.495708:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734256928.495713:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:2.0:1734256928.495792:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256928.495796:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256928.495798:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256928.495802:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098168320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256944 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256928.495808:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098168320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256944 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256928.495824:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734256928.495827:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734256928.495830:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734256933.499831:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734256933.499857:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734256933.500513:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734256933.500521:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734256933.500549:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 02000000:00000010:0.0:1734256933.500554:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734256933.500562:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50478. 00000400:00000010:1.0:1734256933.500565:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:0.0:1734256933.500583:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734256933.500591:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098168704, portal 10 00000400:00000010:1.0:1734256933.500595:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256933.500597:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098168576, portal 25 00000400:00000010:0.0:1734256933.500599:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000400:00000010:1.0:1734256933.500600:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734256933.500601:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098168704, offset 0 00000100:00000200:1.0:1734256933.500601:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098168576, offset 0 00000400:00000200:0.0:1734256933.500610:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256933.500631:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256933.500637:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256933.500641:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256933.500644:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256933.500646:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256933.500649:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [49:49:256:4294967295] 192.168.202.108@tcp LPNI seq info [48:48:8:4294967295] 00000400:00000200:0.0:1734256933.500658:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256933.500664:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256933.500668:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734256933.500674:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256933.500681:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256933.500685:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734256933.500705:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256933.500709:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256933.500711:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256933.500712:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256933.500714:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256933.500715:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256933.500717:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [50:50:255:4294967295] 192.168.202.108@tcp LPNI seq info [49:49:7:4294967295] 00000400:00000200:1.0:1734256933.500722:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256933.500724:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734256933.500726:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734256933.500728:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734256933.500731:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734256933.500733:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734256933.500742:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256933.500749:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:0.0:1734256933.500754:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256933.500758:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256933.500761:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:0.0:1734256933.500763:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734256933.500770:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098168704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256943 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734256933.500838:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256933.500841:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734256933.500844:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256933.500847:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256933.500849:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734256933.500850:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734256933.500854:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098168576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256949 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256933.504109:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256933.504128:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601780 00000400:00000200:0.0:1734256933.504137:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x279 [1] + 0 00000400:00000200:0.0:1734256933.504158:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256933.504162:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256933.504172:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098168704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256943 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256933.505632:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256933.505644:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601700 00000400:00000200:0.0:1734256933.505650:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x27d [1] + 224 00000400:00000200:0.0:1734256933.505662:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256933.505669:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256933.505675:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098168576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256949 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734256933.505781:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734256933.505786:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256933.505792:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256933.505797:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098168576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256949 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256933.505808:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098168576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256949 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256933.505842:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734256933.505848:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734256933.505852:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:2.0:1734256933.505900:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50478. 00000400:00000200:2.0:1734256933.505905:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:2.0:1734256933.505907:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:2.0:1734256933.505914:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098168704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256943 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256933.505920:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098168704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256943 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256933.505941:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734256933.505946:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734256933.505949:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734256938.507867:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734256938.507896:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734256938.507959:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734256938.507965:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734256938.508012:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734256938.508023:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734256938.508030:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 02000000:00000010:2.0:1734256938.508038:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734256938.508045:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000100:00000200:1.0:1734256938.508046:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098168832, portal 25 00000400:00000010:2.0:1734256938.508050:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000400:00000010:1.0:1734256938.508052:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734256938.508056:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098168832, offset 0 00000100:00000200:2.0:1734256938.508056:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098168960, portal 10 00000400:00000010:2.0:1734256938.508062:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000400:00000200:1.0:1734256938.508065:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734256938.508071:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098168960, offset 0 00000400:00000200:1.0:1734256938.508077:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256938.508079:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256938.508082:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256938.508086:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256938.508089:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256938.508091:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256938.508094:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [51:51:256:4294967295] 192.168.202.108@tcp LPNI seq info [50:50:8:4294967295] 00000400:00000200:1.0:1734256938.508102:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256938.508108:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256938.508111:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734256938.508113:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000400:00000200:2.0:1734256938.508116:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734256938.508119:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734256938.508119:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256938.508122:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256938.508124:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256938.508127:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [52:52:255:4294967295] 192.168.202.108@tcp LPNI seq info [51:51:7:4294967295] 00000800:00000200:1.0:1734256938.508128:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734256938.508132:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734256938.508134:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256938.508140:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256938.508148:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734256938.508152:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256938.508158:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256938.508161:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734256938.508873:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256938.508877:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734256938.508881:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256938.508886:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256938.508891:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734256938.508893:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734256938.508900:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098168832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256954 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734256938.508983:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256938.508985:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734256938.508988:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256938.508991:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256938.508993:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734256938.508994:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734256938.508998:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098168960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256948 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256938.512363:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256938.512383:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601880 00000400:00000200:0.0:1734256938.512394:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x28d [1] + 0 00000400:00000200:0.0:1734256938.512417:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256938.512421:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256938.512431:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098168960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256948 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256938.512541:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256938.512554:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256938.512557:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256938.512562:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098168960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256948 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256938.513514:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098168960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256948 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256938.513549:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734256938.513555:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734256938.513561:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734256938.514505:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256938.514516:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601800 00000400:00000200:0.0:1734256938.514526:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x289 [1] + 224 00000400:00000200:0.0:1734256938.514539:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256938.514548:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256938.514554:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098168832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256954 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734256938.515321:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734256938.515327:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256938.515329:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256938.515336:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098168832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256954 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256938.515343:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098168832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256954 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256938.515362:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734256938.515367:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734256938.515370:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734256943.515860:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734256943.515907:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734256943.515955:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734256943.515960:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734256943.515998:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734256943.516003:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d504d0. 00000400:00000010:0.0:1734256943.516008:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 02000000:00000010:3.0:1734256943.516008:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000100:00000200:0.0:1734256943.516014:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098169216, portal 10 00000400:00000010:3.0:1734256943.516018:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:0.0:1734256943.516019:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734256943.516021:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098169216, offset 0 00000400:00000010:3.0:1734256943.516024:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000200:0.0:1734256943.516029:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256943.516039:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256943.516043:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256943.516047:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256943.516049:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256943.516051:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256943.516054:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [53:53:256:4294967295] 192.168.202.108@tcp LPNI seq info [52:52:8:4294967295] 00000400:00000200:0.0:1734256943.516060:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256943.516065:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256943.516067:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000800:00000200:0.0:1734256943.516072:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256943.516078:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256943.516082:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:3.0:1734256943.516273:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098169088, portal 25 00000400:00000010:3.0:1734256943.516278:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734256943.516280:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098169088, offset 0 00000400:00000200:3.0:1734256943.516287:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256943.516300:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256943.516304:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256943.516307:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256943.516310:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256943.516312:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256943.516314:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [54:54:255:4294967295] 192.168.202.108@tcp LPNI seq info [53:53:7:4294967295] 00000400:00000200:3.0:1734256943.516321:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256943.516325:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256943.516329:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734256943.516333:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256943.516339:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256943.516342:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734256943.516353:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256943.516356:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734256943.516360:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256943.516364:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256943.516368:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:1.0:1734256943.516378:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:1.0:1734256943.516385:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098169216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256953 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734256943.516546:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256943.516548:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:1.0:1734256943.516550:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256943.516552:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256943.516554:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:1.0:1734256943.516555:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734256943.516559:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098169088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256959 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256943.519326:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256943.519344:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601900 00000400:00000200:0.0:1734256943.519352:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a1 [1] + 224 00000400:00000200:0.0:1734256943.519363:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256943.519376:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256943.519385:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098169088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256959 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256943.519425:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256943.519429:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601980 00000400:00000200:0.0:1734256943.519434:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x299 [1] + 0 00000400:00000200:0.0:1734256943.519450:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256943.519453:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256943.519458:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098169216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256953 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734256943.519559:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d504d0. 00000400:00000200:1.0:1734256943.519564:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:1.0:1734256943.519565:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:1.0:1734256943.519592:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098169216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256953 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256943.519598:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098169216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256953 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256943.519628:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734256943.519633:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734256943.519637:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:3.0:1734256943.520611:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256943.520617:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256943.520618:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256943.520624:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098169088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256959 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256943.520632:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098169088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256959 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256943.520655:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734256943.520659:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734256943.520662:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734256948.523681:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734256948.523701:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734256948.523755:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734256948.523762:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734256948.523777:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734256948.523783:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734256948.523788:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256948.523793:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098169344, portal 25 00000400:00000010:2.0:1734256948.523797:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734256948.523798:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098169344, offset 0 00000400:00000200:2.0:1734256948.523805:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256948.523815:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256948.523818:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256948.523821:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256948.523824:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256948.523826:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256948.523828:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [55:55:256:4294967295] 192.168.202.108@tcp LPNI seq info [54:54:8:4294967295] 00000400:00000200:2.0:1734256948.523834:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256948.523864:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256948.523867:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734256948.523871:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256948.523878:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256948.523880:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734256948.524005:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256948.524007:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734256948.524011:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256948.524014:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256948.524017:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734256948.524019:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734256948.524024:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098169344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256964 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256948.524133:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734256948.524142:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734256948.524147:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256948.524152:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098169472, portal 10 00000400:00000010:1.0:1734256948.524158:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734256948.524160:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098169472, offset 0 00000400:00000200:1.0:1734256948.524166:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256948.524176:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256948.524179:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256948.524182:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256948.524185:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256948.524198:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256948.524201:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [56:56:256:4294967295] 192.168.202.108@tcp LPNI seq info [55:55:8:4294967295] 00000400:00000200:1.0:1734256948.524208:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256948.524213:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734256948.524216:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734256948.524220:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734256948.524226:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734256948.524228:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734256948.524303:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256948.524305:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:2.0:1734256948.524307:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256948.524319:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734256948.524321:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:2.0:1734256948.524323:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:2.0:1734256948.524327:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098169472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256958 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256948.525718:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256948.525730:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601a00 00000400:00000200:0.0:1734256948.525735:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a9 [1] + 224 00000400:00000200:0.0:1734256948.525750:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256948.525754:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256948.525760:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098169344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256964 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256948.525998:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256948.526001:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256948.526002:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256948.526006:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098169344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256964 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256948.526013:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098169344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256964 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256948.526028:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734256948.526031:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734256948.526034:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734256948.526454:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256948.526460:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601a80 00000400:00000200:0.0:1734256948.526467:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b1 [1] + 0 00000400:00000200:0.0:1734256948.526477:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256948.526479:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256948.526484:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098169472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256958 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734256948.526753:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734256948.526757:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256948.526758:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256948.526763:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098169472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256958 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256948.526832:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098169472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256958 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256948.526860:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734256948.526864:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734256948.526867:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734256953.534928:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734256953.534953:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734256953.535011:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734256953.535016:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734256953.535246:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734256953.535254:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734256953.535261:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256953.535268:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098169600, portal 25 00000400:00000010:2.0:1734256953.535272:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734256953.535274:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098169600, offset 0 00000400:00000200:2.0:1734256953.535283:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256953.535297:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256953.535302:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256953.535306:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256953.535309:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256953.535312:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256953.535314:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [57:57:256:4294967295] 192.168.202.108@tcp LPNI seq info [56:56:8:4294967295] 00000400:00000200:2.0:1734256953.535323:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256953.535328:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256953.535331:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734256953.535348:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256953.535356:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256953.535360:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734256953.535616:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256953.535618:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:2.0:1734256953.535621:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256953.535625:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734256953.535629:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:2.0:1734256953.535631:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734256953.535637:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098169600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256969 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256953.535746:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734256953.535750:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734256953.535753:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256953.535756:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098169728, portal 10 00000400:00000010:1.0:1734256953.535760:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734256953.535761:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098169728, offset 0 00000400:00000200:1.0:1734256953.535765:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256953.535770:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256953.535772:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256953.535774:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256953.535776:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256953.535777:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256953.535784:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [58:58:256:4294967295] 192.168.202.108@tcp LPNI seq info [57:57:8:4294967295] 00000400:00000200:1.0:1734256953.535790:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256953.535794:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734256953.535796:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734256953.535808:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734256953.535812:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734256953.535814:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734256953.535891:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256953.535893:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734256953.535895:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256953.535898:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256953.535900:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:0.0:1734256953.535901:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734256953.535904:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098169728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256963 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256953.537952:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256953.537968:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601b00 00000400:00000200:0.0:1734256953.537977:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b9 [1] + 224 00000400:00000200:0.0:1734256953.537998:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256953.538001:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256953.538011:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098169600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256969 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256953.538098:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256953.538103:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256953.538104:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256953.538109:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098169600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256969 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256953.538116:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098169600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256969 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256953.538141:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734256953.538145:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:2.0:1734256953.538150:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734256953.539538:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256953.539550:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601b80 00000400:00000200:0.0:1734256953.539565:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c1 [1] + 0 00000400:00000200:0.0:1734256953.539604:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256953.539607:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256953.539615:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098169728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256963 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734256953.541061:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734256953.541067:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256953.541069:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256953.541075:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098169728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256963 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256953.541083:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098169728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256963 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:1.0:1734256953.541102:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:1.0:1734256953.543926:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734256953.543939:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734256953.543945:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734256958.539716:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734256958.539742:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 02000000:00000010:2.0:1734256958.540066:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734256958.540075:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734256958.540081:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256958.540089:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098169856, portal 25 00000400:00000010:2.0:1734256958.540094:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734256958.540096:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098169856, offset 0 00000400:00000200:2.0:1734256958.540105:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256958.540120:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256958.540126:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256958.540129:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256958.540132:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256958.540148:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256958.540152:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [59:59:256:4294967295] 192.168.202.108@tcp LPNI seq info [58:58:8:4294967295] 00000400:00000200:2.0:1734256958.540161:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256958.540166:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256958.540170:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734256958.540176:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256958.540189:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256958.540193:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734256958.540393:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734256958.540411:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734256958.540647:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734256958.540654:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50528. 00000400:00000010:0.0:1734256958.540659:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000100:00000200:0.0:1734256958.540665:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098169984, portal 10 00000400:00000010:0.0:1734256958.540669:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734256958.540671:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098169984, offset 0 00000400:00000200:0.0:1734256958.540679:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256958.540688:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256958.540692:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256958.540696:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256958.540698:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256958.540700:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256958.540702:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [60:60:255:4294967295] 192.168.202.108@tcp LPNI seq info [59:59:7:4294967295] 00000400:00000200:0.0:1734256958.540709:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256958.540713:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256958.540717:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734256958.540721:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256958.540728:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256958.540731:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734256958.540733:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256958.540736:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734256958.540740:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256958.540746:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256958.540750:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:1.0:1734256958.540752:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:1.0:1734256958.540771:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098169856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256974 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734256958.540821:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256958.540823:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734256958.540826:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256958.540829:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256958.540837:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:1.0:1734256958.540838:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:1.0:1734256958.540843:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098169984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256968 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256958.547771:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256958.547799:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601c00 00000400:00000200:0.0:1734256958.547807:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c9 [1] + 224 00000400:00000200:0.0:1734256958.547819:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256958.547823:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256958.547832:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098169856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256974 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256958.547873:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256958.547877:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601c80 00000400:00000200:0.0:1734256958.547882:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d1 [1] + 0 00000400:00000200:0.0:1734256958.547896:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256958.547899:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256958.547903:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098169984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256968 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256958.548075:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256958.548080:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256958.548082:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256958.548087:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098169856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256974 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256958.548093:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098169856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256974 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256958.548119:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734256958.548123:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734256958.548127:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:1.0:1734256958.548194:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50528. 00000400:00000200:1.0:1734256958.548197:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:1.0:1734256958.548198:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:1.0:1734256958.548202:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098169984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256968 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256958.548208:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098169984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256968 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256958.548225:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:1.0:1734256958.548227:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734256958.548229:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734256963.547707:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734256963.547742:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734256963.547805:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734256963.547813:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734256963.547849:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734256963.547859:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256963.547865:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256963.547870:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098170112, portal 25 00000400:00000010:3.0:1734256963.547874:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734256963.547875:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098170112, offset 0 00000400:00000200:3.0:1734256963.547882:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256963.547893:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256963.547897:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256963.547900:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256963.547903:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256963.547905:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256963.547907:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [61:61:256:4294967295] 192.168.202.108@tcp LPNI seq info [60:60:8:4294967295] 00000400:00000200:3.0:1734256963.547915:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256963.547919:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256963.547922:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734256963.547926:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256963.547932:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256963.547935:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734256963.548074:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256963.548077:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734256963.548080:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256963.548084:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256963.548088:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734256963.548089:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734256963.548094:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098170112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256979 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256963.549566:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734256963.549614:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734256963.549620:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256963.549624:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098170240, portal 10 00000400:00000010:1.0:1734256963.549629:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734256963.549631:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098170240, offset 0 00000400:00000200:1.0:1734256963.549637:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256963.549645:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256963.549649:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256963.549651:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256963.549654:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256963.549655:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256963.549658:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [62:62:256:4294967295] 192.168.202.108@tcp LPNI seq info [61:61:8:4294967295] 00000400:00000200:1.0:1734256963.549666:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256963.549670:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734256963.549674:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734256963.549689:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734256963.549695:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734256963.549698:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734256963.549833:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256963.549836:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:2.0:1734256963.549839:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256963.549842:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734256963.549845:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:2.0:1734256963.549846:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:2.0:1734256963.549852:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098170240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256973 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256963.550157:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256963.550166:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601d00 00000400:00000200:0.0:1734256963.550172:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d9 [1] + 224 00000400:00000200:0.0:1734256963.550185:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256963.550192:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256963.550196:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098170112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256979 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256963.550269:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256963.550272:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256963.550273:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256963.550277:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098170112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256979 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256963.550283:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098170112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256979 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256963.550299:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734256963.550308:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734256963.550311:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734256963.553124:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256963.553139:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601d80 00000400:00000200:0.0:1734256963.553153:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2e1 [1] + 0 00000400:00000200:0.0:1734256963.553171:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256963.553175:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256963.553184:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098170240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256973 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734256963.553396:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734256963.553400:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256963.553402:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256963.553407:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098170240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256973 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256963.553414:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098170240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256973 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256963.553436:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734256963.553440:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734256963.553444:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734256968.555776:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734256968.555793:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734256968.555840:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734256968.555845:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734256968.555911:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 02000000:00000010:1.0:1734256968.555914:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734256968.555919:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:2.0:1734256968.555919:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:1.0:1734256968.555924:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:2.0:1734256968.555924:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256968.555929:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098170368, portal 25 00000100:00000200:1.0:1734256968.555934:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098170496, portal 10 00000400:00000010:2.0:1734256968.555943:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000400:00000010:1.0:1734256968.555944:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:1.0:1734256968.555945:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098170496, offset 0 00000100:00000200:2.0:1734256968.555945:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098170368, offset 0 00000400:00000200:1.0:1734256968.555952:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256968.555957:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256968.555962:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256968.555966:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256968.555970:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256968.555972:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256968.555974:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256968.555977:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [63:63:256:4294967295] 192.168.202.108@tcp LPNI seq info [62:62:8:4294967295] 00000400:00000200:1.0:1734256968.555984:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256968.555989:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256968.555990:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256968.555992:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734256968.555993:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000400:00000200:2.0:1734256968.555994:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256968.555996:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256968.555997:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256968.555999:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [64:64:255:4294967295] 192.168.202.108@tcp LPNI seq info [63:63:7:4294967295] 00000800:00000200:1.0:1734256968.556001:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734256968.556005:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256968.556008:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256968.556011:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:1.0:1734256968.556013:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256968.556014:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734256968.556016:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734256968.556017:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256968.556019:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734256968.556073:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734256968.556076:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:3.0:1734256968.556080:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734256968.556084:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734256968.556087:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:3.0:1734256968.556088:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:3.0:1734256968.556094:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098170496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256978 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734256968.556147:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734256968.556149:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734256968.556152:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734256968.556155:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734256968.556157:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:3.0:1734256968.556157:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:3.0:1734256968.556161:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098170368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256984 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256968.557743:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256968.557763:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601e00 00000400:00000200:0.0:1734256968.557770:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2e9 [1] + 224 00000400:00000200:0.0:1734256968.557792:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256968.557796:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256968.557806:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098170368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256984 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256968.557984:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256968.557991:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601e80 00000400:00000200:0.0:1734256968.557996:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2ed [1] + 0 00000400:00000200:0.0:1734256968.558007:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256968.558010:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256968.558015:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098170496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256978 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256968.558053:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256968.558058:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256968.558060:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256968.558065:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098170368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256984 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256968.558073:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098170368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256984 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256968.558094:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 00000400:00000010:1.0:1734256968.558095:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 02000000:00000010:2.0:1734256968.558099:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000400:00000200:1.0:1734256968.558102:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000100:00000010:2.0:1734256968.558102:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:1.0:1734256968.558103:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256968.558111:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098170496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256978 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256968.558119:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098170496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256978 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256968.558142:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734256968.558146:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734256968.558150:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734256973.563762:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734256973.563782:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734256973.563836:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734256973.563842:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734256973.563885:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734256973.563890:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50580. 00000400:00000010:0.0:1734256973.563896:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000100:00000200:0.0:1734256973.563902:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098170752, portal 10 00000400:00000010:0.0:1734256973.563907:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:0.0:1734256973.563908:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098170752, offset 0 00000400:00000200:0.0:1734256973.563915:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734256973.563930:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734256973.563934:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734256973.563938:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734256973.563940:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734256973.563942:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734256973.563945:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [65:65:256:4294967295] 192.168.202.108@tcp LPNI seq info [64:64:8:4294967295] 00000400:00000200:0.0:1734256973.563951:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734256973.563955:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734256973.563958:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734256973.563962:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734256973.563968:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734256973.563971:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734256973.564029:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734256973.564033:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256973.564036:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256973.564039:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098170624, portal 25 00000400:00000010:3.0:1734256973.564041:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734256973.564043:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098170624, offset 0 00000400:00000200:3.0:1734256973.564047:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256973.564051:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256973.564054:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256973.564056:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256973.564057:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256973.564059:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256973.564061:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [66:66:255:4294967295] 192.168.202.108@tcp LPNI seq info [65:65:7:4294967295] 00000400:00000200:3.0:1734256973.564066:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256973.564078:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734256973.564080:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734256973.564083:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256973.564086:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734256973.564088:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734256973.564131:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256973.564134:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:2.0:1734256973.564137:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256973.564141:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734256973.564147:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:2.0:1734256973.564148:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:2.0:1734256973.564158:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098170752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256983 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734256973.564211:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256973.564213:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:2.0:1734256973.564215:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256973.564217:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734256973.564219:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:2.0:1734256973.564221:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:2.0:1734256973.564224:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098170624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256989 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256973.570136:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256973.570156:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c601f00 00000400:00000200:0.0:1734256973.570165:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x301 [1] + 224 00000400:00000200:0.0:1734256973.570189:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256973.570193:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256973.570213:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098170624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256973.570319:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256973.570324:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256973.570326:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256973.570331:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098170624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256989 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256973.570337:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098170624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256989 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256973.570362:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734256973.570369:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734256973.570372:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734256973.571071:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256973.571078:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c601f80 00000400:00000200:0.0:1734256973.571083:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2f9 [1] + 0 00000400:00000200:0.0:1734256973.571095:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256973.571098:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256973.571104:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098170752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256983 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256973.571303:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50580. 00000400:00000200:2.0:1734256973.571307:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:2.0:1734256973.571308:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:2.0:1734256973.571313:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098170752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256983 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256973.571319:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098170752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256983 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256973.571337:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734256973.571340:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734256973.571344:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:2.0:1734256978.571882:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734256978.571908:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734256978.571972:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734256978.571979:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734256978.572012:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734256978.572012:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734256978.572018:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734256978.572025:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256978.572033:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098170880, portal 25 00000400:00000010:3.0:1734256978.572037:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734256978.572039:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098170880, offset 0 00000400:00000200:3.0:1734256978.572049:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256978.572064:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256978.572070:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256978.572073:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256978.572077:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256978.572079:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256978.572082:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [67:67:256:4294967295] 192.168.202.108@tcp LPNI seq info [66:66:8:4294967295] 00000400:00000200:3.0:1734256978.572090:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256978.572096:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734256978.572102:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734256978.572107:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256978.572109:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098171008, portal 10 00000800:00000010:3.0:1734256978.572113:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000400:00000010:2.0:1734256978.572114:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734256978.572115:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098171008, offset 0 00000400:00000200:2.0:1734256978.572119:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734256978.572119:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734256978.572127:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734256978.572128:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256978.572130:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:3.0:1734256978.572131:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734256978.572132:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256978.572134:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256978.572135:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256978.572137:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [68:68:255:4294967295] 192.168.202.108@tcp LPNI seq info [67:67:7:4294967295] 00000400:00000200:2.0:1734256978.572142:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256978.572145:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256978.572147:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734256978.572149:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256978.572152:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256978.572154:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734256978.572202:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256978.572205:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:2.0:1734256978.572207:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256978.572211:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734256978.572215:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:2.0:1734256978.572216:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:2.0:1734256978.572223:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098170880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256994 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734256978.572414:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734256978.572416:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:2.0:1734256978.572419:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734256978.572422:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734256978.572424:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734256978.572425:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734256978.572429:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098171008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256988 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256978.573883:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256978.573898:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602000 00000400:00000200:0.0:1734256978.573906:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x309 [1] + 224 00000400:00000200:0.0:1734256978.573915:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256978.573918:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256978.573927:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098170880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256994 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256978.573963:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256978.573966:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602080 00000400:00000200:0.0:1734256978.573971:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x311 [1] + 0 00000400:00000200:0.0:1734256978.573985:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256978.573988:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256978.573992:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098171008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256988 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256978.574068:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256978.574074:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256978.574076:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256978.574088:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098171008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256988 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256978.574088:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256978.574091:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256978.574093:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:2.0:1734256978.574096:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098171008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256988 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256978.574097:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098170880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256994 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256978.574105:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098170880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256994 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256978.574123:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734256978.574124:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734256978.574128:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 02000000:00000010:2.0:1734256978.574129:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734256978.574131:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734256978.574132:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000100:00000010:2.0:1734256983.580029:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734256983.580048:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734256983.580103:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734256983.580110:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734256983.580121:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734256983.580129:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 02000000:00000010:2.0:1734256983.580135:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:3.0:1734256983.580135:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000010:2.0:1734256983.580139:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000100:00000200:3.0:1734256983.580140:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098171136, portal 25 00000400:00000010:2.0:1734256983.580142:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256983.580144:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098171264, portal 10 00000400:00000010:3.0:1734256983.580144:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734256983.580146:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098171136, offset 0 00000400:00000010:2.0:1734256983.580148:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000200:3.0:1734256983.580154:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734256983.580158:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098171264, offset 0 00000400:00000200:2.0:1734256983.580162:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734256983.580165:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734256983.580170:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734256983.580173:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734256983.580176:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734256983.580178:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734256983.580180:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [69:69:256:4294967295] 192.168.202.108@tcp LPNI seq info [68:68:8:4294967295] 00000400:00000200:3.0:1734256983.580187:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734256983.580192:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256983.580193:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734256983.580195:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000400:00000200:2.0:1734256983.580196:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256983.580198:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256983.580200:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256983.580201:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256983.580203:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [70:70:255:4294967295] 192.168.202.108@tcp LPNI seq info [69:69:7:4294967295] 00000800:00000200:3.0:1734256983.580206:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734256983.580209:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256983.580212:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734256983.580212:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:2.0:1734256983.580214:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:3.0:1734256983.580214:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734256983.580217:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256983.580221:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256983.580223:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734256983.580267:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256983.580270:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734256983.580275:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256983.580278:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256983.580281:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:0.0:1734256983.580285:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:0.0:1734256983.580291:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098171136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256999 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734256983.580341:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256983.580343:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734256983.580344:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256983.580346:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256983.580347:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734256983.580348:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734256983.580350:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098171264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256993 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256983.581997:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256983.582008:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602100 00000400:00000200:0.0:1734256983.582014:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x319 [1] + 224 00000400:00000200:0.0:1734256983.582030:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256983.582033:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256983.582041:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098171136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256999 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734256983.582115:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734256983.582119:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734256983.582120:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734256983.582124:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098171136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256999 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256983.582131:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098171136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734256999 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256983.582148:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734256983.582153:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734256983.582156:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000400:00000200:0.0:1734256983.582395:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256983.582400:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602180 00000400:00000200:0.0:1734256983.582404:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x31d [1] + 0 00000400:00000200:0.0:1734256983.582411:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256983.582413:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256983.582416:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098171264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256993 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256983.582609:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256983.582614:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256983.582615:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256983.582620:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098171264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256993 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256983.582627:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098171264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256993 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256983.582642:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734256983.582646:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734256983.582648:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000100:1.0:1734256985.659687:0:6027:0:(lib-socket.c:436:lnet_sock_connect()) Error -110 connecting 1023 -> 1.2.3.4:988 00000400:00000100:1.0:1734256985.659736:0:6027:0:(acceptor.c:88:lnet_connect_console_error()) Connection to 1.2.3.4@tcp at host 1.2.3.4:988 took too long: that node may be hung or experiencing high load. 00000400:00000200:1.0:1734256985.659744:0:6027:0:(router.c:1668:lnet_notify()) 192.168.202.8@tcp notifying 1.2.3.4@tcp: down 00000800:00000200:1.0:1734256985.659751:0:6027:0:(socklnd.c:1718:ksocknal_notify_gw_down()) gw 1.2.3.4@tcp down 00000100:00000010:0.0:1734256988.587848:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734256988.587866:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 02000000:00000010:2.0:1734256988.587995:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000400:00000010:2.0:1734256988.588002:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734256988.588008:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000010:0.0:1734256988.588009:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 00000100:00000200:2.0:1734256988.588014:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098171392, portal 25 02000000:00000010:0.0:1734256988.588015:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 00000400:00000010:2.0:1734256988.588017:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734256988.588019:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098171392, offset 0 00000400:00000200:2.0:1734256988.588026:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256988.588037:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256988.588042:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256988.588045:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256988.588048:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256988.588050:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256988.588053:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [71:71:256:4294967295] 192.168.202.108@tcp LPNI seq info [70:70:8:4294967295] 00000400:00000200:2.0:1734256988.588060:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256988.588065:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256988.588068:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734256988.588073:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256988.588080:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256988.588083:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734256988.588125:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734256988.588133:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c948. 00000400:00000010:2.0:1734256988.588136:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734256988.588138:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098171520, portal 10 00000400:00000010:2.0:1734256988.588141:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734256988.588142:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098171520, offset 0 00000400:00000200:2.0:1734256988.588146:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256988.588150:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256988.588152:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256988.588154:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256988.588156:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256988.588157:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256988.588159:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [72:72:255:4294967295] 192.168.202.108@tcp LPNI seq info [71:71:7:4294967295] 00000400:00000200:2.0:1734256988.588164:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256988.588168:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256988.588170:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734256988.588173:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256988.588176:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256988.588178:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734256988.588267:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256988.588270:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734256988.588274:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256988.588278:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256988.588282:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:1.0:1734256988.588283:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:1.0:1734256988.588290:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098171392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734256988.588348:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734256988.588350:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734256988.588352:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734256988.588355:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734256988.588357:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:1.0:1734256988.588358:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:1.0:1734256988.588361:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098171520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256998 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256988.590411:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256988.590429:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602200 00000400:00000200:0.0:1734256988.590438:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x329 [1] + 224 00000400:00000200:0.0:1734256988.590456:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256988.590460:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256988.590470:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098171392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257004 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256988.590506:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256988.590510:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602280 00000400:00000200:0.0:1734256988.590530:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x331 [1] + 0 00000400:00000200:0.0:1734256988.590550:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256988.590553:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256988.590558:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098171520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256998 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256988.590694:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256988.590703:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256988.590705:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256988.590713:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098171392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256988.590721:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098171392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257004 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256988.590739:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:2.0:1734256988.590743:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734256988.590746:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:3.0:1734256988.590870:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c948. 00000400:00000200:3.0:1734256988.590875:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:3.0:1734256988.590877:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:3.0:1734256988.590882:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098171520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256998 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734256988.590889:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098171520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734256998 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734256988.590913:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734256988.590918:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734256988.590922:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:0.0:1734256988.745695:0:6035:0:(lib-lnet.h:476:lnet_rspt_free()) free 'rspt': 56 at ffff8800ab6681f8. 00000100:00000010:0.0:1734256993.595718:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734256993.595742:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734256993.595808:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734256993.595816:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734256993.595923:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734256993.595925:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734256993.595933:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:2.0:1734256993.595935:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:1.0:1734256993.595940:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:2.0:1734256993.595941:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:1.0:1734256993.595947:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098171648, portal 25 00000400:00000010:1.0:1734256993.595952:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734256993.595954:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098171648, offset 0 00000100:00000200:2.0:1734256993.595958:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098171776, portal 10 00000400:00000200:1.0:1734256993.595964:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734256993.595964:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734256993.595968:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098171776, offset 0 00000400:00000200:2.0:1734256993.595976:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256993.595979:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256993.595984:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256993.595995:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256993.596002:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256993.596004:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256993.596006:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [73:73:256:4294967295] 192.168.202.108@tcp LPNI seq info [72:72:8:4294967295] 00000400:00000200:1.0:1734256993.596019:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256993.596025:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734256993.596028:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000400:00000200:2.0:1734256993.596029:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256993.596034:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734256993.596035:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734256993.596040:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734256993.596043:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734256993.596043:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256993.596045:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734256993.596047:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734256993.596047:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [74:74:255:4294967295] 192.168.202.108@tcp LPNI seq info [73:73:7:4294967295] 00000400:00000200:2.0:1734256993.596055:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256993.596060:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256993.596063:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734256993.596068:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256993.596074:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256993.596078:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734256993.596187:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256993.596190:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734256993.596195:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256993.596199:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256993.596203:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:0.0:1734256993.596205:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:0.0:1734256993.596213:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098171648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734256993.596285:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256993.596287:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734256993.596290:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256993.596301:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256993.596304:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734256993.596305:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734256993.596309:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098171776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257003 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256993.598717:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256993.598733:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602380 00000400:00000200:0.0:1734256993.598741:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x341 [1] + 0 00000400:00000200:0.0:1734256993.598751:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256993.598754:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256993.598763:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098171776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257003 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256993.598794:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256993.598799:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602300 00000400:00000200:0.0:1734256993.598803:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x339 [1] + 224 00000400:00000200:0.0:1734256993.598816:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256993.598819:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256993.598823:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098171648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257009 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256993.598933:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256993.598943:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256993.598945:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256993.598954:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098171776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257003 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256993.599256:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098171776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257003 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256993.599285:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734256993.599291:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734256993.599295:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:1.0:1734256993.600514:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734256993.600521:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256993.600523:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256993.600530:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098171648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257009 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256993.600538:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098171648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257009 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256993.600560:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734256993.600564:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734256993.600586:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734256998.603669:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734256998.603687:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734256998.603733:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734256998.603737:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734256998.603810:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734256998.603816:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734256998.603821:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256998.603825:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098172032, portal 10 00000400:00000010:2.0:1734256998.603838:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734256998.603840:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098172032, offset 0 00000400:00000200:2.0:1734256998.603846:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734256998.603856:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734256998.603859:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734256998.603862:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734256998.603864:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734256998.603866:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734256998.603868:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [75:75:256:4294967295] 192.168.202.108@tcp LPNI seq info [74:74:8:4294967295] 00000400:00000200:2.0:1734256998.603873:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734256998.603877:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734256998.603879:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734256998.603883:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734256998.603888:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734256998.603890:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734256998.603949:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734256998.603953:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734256998.603955:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256998.603956:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098171904, portal 25 00000400:00000010:1.0:1734256998.603958:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734256998.603959:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098171904, offset 0 00000400:00000200:1.0:1734256998.603962:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734256998.603965:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734256998.603966:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734256998.603967:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734256998.603968:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734256998.603969:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734256998.603971:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [76:76:255:4294967295] 192.168.202.108@tcp LPNI seq info [75:75:7:4294967295] 00000400:00000200:1.0:1734256998.603974:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734256998.603976:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734256998.603978:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734256998.603980:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734256998.603982:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734256998.603983:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734256998.604299:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256998.604302:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734256998.604305:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256998.604309:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256998.604313:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734256998.604314:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734256998.604324:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098172032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257008 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734256998.604382:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734256998.604384:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734256998.604386:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256998.604388:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734256998.604390:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734256998.604391:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734256998.604394:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098171904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256998.608394:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256998.608409:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602480 00000400:00000200:0.0:1734256998.608416:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x349 [1] + 0 00000400:00000200:0.0:1734256998.608426:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256998.608429:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256998.608449:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098172032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257008 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734256998.608485:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734256998.608489:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602400 00000400:00000200:0.0:1734256998.608494:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x351 [1] + 224 00000400:00000200:0.0:1734256998.608510:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734256998.608514:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734256998.608518:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098171904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734256998.608836:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734256998.608841:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734256998.608843:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734256998.608848:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098172032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257008 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734256998.608854:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098172032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257008 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734256998.608878:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734256998.608882:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734256998.608886:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:1.0:1734256998.608951:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734256998.608955:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734256998.608956:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734256998.608960:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098171904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734256998.608966:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098171904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257014 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734256998.608977:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734256998.608980:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734256998.608981:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734257003.611735:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257003.611754:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257003.611812:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257003.611818:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257003.611831:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257003.611838:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257003.611843:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 02000000:00000010:0.0:1734257003.611848:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000100:00000200:3.0:1734257003.611849:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098172160, portal 25 00000400:00000010:3.0:1734257003.611852:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734257003.611854:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098172160, offset 0 00000400:00000200:3.0:1734257003.611861:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:0.0:1734257003.611862:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d505d8. 00000400:00000010:0.0:1734257003.611865:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734257003.611867:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098172288, portal 10 00000400:00000010:0.0:1734257003.611871:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000400:00000200:3.0:1734257003.611871:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:0.0:1734257003.611872:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098172288, offset 0 00000400:00000200:0.0:1734257003.611877:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257003.611880:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257003.611883:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257003.611886:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257003.611888:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257003.611890:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [77:77:256:4294967295] 192.168.202.108@tcp LPNI seq info [76:76:8:4294967295] 00000400:00000200:3.0:1734257003.611896:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257003.611900:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257003.611903:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734257003.611907:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257003.611913:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257003.611916:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734257003.611967:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257003.611970:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257003.611972:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257003.611974:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257003.611975:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257003.611977:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [78:78:255:4294967295] 192.168.202.108@tcp LPNI seq info [77:77:7:4294967295] 00000400:00000200:0.0:1734257003.611983:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257003.611987:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257003.611989:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000800:00000200:0.0:1734257003.611991:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257003.611995:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257003.611997:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257003.612228:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257003.612235:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:1.0:1734257003.612239:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257003.612243:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257003.612246:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:1.0:1734257003.612247:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:1.0:1734257003.612254:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098172160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257003.612452:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257003.612454:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734257003.612456:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257003.612459:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257003.612461:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:1.0:1734257003.612462:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:1.0:1734257003.612465:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098172288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257013 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257003.616636:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257003.616651:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602500 00000400:00000200:0.0:1734257003.616658:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x359 [1] + 224 00000400:00000200:0.0:1734257003.616666:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257003.616669:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257003.616676:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098172160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257019 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257003.616708:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257003.616712:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602580 00000400:00000200:0.0:1734257003.616715:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x361 [1] + 0 00000400:00000200:0.0:1734257003.616728:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257003.616735:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257003.616738:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098172288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257003.616821:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257003.616824:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257003.616826:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257003.616830:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098172160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257003.616836:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098172160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257019 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257003.616852:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257003.616856:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734257003.616859:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:1.0:1734257003.616916:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d505d8. 00000400:00000200:1.0:1734257003.616918:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:1.0:1734257003.616920:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:1.0:1734257003.616923:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098172288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257013 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257003.616928:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098172288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257013 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257003.616941:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257003.616944:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734257003.616945:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257008.619839:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257008.619857:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734257008.619907:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257008.619912:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734257008.620007:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257008.620014:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257008.620020:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257008.620027:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098172416, portal 25 00000400:00000010:3.0:1734257008.620030:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734257008.620032:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098172416, offset 0 00000400:00000200:3.0:1734257008.620038:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257008.620047:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257008.620052:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257008.620155:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257008.620158:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257008.620160:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257008.620163:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [79:79:256:4294967295] 192.168.202.108@tcp LPNI seq info [78:78:8:4294967295] 00000400:00000200:3.0:1734257008.620171:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257008.620175:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257008.620178:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257008.620183:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257008.620189:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257008.620192:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257008.620322:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257008.620324:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734257008.620328:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257008.620332:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257008.620335:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734257008.620337:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 02000000:00000010:1.0:1734257008.620338:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000100:00000200:0.0:1734257008.620342:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098172416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257024 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257008.620342:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257008.620344:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257008.620346:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098172544, portal 10 00000400:00000010:1.0:1734257008.620350:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734257008.620351:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098172544, offset 0 00000400:00000200:1.0:1734257008.620363:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257008.620371:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257008.620374:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257008.620376:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257008.620377:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257008.620379:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257008.620381:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [80:80:256:4294967295] 192.168.202.108@tcp LPNI seq info [79:79:8:4294967295] 00000400:00000200:1.0:1734257008.620386:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257008.620390:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257008.620392:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734257008.620394:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257008.620398:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257008.620400:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257008.620559:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257008.620564:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:2.0:1734257008.620917:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257008.620924:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257008.620929:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:2.0:1734257008.620938:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:2.0:1734257008.620946:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098172544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257018 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257008.622848:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257008.622864:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602680 00000400:00000200:0.0:1734257008.622871:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x371 [1] + 0 00000400:00000200:0.0:1734257008.622888:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257008.622891:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257008.622898:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098172544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257008.622959:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257008.622964:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257008.622966:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257008.622971:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098172544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257018 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257008.622978:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098172544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257018 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257008.623007:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257008.623012:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734257008.623017:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734257008.624724:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257008.624740:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602600 00000400:00000200:0.0:1734257008.624748:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x369 [1] + 224 00000400:00000200:0.0:1734257008.624765:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257008.624769:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257008.624777:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098172416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257024 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257008.624877:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257008.624880:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257008.624882:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257008.624886:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098172416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257024 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257008.624892:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098172416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257024 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257008.624910:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257008.624915:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734257008.624917:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257013.627666:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257013.627682:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257013.627734:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257013.627739:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734257013.627753:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257013.627759:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257013.627765:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257013.627770:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098172672, portal 25 02000000:00000010:0.0:1734257013.627772:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:3.0:1734257013.627774:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000400:00000010:0.0:1734257013.627775:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509f8. 00000100:00000200:3.0:1734257013.627775:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098172672, offset 0 00000400:00000010:0.0:1734257013.627778:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000400:00000200:3.0:1734257013.627782:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257013.627793:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257013.627797:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257013.627800:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257013.627803:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257013.627813:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257013.627816:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [81:81:256:4294967295] 192.168.202.108@tcp LPNI seq info [80:80:8:4294967295] 00000400:00000200:3.0:1734257013.627824:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257013.627828:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257013.627831:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734257013.627836:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257013.627842:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:0.0:1734257013.627843:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098172800, portal 10 00000800:00000200:3.0:1734257013.627845:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:0.0:1734257013.627847:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000100:00000200:0.0:1734257013.627849:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098172800, offset 0 00000400:00000200:0.0:1734257013.627852:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257013.627856:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257013.627858:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257013.627860:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257013.627861:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257013.627863:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257013.627865:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [82:82:255:4294967295] 192.168.202.108@tcp LPNI seq info [81:81:7:4294967295] 00000400:00000200:0.0:1734257013.627870:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257013.627872:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257013.627874:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000800:00000200:0.0:1734257013.627876:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257013.627879:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257013.627881:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257013.627960:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257013.627963:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:2.0:1734257013.627967:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257013.627971:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257013.627975:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:2.0:1734257013.627976:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:2.0:1734257013.627982:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098172672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257029 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257013.628042:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257013.628044:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:2.0:1734257013.628046:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257013.628048:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257013.628050:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:2.0:1734257013.628052:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:2.0:1734257013.628055:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098172800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257023 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257013.630134:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257013.630146:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602700 00000400:00000200:0.0:1734257013.630153:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x379 [1] + 224 00000400:00000200:0.0:1734257013.630169:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257013.630172:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257013.630183:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098172672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257013.632110:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257013.632118:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602780 00000400:00000200:0.0:1734257013.632125:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x381 [1] + 0 00000400:00000200:0.0:1734257013.632138:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257013.632141:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257013.632147:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098172800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257023 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257013.632283:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257013.632288:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257013.632290:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257013.632294:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098172672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257029 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257013.632301:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098172672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257029 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257013.632345:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257013.632350:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734257013.632353:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:1.0:1734257013.632425:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509f8. 00000400:00000200:1.0:1734257013.632428:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:1.0:1734257013.632429:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:1.0:1734257013.632433:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098172800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257023 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257013.632439:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098172800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257023 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257013.632454:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:1.0:1734257013.632462:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734257013.632465:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257018.635680:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257018.635697:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734257018.635745:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257018.635751:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734257018.635790:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734257018.635791:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:0.0:1734257018.635796:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509a0. 00000400:00000010:3.0:1734257018.635796:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:0.0:1734257018.635801:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000400:00000010:3.0:1734257018.635801:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:0.0:1734257018.635806:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098173056, portal 10 00000400:00000010:0.0:1734257018.635811:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:3.0:1734257018.635811:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098172928, portal 25 00000100:00000200:0.0:1734257018.635813:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098173056, offset 0 00000400:00000010:3.0:1734257018.635815:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000400:00000200:0.0:1734257018.635819:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734257018.635823:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098172928, offset 0 00000400:00000200:3.0:1734257018.635828:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257018.635829:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257018.635834:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257018.635837:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257018.635839:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257018.635841:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257018.635844:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [83:83:256:4294967295] 192.168.202.108@tcp LPNI seq info [82:82:8:4294967295] 00000400:00000200:0.0:1734257018.635851:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257018.635855:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257018.635856:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734257018.635858:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000400:00000200:3.0:1734257018.635859:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257018.635861:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257018.635863:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257018.635864:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257018.635866:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [84:84:255:4294967295] 192.168.202.108@tcp LPNI seq info [83:83:7:4294967295] 00000800:00000200:0.0:1734257018.635872:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257018.635877:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257018.635879:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257018.635880:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734257018.635882:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000010:3.0:1734257018.635882:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734257018.635884:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257018.635887:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257018.635888:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257018.635984:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257018.635987:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734257018.635992:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257018.635996:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257018.636000:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:1.0:1734257018.636001:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:1.0:1734257018.636007:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098173056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257028 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257018.636066:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257018.636068:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:1.0:1734257018.636071:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257018.636074:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257018.636076:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:1.0:1734257018.636077:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:1.0:1734257018.636080:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098172928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257034 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257018.638752:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257018.638766:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602880 00000400:00000200:0.0:1734257018.638772:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x389 [1] + 0 00000400:00000200:0.0:1734257018.638781:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257018.638785:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257018.638794:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098173056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257028 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257018.638832:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257018.638836:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602800 00000400:00000200:0.0:1734257018.638840:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x38d [1] + 224 00000400:00000200:0.0:1734257018.638852:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257018.638855:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257018.638859:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098172928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257018.638919:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257018.638924:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257018.638926:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257018.638931:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098172928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257034 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257018.638938:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098172928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257034 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257018.638956:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257018.638960:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734257018.638963:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:2.0:1734257018.639018:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509a0. 00000400:00000200:2.0:1734257018.639022:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:2.0:1734257018.639023:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:2.0:1734257018.639027:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098173056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257028 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257018.639039:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098173056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257028 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257018.639056:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257018.639060:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257018.639062:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734257023.643841:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257023.643858:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257023.643913:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257023.643918:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734257023.643954:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734257023.643960:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50948. 00000400:00000010:0.0:1734257023.643965:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000100:00000200:0.0:1734257023.643971:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098173312, portal 10 00000400:00000010:0.0:1734257023.643976:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000100:00000200:0.0:1734257023.643977:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098173312, offset 0 00000400:00000200:0.0:1734257023.643984:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257023.643995:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257023.644010:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257023.644014:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257023.644016:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257023.644018:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257023.644021:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [85:85:256:4294967295] 192.168.202.108@tcp LPNI seq info [84:84:8:4294967295] 02000000:00000010:3.0:1734257023.644067:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257023.644070:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257023.644073:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257023.644075:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098173184, portal 25 00000400:00000010:3.0:1734257023.644078:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734257023.644079:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098173184, offset 0 00000400:00000200:3.0:1734257023.644083:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257023.644832:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257023.644839:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257023.644844:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734257023.644849:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257023.644855:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257023.644859:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734257023.645394:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257023.645398:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257023.645400:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257023.645403:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257023.645405:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257023.645407:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [86:86:255:4294967295] 192.168.202.108@tcp LPNI seq info [85:85:7:4294967295] 00000400:00000200:3.0:1734257023.645413:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257023.645423:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257023.645426:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257023.645429:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257023.645432:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257023.645434:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257023.645535:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257023.645539:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734257023.645544:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257023.645548:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257023.645552:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:1.0:1734257023.645553:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:1.0:1734257023.645561:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098173312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257033 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257023.645642:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257023.645644:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:1.0:1734257023.645647:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257023.645650:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257023.645652:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:1.0:1734257023.645653:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:1.0:1734257023.645657:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098173184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257039 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257023.647829:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257023.647845:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602900 00000400:00000200:0.0:1734257023.647853:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x3a1 [1] + 224 00000400:00000200:0.0:1734257023.647863:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257023.647866:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257023.647873:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098173184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257039 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257023.647909:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257023.647913:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602980 00000400:00000200:0.0:1734257023.647918:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x399 [1] + 0 00000400:00000200:0.0:1734257023.647932:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257023.647934:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257023.647939:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098173312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257023.648001:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50948. 00000400:00000200:1.0:1734257023.648007:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:1.0:1734257023.648008:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000100:00000200:1.0:1734257023.648013:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098173312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257033 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257023.648020:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098173312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257033 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257023.648023:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257023.648027:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257023.648028:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257023.648032:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098173184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257039 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257023.648038:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098173184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257039 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257023.648041:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257023.648044:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734257023.648048:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 02000000:00000010:3.0:1734257023.648050:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257023.648053:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734257023.648055:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257028.651915:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257028.651934:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257028.652482:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257028.652497:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734257028.652512:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734257028.652519:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257028.652525:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257028.652535:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098173440, portal 25 00000400:00000010:2.0:1734257028.652539:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734257028.652541:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098173440, offset 0 00000400:00000200:2.0:1734257028.652549:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257028.652560:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257028.652565:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:1.0:1734257028.652592:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257028.652596:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257028.652600:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257028.652602:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098173568, portal 10 00000400:00000200:2.0:1734257028.652603:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:1.0:1734257028.652606:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000200:2.0:1734257028.652607:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:1.0:1734257028.652608:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098173568, offset 0 00000400:00000200:2.0:1734257028.652609:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257028.652611:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [87:87:256:4294967295] 192.168.202.108@tcp LPNI seq info [86:86:8:4294967295] 00000400:00000200:1.0:1734257028.652612:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257028.652619:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257028.652624:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257028.652627:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257028.652633:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257028.652639:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257028.652643:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734257028.652689:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257028.652691:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257028.652693:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257028.652695:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257028.652696:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257028.652698:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [88:88:255:4294967295] 192.168.202.108@tcp LPNI seq info [87:87:7:4294967295] 00000400:00000200:1.0:1734257028.652704:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257028.652707:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257028.652709:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734257028.652712:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257028.652715:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257028.652717:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257028.652728:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257028.652730:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:2.0:1734257028.652734:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257028.652738:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257028.652741:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:2.0:1734257028.652743:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734257028.652749:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098173440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257044 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257028.652801:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257028.652804:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:2.0:1734257028.652806:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257028.652809:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257028.652811:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:2.0:1734257028.652812:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:2.0:1734257028.652815:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098173568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257038 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257028.654611:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257028.654623:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602a80 00000400:00000200:0.0:1734257028.654628:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x3b1 [1] + 0 00000400:00000200:0.0:1734257028.654637:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257028.654640:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257028.654646:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098173568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257038 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257028.654680:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257028.654683:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602a00 00000400:00000200:0.0:1734257028.654687:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x3a9 [1] + 224 00000400:00000200:0.0:1734257028.654699:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257028.654701:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257028.654705:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098173440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257044 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257028.654854:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257028.654858:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257028.654859:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257028.654864:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098173568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257038 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257028.654869:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098173568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257038 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257028.654890:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257028.654895:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734257028.654898:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:2.0:1734257028.655213:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257028.655217:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257028.655218:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257028.655223:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098173440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257044 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257028.655229:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098173440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257044 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257028.655239:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734257028.655242:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734257028.655244:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734257033.659697:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257033.659721:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257033.660649:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257033.660658:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257033.660731:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257033.660744:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257033.660751:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257033.660758:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098173696, portal 25 00000400:00000010:1.0:1734257033.660762:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734257033.660764:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098173696, offset 0 00000400:00000200:1.0:1734257033.660772:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257033.660782:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257033.660787:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257033.660790:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257033.660793:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257033.660795:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257033.660797:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [89:89:256:4294967295] 192.168.202.108@tcp LPNI seq info [88:88:8:4294967295] 00000400:00000200:1.0:1734257033.660806:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257033.660811:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257033.660814:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734257033.660819:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257033.660826:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257033.660830:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257033.661030:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257033.661034:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734257033.661038:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257033.661044:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257033.661048:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:0.0:1734257033.661050:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:0.0:1734257033.661057:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098173696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257049 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:0.0:1734257033.661087:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734257033.661091:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d508f0. 00000400:00000010:0.0:1734257033.661107:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1088. 00000100:00000200:0.0:1734257033.661111:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098173824, portal 10 00000400:00000010:0.0:1734257033.661116:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734257033.661118:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098173824, offset 0 00000400:00000200:0.0:1734257033.661123:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257033.661130:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257033.661134:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257033.661136:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257033.661139:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257033.661141:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257033.661144:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [90:90:256:4294967295] 192.168.202.108@tcp LPNI seq info [89:89:8:4294967295] 00000400:00000200:0.0:1734257033.661160:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257033.661165:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257033.661167:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734257033.661171:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257033.661176:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257033.661179:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257033.661897:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257033.661900:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:2.0:1734257033.661902:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257033.661905:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257033.661908:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:2.0:1734257033.661909:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:2.0:1734257033.661913:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098173824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257043 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257033.664126:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257033.664140:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602b00 00000400:00000200:0.0:1734257033.664148:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x3b9 [1] + 224 00000400:00000200:0.0:1734257033.664175:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257033.664179:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257033.664188:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098173696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257049 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257033.664224:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257033.664228:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602b80 00000400:00000200:0.0:1734257033.664232:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x3c1 [1] + 0 00000400:00000200:0.0:1734257033.664252:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257033.664255:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257033.664266:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098173824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257043 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257033.664435:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257033.664444:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257033.664446:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257033.664451:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098173696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257049 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257033.664458:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098173696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257049 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257033.664484:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257033.664488:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734257033.664491:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:2.0:1734257033.664949:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d508f0. 00000400:00000200:2.0:1734257033.664958:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1088 00000400:00000010:2.0:1734257033.664960:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1088. 00000100:00000200:2.0:1734257033.664968:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098173824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257043 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257033.664976:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098173824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257043 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257033.665001:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257033.665006:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257033.665009:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257038.667741:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257038.667768:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 02000000:00000010:2.0:1734257038.667930:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734257038.667938:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257038.667960:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257038.667969:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098173952, portal 25 00000400:00000010:2.0:1734257038.667974:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734257038.667976:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098173952, offset 0 00000400:00000200:2.0:1734257038.667987:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257038.668001:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257038.668007:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257038.668010:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257038.668014:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257038.668016:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257038.668019:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [91:91:256:4294967295] 192.168.202.108@tcp LPNI seq info [90:90:8:4294967295] 00000400:00000200:2.0:1734257038.668028:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257038.668035:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257038.668038:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257038.668044:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257038.668052:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257038.668056:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257038.668200:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257038.668208:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734257038.668247:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734257038.668251:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50898. 00000400:00000010:0.0:1734257038.668254:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000100:00000200:0.0:1734257038.668257:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098174080, portal 10 00000400:00000010:0.0:1734257038.668261:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734257038.668262:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098174080, offset 0 00000400:00000200:0.0:1734257038.668266:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257038.668271:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257038.668273:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257038.668275:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257038.668276:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257038.668278:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257038.668279:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [92:92:255:4294967295] 192.168.202.108@tcp LPNI seq info [91:91:7:4294967295] 00000400:00000200:0.0:1734257038.668284:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257038.668288:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257038.668290:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734257038.668292:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257038.668296:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257038.668298:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257038.668492:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257038.668496:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734257038.668501:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257038.668505:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257038.668509:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:1.0:1734257038.668510:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:1.0:1734257038.668517:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098173952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257054 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257038.668609:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257038.668611:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734257038.668614:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257038.668617:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257038.668619:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:1.0:1734257038.668620:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:1.0:1734257038.668624:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098174080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257048 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257038.673143:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257038.673162:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602c80 00000400:00000200:0.0:1734257038.673170:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x3d1 [1] + 0 00000400:00000200:0.0:1734257038.673198:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257038.673211:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257038.673220:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098174080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257048 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257038.675845:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50898. 00000400:00000200:2.0:1734257038.675855:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:2.0:1734257038.675857:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:2.0:1734257038.675870:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098174080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257048 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257038.675880:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098174080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257048 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257038.675913:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257038.675919:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257038.675924:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734257038.678077:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257038.678095:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602c00 00000400:00000200:0.0:1734257038.678103:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x3c9 [1] + 224 00000400:00000200:0.0:1734257038.678149:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257038.678153:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257038.678163:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098173952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257054 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257038.679722:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257038.679729:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257038.679732:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257038.679741:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098173952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257054 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257038.679760:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098173952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257054 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257038.679802:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734257038.679808:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734257038.679813:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257043.675756:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257043.675780:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257043.675847:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257043.675854:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257043.675870:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257043.675878:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257043.675884:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 02000000:00000010:0.0:1734257043.675889:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000100:00000200:3.0:1734257043.675891:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098174208, portal 25 00000400:00000010:0.0:1734257043.675894:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50840. 00000400:00000010:3.0:1734257043.675895:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000400:00000010:0.0:1734257043.675897:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1000. 00000100:00000200:3.0:1734257043.675897:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098174208, offset 0 00000100:00000200:0.0:1734257043.675900:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098174336, portal 10 00000400:00000200:3.0:1734257043.675905:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:0.0:1734257043.675906:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000100:00000200:0.0:1734257043.675909:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098174336, offset 0 00000400:00000200:0.0:1734257043.675914:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257043.675919:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257043.675924:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257043.675927:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257043.675930:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257043.675933:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257043.675936:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [93:93:256:4294967295] 192.168.202.108@tcp LPNI seq info [92:92:8:4294967295] 00000400:00000200:3.0:1734257043.675944:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257043.675949:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257043.675965:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734257043.675971:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257043.675979:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257043.675983:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257043.676171:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257043.676174:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734257043.676177:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257043.676182:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257043.676185:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:1.0:1734257043.676187:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:1.0:1734257043.676193:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098174208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257059 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257043.676654:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257043.676657:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257043.676659:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257043.676661:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257043.676663:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257043.676665:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [94:94:255:4294967295] 192.168.202.108@tcp LPNI seq info [93:93:7:4294967295] 00000400:00000200:0.0:1734257043.676671:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257043.676675:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257043.677337:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734257043.677346:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257043.677353:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257043.677356:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257043.677466:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257043.677469:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:2.0:1734257043.677472:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257043.677476:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257043.677479:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:2.0:1734257043.677480:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:2.0:1734257043.677486:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098174336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257053 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257043.680042:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257043.680414:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602d00 00000400:00000200:0.0:1734257043.680421:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x3d9 [1] + 224 00000400:00000200:0.0:1734257043.680432:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257043.680435:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257043.680444:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098174208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257059 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257043.682099:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257043.682105:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257043.682107:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000400:00000200:0.0:1734257043.682112:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000100:00000200:3.0:1734257043.682112:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098174208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257059 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257043.682119:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602d80 00000100:00000200:3.0:1734257043.682119:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098174208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257059 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257043.682123:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x3e1 [1] + 0 02000000:00000010:3.0:1734257043.682138:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 00000400:00000200:0.0:1734257043.682142:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 02000000:00000010:3.0:1734257043.682142:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734257043.682144:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000200:0.0:1734257043.682145:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257043.682150:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098174336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257053 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257043.682228:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50840. 00000400:00000200:2.0:1734257043.682232:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1000 00000400:00000010:2.0:1734257043.682233:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1000. 00000100:00000200:2.0:1734257043.682236:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098174336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257053 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257043.682242:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098174336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257053 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257043.682256:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734257043.682259:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257043.682260:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257048.684320:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257048.684343:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 02000000:00000010:3.0:1734257048.685911:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257048.685919:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257048.685925:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257048.685931:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098174464, portal 25 00000400:00000010:3.0:1734257048.685934:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734257048.685936:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098174464, offset 0 00000400:00000200:3.0:1734257048.685949:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257048.685963:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257048.685970:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257048.685973:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257048.685976:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257048.685978:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257048.685980:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [95:95:256:4294967295] 192.168.202.108@tcp LPNI seq info [94:94:8:4294967295] 00000400:00000200:3.0:1734257048.685987:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257048.685993:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257048.685996:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734257048.686010:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257048.686016:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257048.686019:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257048.686179:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257048.686182:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:1.0:1734257048.686185:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257048.686189:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257048.686192:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:1.0:1734257048.686194:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:1.0:1734257048.686200:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098174464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257064 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257048.686467:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257048.686475:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257048.686780:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257048.686785:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257048.686788:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257048.686791:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098174592, portal 10 00000400:00000010:2.0:1734257048.686795:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734257048.686796:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098174592, offset 0 00000400:00000200:2.0:1734257048.686800:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257048.686810:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257048.686812:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257048.686814:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257048.686816:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257048.686817:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257048.686819:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [96:96:256:4294967295] 192.168.202.108@tcp LPNI seq info [95:95:8:4294967295] 00000400:00000200:2.0:1734257048.686825:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257048.686828:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257048.686831:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257048.686834:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257048.686837:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257048.686839:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257048.687095:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257048.687097:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257048.687100:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257048.687103:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257048.687105:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734257048.687106:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734257048.687110:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098174592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257058 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257048.693262:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257048.693281:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602e00 00000400:00000200:0.0:1734257048.693289:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x3e9 [1] + 224 00000400:00000200:0.0:1734257048.693300:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257048.693304:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257048.693313:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098174464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257064 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257048.693346:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257048.693350:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602e80 00000400:00000200:0.0:1734257048.693354:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x3f1 [1] + 0 00000400:00000200:0.0:1734257048.693367:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257048.693370:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257048.693374:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098174592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257058 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257048.693458:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257048.693462:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257048.693463:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257048.693468:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098174464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257064 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257048.693474:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098174464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257064 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257048.693494:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257048.693498:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734257048.693502:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:2.0:1734257048.694309:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257048.694313:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257048.694315:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257048.694319:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098174592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257058 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257048.694326:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098174592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257058 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257048.694343:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257048.694347:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257048.694349:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257053.691921:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257053.691942:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257053.692029:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257053.692036:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734257053.692074:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734257053.692081:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d507e8. 00000400:00000010:0.0:1734257053.692087:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734257053.692093:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098174848, portal 10 00000400:00000010:0.0:1734257053.692098:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1088. 00000100:00000200:0.0:1734257053.692099:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098174848, offset 0 00000400:00000200:0.0:1734257053.692106:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257053.692117:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257053.692121:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257053.692125:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257053.692139:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257053.692141:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257053.692143:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [97:97:256:4294967295] 192.168.202.108@tcp LPNI seq info [96:96:8:4294967295] 00000400:00000200:0.0:1734257053.692151:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257053.692157:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257053.692160:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734257053.692165:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257053.692171:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257053.692174:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734257053.692207:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257053.692212:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257053.692215:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257053.692217:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098174720, portal 25 00000400:00000010:3.0:1734257053.692220:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734257053.692221:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098174720, offset 0 00000400:00000200:3.0:1734257053.692226:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257053.692230:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257053.692232:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257053.692234:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257053.692236:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257053.692238:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257053.692240:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [98:98:255:4294967295] 192.168.202.108@tcp LPNI seq info [97:97:7:4294967295] 00000400:00000200:3.0:1734257053.692245:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257053.692249:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257053.692251:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734257053.692254:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257053.692257:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257053.692263:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257053.692329:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257053.692332:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:1.0:1734257053.692336:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257053.692340:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257053.692343:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1088 00000400:00000010:1.0:1734257053.692345:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1088. 00000100:00000200:1.0:1734257053.692351:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098174848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257063 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257053.692530:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257053.692533:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:1.0:1734257053.692535:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257053.692538:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257053.692540:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:1.0:1734257053.692541:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:1.0:1734257053.692544:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098174720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257069 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257053.696200:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257053.696221:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c602f80 00000400:00000200:0.0:1734257053.696231:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x3f9 [1] + 0 00000400:00000200:0.0:1734257053.696242:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257053.696246:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257053.696256:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098174848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257063 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257053.696300:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257053.696304:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c602f00 00000400:00000200:0.0:1734257053.696310:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x401 [1] + 224 00000400:00000200:0.0:1734257053.696326:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257053.696328:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257053.696333:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098174720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257069 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257053.696514:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d507e8. 00000400:00000200:2.0:1734257053.696520:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:2.0:1734257053.696522:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:2.0:1734257053.696527:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098174848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257063 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257053.696533:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098174848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257063 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257053.696563:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257053.696617:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257053.696621:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:3.0:1734257053.697709:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257053.697720:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257053.697721:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257053.697731:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098174720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257069 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257053.697740:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098174720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257069 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257053.697760:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257053.697765:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734257053.697768:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257058.699992:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257058.700011:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257058.700171:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257058.700178:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257058.700227:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734257058.700235:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257058.700240:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257058.700245:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098174976, portal 25 00000400:00000010:2.0:1734257058.700249:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734257058.700251:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098174976, offset 0 00000400:00000200:2.0:1734257058.700258:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257058.700268:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257058.700273:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257058.700276:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257058.700279:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257058.700281:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257058.700283:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [99:99:256:4294967295] 192.168.202.108@tcp LPNI seq info [98:98:8:4294967295] 00000400:00000200:2.0:1734257058.700290:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257058.700295:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257058.700304:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257058.700309:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257058.700315:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257058.700318:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257058.700984:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257058.700988:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734257058.700992:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257058.700995:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257058.700999:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:1.0:1734257058.701001:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:1.0:1734257058.701007:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098174976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257074 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257058.701708:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257058.701714:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9a0. 00000400:00000010:2.0:1734257058.701718:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734257058.701722:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098175104, portal 10 00000400:00000010:2.0:1734257058.701726:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734257058.701728:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098175104, offset 0 00000400:00000200:2.0:1734257058.701733:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257058.701739:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257058.701742:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257058.701745:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257058.701752:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257058.701754:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257058.701756:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [100:100:256:4294967295] 192.168.202.108@tcp LPNI seq info [99:99:8:4294967295] 00000400:00000200:2.0:1734257058.701763:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257058.701766:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257058.701769:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257058.701772:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257058.701777:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257058.701779:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257058.701862:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257058.701864:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734257058.701866:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257058.701869:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257058.701871:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:1.0:1734257058.701873:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:1.0:1734257058.701876:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098175104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257068 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257058.703968:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257058.703990:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603000 00000400:00000200:0.0:1734257058.703998:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x409 [1] + 224 00000400:00000200:0.0:1734257058.704008:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257058.704011:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257058.704019:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098174976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257074 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257058.704352:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257058.704357:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603080 00000400:00000200:0.0:1734257058.704362:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x411 [1] + 0 00000400:00000200:0.0:1734257058.704372:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257058.704375:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257058.704379:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098175104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257068 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257058.704457:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257058.704461:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257058.704463:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257058.704468:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098174976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257074 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257058.704473:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098174976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257074 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257058.704493:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734257058.704496:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734257058.704499:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:3.0:1734257058.704639:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9a0. 00000400:00000200:3.0:1734257058.704643:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:3.0:1734257058.704644:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:3.0:1734257058.704648:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098175104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257068 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257058.704654:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098175104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257068 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257058.704668:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734257058.704672:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257058.704675:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734257063.708135:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257063.708153:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257063.708199:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257063.708205:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734257063.708238:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734257063.708244:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50790. 00000400:00000010:0.0:1734257063.708249:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734257063.708254:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098175360, portal 10 00000400:00000010:0.0:1734257063.708259:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000100:00000200:0.0:1734257063.708260:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098175360, offset 0 00000400:00000200:0.0:1734257063.708267:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257063.708276:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257063.708281:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257063.708284:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257063.708286:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257063.708288:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257063.708298:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [101:101:256:4294967295] 192.168.202.108@tcp LPNI seq info [100:100:8:4294967295] 00000400:00000200:0.0:1734257063.708306:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257063.708310:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257063.708312:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000800:00000200:0.0:1734257063.708317:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257063.708323:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257063.708326:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734257063.708968:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734257063.708973:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257063.708976:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257063.708979:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098175232, portal 25 00000400:00000010:2.0:1734257063.708981:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734257063.708982:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098175232, offset 0 00000400:00000200:2.0:1734257063.708986:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257063.708990:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257063.708993:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257063.708995:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257063.708996:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257063.708997:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257063.709005:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [102:102:255:4294967295] 192.168.202.108@tcp LPNI seq info [101:101:7:4294967295] 00000400:00000200:2.0:1734257063.709010:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257063.709014:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257063.709017:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257063.709020:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257063.709024:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257063.709026:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257063.709205:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257063.709208:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:1.0:1734257063.709211:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257063.709215:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257063.709219:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:1.0:1734257063.709220:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000100:00000200:1.0:1734257063.709226:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098175360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257073 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257063.709286:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257063.709288:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734257063.709290:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257063.709293:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257063.709295:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:1.0:1734257063.709296:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:1.0:1734257063.709299:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098175232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257079 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257063.711660:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257063.711674:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603180 00000400:00000200:0.0:1734257063.711680:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x419 [1] + 0 00000400:00000200:0.0:1734257063.711698:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257063.711701:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257063.711709:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098175360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257073 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257063.712625:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50790. 00000400:00000200:2.0:1734257063.712630:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:2.0:1734257063.712631:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:2.0:1734257063.712636:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098175360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257073 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257063.712642:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098175360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257073 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257063.712664:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:2.0:1734257063.712668:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257063.712671:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734257063.712817:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257063.712824:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603100 00000400:00000200:0.0:1734257063.712829:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x421 [1] + 224 00000400:00000200:0.0:1734257063.712840:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257063.712844:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257063.712849:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098175232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257063.713131:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257063.713135:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257063.713136:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257063.713140:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098175232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257079 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257063.713145:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098175232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257079 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257063.713155:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734257063.713157:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:2.0:1734257063.713159:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257068.715674:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257068.715694:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 02000000:00000010:2.0:1734257068.715770:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734257068.715777:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257068.715783:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257068.715799:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098175488, portal 25 00000400:00000010:2.0:1734257068.715802:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734257068.715804:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098175488, offset 0 00000400:00000200:2.0:1734257068.715811:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257068.715822:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257068.715826:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257068.715829:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257068.715832:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257068.715834:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257068.715836:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [103:103:256:4294967295] 192.168.202.108@tcp LPNI seq info [102:102:8:4294967295] 00000400:00000200:2.0:1734257068.715844:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257068.715848:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257068.715852:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257068.715857:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257068.715863:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257068.715866:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257068.715968:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257068.715974:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734257068.716172:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734257068.716177:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257068.716180:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257068.716183:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098175616, portal 10 00000400:00000010:3.0:1734257068.716187:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734257068.716189:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098175616, offset 0 00000400:00000200:3.0:1734257068.716193:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257068.716198:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257068.716200:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257068.716202:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257068.716209:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257068.716211:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257068.716213:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [104:104:255:4294967295] 192.168.202.108@tcp LPNI seq info [103:103:7:4294967295] 00000400:00000200:3.0:1734257068.716219:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257068.716223:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257068.716225:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734257068.716228:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257068.716232:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257068.716234:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257068.717625:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257068.717630:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734257068.717634:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257068.717639:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257068.717643:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:1.0:1734257068.717644:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:1.0:1734257068.717651:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098175488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257084 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257068.717713:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257068.717715:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:1.0:1734257068.717717:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257068.717720:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257068.717722:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:1.0:1734257068.717723:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:1.0:1734257068.717727:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098175616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257078 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257068.720007:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257068.720021:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603280 00000400:00000200:0.0:1734257068.720035:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x431 [1] + 0 00000400:00000200:0.0:1734257068.720045:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257068.720048:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257068.720056:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098175616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257078 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257068.720091:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257068.720095:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603200 00000400:00000200:0.0:1734257068.720099:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x429 [1] + 224 00000400:00000200:0.0:1734257068.720111:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257068.720114:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257068.720119:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098175488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257084 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257068.720456:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257068.720461:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257068.720463:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000400:00000010:2.0:1734257068.720592:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257068.720597:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257068.720598:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257068.720602:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098175488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257084 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257068.720610:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098175488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257084 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257068.720619:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098175616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257078 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257068.720627:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098175616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257078 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257068.720628:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734257068.720632:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734257068.720635:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 02000000:00000010:3.0:1734257068.720644:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734257068.720648:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734257068.720650:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257073.724072:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257073.724091:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257073.724145:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257073.724150:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257073.724173:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257073.724180:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 02000000:00000010:0.0:1734257073.724181:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734257073.724184:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50738. 00000400:00000010:3.0:1734257073.724186:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000010:0.0:1734257073.724188:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000100:00000200:0.0:1734257073.724191:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098175872, portal 10 00000100:00000200:3.0:1734257073.724191:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098175744, portal 25 00000400:00000010:3.0:1734257073.724194:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000400:00000010:0.0:1734257073.724195:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000100:00000200:3.0:1734257073.724196:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098175744, offset 0 00000100:00000200:0.0:1734257073.724197:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098175872, offset 0 00000400:00000200:3.0:1734257073.724203:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257073.724209:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257073.724215:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257073.724220:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257073.724224:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257073.724226:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257073.724237:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257073.724240:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [105:105:256:4294967295] 192.168.202.108@tcp LPNI seq info [104:104:8:4294967295] 00000400:00000200:3.0:1734257073.724247:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257073.724251:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257073.724253:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734257073.724254:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734257073.724255:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257073.724257:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257073.724259:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734257073.724259:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734257073.724260:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257073.724262:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [106:106:255:4294967295] 192.168.202.108@tcp LPNI seq info [105:105:7:4294967295] 00000800:00000200:3.0:1734257073.724265:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734257073.724268:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257073.724269:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257073.724276:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257073.724278:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734257073.724281:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257073.724284:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257073.724286:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257073.724387:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257073.724390:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:1.0:1734257073.724394:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257073.724397:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257073.724400:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:1.0:1734257073.724401:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:1.0:1734257073.724408:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098175744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257089 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257073.724468:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257073.724470:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734257073.724472:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257073.724475:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257073.724477:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:1.0:1734257073.724478:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:1.0:1734257073.724481:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098175872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257083 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257073.729769:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257073.729786:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603380 00000400:00000200:0.0:1734257073.729794:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x43d [1] + 0 00000400:00000200:0.0:1734257073.729803:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257073.729806:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257073.729814:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098175872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257083 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257073.730668:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257073.730673:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603300 00000400:00000200:0.0:1734257073.730679:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x439 [1] + 224 00000400:00000200:0.0:1734257073.730694:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257073.730698:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257073.730702:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098175744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257089 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257073.731913:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50738. 00000400:00000200:2.0:1734257073.731920:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:2.0:1734257073.731922:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:2.0:1734257073.731929:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098175872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257083 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257073.731950:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098175872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257083 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257073.731976:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734257073.731982:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257073.731985:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:3.0:1734257073.735290:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257073.735302:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257073.735304:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257073.735314:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098175744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257089 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257073.735323:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098175744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257089 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257073.735345:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257073.735350:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734257073.735353:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734257078.731852:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257078.731871:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257078.731924:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257078.731930:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734257078.731967:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734257078.731973:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d506e0. 00000400:00000010:0.0:1734257078.731978:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:0.0:1734257078.731983:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098176128, portal 10 00000400:00000010:0.0:1734257078.731989:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734257078.732000:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098176128, offset 0 00000400:00000200:0.0:1734257078.732008:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257078.732018:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257078.732021:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257078.732025:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257078.732027:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257078.732029:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257078.732032:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [107:107:256:4294967295] 192.168.202.108@tcp LPNI seq info [106:106:8:4294967295] 00000400:00000200:0.0:1734257078.732039:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257078.732044:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257078.732047:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734257078.732052:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257078.732063:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257078.732066:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734257078.732104:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257078.732109:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257078.732111:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257078.732114:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098176000, portal 25 00000400:00000010:3.0:1734257078.732116:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734257078.732117:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098176000, offset 0 00000400:00000200:3.0:1734257078.732121:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257078.732126:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257078.732128:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257078.732130:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257078.732132:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257078.732133:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257078.732135:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [108:108:255:4294967295] 192.168.202.108@tcp LPNI seq info [107:107:7:4294967295] 00000400:00000200:3.0:1734257078.732144:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257078.732148:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257078.732150:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734257078.732152:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257078.732156:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257078.732158:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257078.732187:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257078.732191:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734257078.732195:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257078.732199:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257078.732202:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:1.0:1734257078.732204:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:1.0:1734257078.732210:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098176128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257088 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257078.732239:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257078.732240:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734257078.732242:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257078.732245:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257078.732246:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:1.0:1734257078.732247:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734257078.732250:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098176000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257094 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257078.734051:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257078.734063:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603480 00000400:00000200:0.0:1734257078.734069:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x449 [1] + 0 00000400:00000200:0.0:1734257078.734077:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257078.734080:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257078.734087:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098176128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257088 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257078.734121:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257078.734125:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603400 00000400:00000200:0.0:1734257078.734129:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x451 [1] + 224 00000400:00000200:0.0:1734257078.734144:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257078.734147:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257078.734151:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098176000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257094 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257078.734234:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d506e0. 00000400:00000200:2.0:1734257078.734239:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:2.0:1734257078.734240:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:2.0:1734257078.734244:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098176128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257088 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257078.734249:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098176128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257088 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257078.734269:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257078.734273:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257078.734276:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:3.0:1734257078.734683:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257078.734687:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257078.734688:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257078.734692:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098176000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257094 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257078.734698:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098176000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257094 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257078.734709:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257078.734712:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734257078.734714:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257083.739924:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257083.739944:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 02000000:00000010:3.0:1734257083.740045:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257083.740052:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257083.740058:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257083.740063:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098176256, portal 25 00000400:00000010:3.0:1734257083.740067:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734257083.740068:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098176256, offset 0 00000400:00000200:3.0:1734257083.740075:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257083.740087:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257083.740091:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257083.740094:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257083.740097:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257083.740099:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257083.740101:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [109:109:256:4294967295] 192.168.202.108@tcp LPNI seq info [108:108:8:4294967295] 00000400:00000200:3.0:1734257083.740108:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257083.740122:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257083.740126:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734257083.740130:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257083.740137:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257083.740139:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257083.740217:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257083.740223:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734257083.741162:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257083.741168:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257083.741171:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257083.741175:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098176384, portal 10 00000400:00000010:2.0:1734257083.741179:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734257083.741180:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098176384, offset 0 00000400:00000200:2.0:1734257083.741185:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257083.741191:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257083.741194:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257083.741196:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257083.741198:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257083.741199:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257083.741201:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [110:110:255:4294967295] 192.168.202.108@tcp LPNI seq info [109:109:7:4294967295] 00000400:00000200:2.0:1734257083.741207:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257083.741218:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257083.741221:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257083.741224:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257083.741228:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257083.741230:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257083.741267:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257083.741270:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734257083.741273:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257083.741277:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257083.741281:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734257083.741282:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734257083.741288:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098176256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257099 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257083.741316:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257083.741317:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257083.741319:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257083.741322:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257083.741323:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734257083.741324:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734257083.741327:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098176384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257093 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257083.742987:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257083.743000:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603500 00000400:00000200:0.0:1734257083.743006:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x459 [1] + 224 00000400:00000200:0.0:1734257083.743014:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257083.743017:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257083.743024:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098176256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257099 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257083.743057:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257083.743062:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603580 00000400:00000200:0.0:1734257083.743074:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x461 [1] + 0 00000400:00000200:0.0:1734257083.743085:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257083.743088:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257083.743091:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098176384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257093 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257083.743237:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257083.743241:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257083.743242:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257083.743246:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098176256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257099 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257083.743252:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098176256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257099 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257083.743269:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257083.743273:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734257083.743276:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:2.0:1734257083.743414:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257083.743418:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257083.743420:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257083.743423:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098176384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257093 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257083.743429:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098176384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257093 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257083.743443:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257083.743446:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257083.743448:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734257088.747641:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257088.747668:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257088.747741:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257088.747748:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257088.747780:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 02000000:00000010:0.0:1734257088.747784:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734257088.747788:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50688. 00000400:00000010:2.0:1734257088.747788:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:0.0:1734257088.747794:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000400:00000010:2.0:1734257088.747794:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257088.747801:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098176512, portal 25 00000400:00000010:2.0:1734257088.747806:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734257088.747807:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098176640, portal 10 00000100:00000200:2.0:1734257088.747808:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098176512, offset 0 00000400:00000010:0.0:1734257088.747812:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000400:00000200:2.0:1734257088.747817:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734257088.747821:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098176640, offset 0 00000400:00000200:0.0:1734257088.747826:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257088.747832:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257088.747836:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257088.747840:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257088.747843:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257088.747845:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257088.747848:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [111:111:256:4294967295] 192.168.202.108@tcp LPNI seq info [110:110:8:4294967295] 00000400:00000200:2.0:1734257088.747855:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257088.747861:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257088.747862:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257088.747864:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257088.747866:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257088.747868:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257088.747869:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257088.747872:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [112:112:255:4294967295] 192.168.202.108@tcp LPNI seq info [111:111:7:4294967295] 00000400:00000200:0.0:1734257088.747877:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000010:2.0:1734257088.747877:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:0.0:1734257088.747880:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734257088.747882:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000010:0.0:1734257088.747883:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734257088.747886:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257088.747890:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257088.747890:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257088.747893:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257088.747893:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257088.747980:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257088.747983:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734257088.747988:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257088.747992:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257088.747995:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:1.0:1734257088.747997:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:1.0:1734257088.748004:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098176640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257098 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257088.748071:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257088.748073:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734257088.748075:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257088.748078:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257088.748080:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:1.0:1734257088.748081:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:1.0:1734257088.748084:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098176512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257104 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257088.749606:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257088.749624:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603600 00000400:00000200:0.0:1734257088.749631:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x469 [1] + 224 00000400:00000200:0.0:1734257088.749641:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257088.749643:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257088.749650:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098176512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257104 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257088.749684:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257088.749687:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603680 00000400:00000200:0.0:1734257088.749691:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x46d [1] + 0 00000400:00000200:0.0:1734257088.749702:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257088.749718:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257088.749722:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098176640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257098 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257088.749862:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257088.749866:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257088.749868:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257088.749873:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098176512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257104 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257088.749879:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098176512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257104 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257088.749897:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734257088.749902:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734257088.749905:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:1.0:1734257088.749961:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50688. 00000400:00000200:1.0:1734257088.749964:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:1.0:1734257088.749966:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:1.0:1734257088.749969:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098176640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257098 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257088.749975:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098176640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257098 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257088.749999:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257088.750003:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734257088.750005:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734257093.755772:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257093.755791:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257093.755849:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257093.755856:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734257093.755911:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257093.755918:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257093.755924:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257093.755929:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098176768, portal 25 00000400:00000010:3.0:1734257093.755932:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734257093.755934:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098176768, offset 0 00000400:00000200:3.0:1734257093.755941:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257093.755952:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257093.755957:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257093.755961:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257093.755963:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257093.755965:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257093.755967:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [113:113:256:4294967295] 192.168.202.108@tcp LPNI seq info [112:112:8:4294967295] 00000400:00000200:3.0:1734257093.755974:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257093.755978:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257093.755997:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734257093.756002:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257093.756009:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257093.756012:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734257093.756394:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257093.756398:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257093.756402:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257093.756404:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098176896, portal 10 00000400:00000010:1.0:1734257093.756408:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734257093.756410:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098176896, offset 0 00000400:00000200:1.0:1734257093.756414:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257093.756419:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257093.756422:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257093.756424:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257093.756425:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257093.756427:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257093.756429:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [114:114:255:4294967295] 192.168.202.108@tcp LPNI seq info [113:113:7:4294967295] 00000400:00000200:1.0:1734257093.756435:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257093.756438:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257093.756441:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734257093.756444:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257093.756447:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257093.756449:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257093.756711:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257093.756714:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734257093.756718:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257093.756723:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257093.756726:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734257093.756728:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734257093.756734:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098176768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257109 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257093.757205:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257093.757208:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734257093.757211:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257093.757214:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257093.757217:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:0.0:1734257093.757222:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:0.0:1734257093.757226:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098176896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257103 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257093.759878:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257093.759893:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603700 00000400:00000200:0.0:1734257093.759901:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x479 [1] + 224 00000400:00000200:0.0:1734257093.759920:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257093.759923:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257093.759931:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098176768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257109 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257093.760153:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257093.760159:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257093.760160:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257093.760166:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098176768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257109 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257093.760173:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098176768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257109 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257093.760193:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257093.760198:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734257093.760201:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734257093.760951:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257093.760959:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603780 00000400:00000200:0.0:1734257093.760964:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x481 [1] + 0 00000400:00000200:0.0:1734257093.760976:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257093.760979:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257093.760983:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098176896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257103 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257093.761309:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257093.761314:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257093.761315:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257093.761320:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098176896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257103 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257093.761326:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098176896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257103 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257093.761354:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257093.761358:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734257093.761361:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734257098.763778:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257098.763796:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257098.764944:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257098.764954:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734257098.765058:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734257098.765064:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257098.765069:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257098.765075:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098177024, portal 25 02000000:00000010:1.0:1734257098.765078:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:2.0:1734257098.765078:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257098.765079:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098177024, offset 0 00000400:00000010:1.0:1734257098.765083:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000200:2.0:1734257098.765086:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734257098.765094:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257098.765097:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098177152, portal 10 00000400:00000200:2.0:1734257098.765097:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734257098.765100:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000400:00000200:2.0:1734257098.765101:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:1.0:1734257098.765102:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098177152, offset 0 00000400:00000200:2.0:1734257098.765104:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257098.765106:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257098.765107:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257098.765109:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257098.765111:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [115:115:256:4294967295] 192.168.202.108@tcp LPNI seq info [114:114:8:4294967295] 00000400:00000200:2.0:1734257098.766467:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734257098.766503:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257098.766506:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257098.766508:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257098.766510:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257098.766512:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257098.766514:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [116:116:255:4294967295] 192.168.202.108@tcp LPNI seq info [115:115:7:4294967295] 00000400:00000200:1.0:1734257098.766520:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257098.766524:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257098.766529:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734257098.766533:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257098.766540:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257098.766543:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257098.766616:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257098.766619:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257098.766638:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257098.766641:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257098.766643:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257098.766817:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257098.766820:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734257098.766825:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257098.766828:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257098.766832:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:0.0:1734257098.766834:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:0.0:1734257098.766841:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098177152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257108 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257098.767206:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257098.767209:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257098.767212:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257098.767215:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257098.767217:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:0.0:1734257098.767218:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:0.0:1734257098.767222:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098177024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257114 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257098.773660:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257098.773676:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603800 00000400:00000200:0.0:1734257098.773683:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x489 [1] + 224 00000400:00000200:0.0:1734257098.773693:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257098.773696:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257098.773704:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098177024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257114 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257098.774162:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257098.774169:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603880 00000400:00000200:0.0:1734257098.774174:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x491 [1] + 0 00000400:00000200:0.0:1734257098.774189:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257098.774192:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257098.774196:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098177152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257108 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257098.774964:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257098.774968:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257098.774971:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257098.774975:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098177024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257114 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257098.774982:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098177024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257114 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257098.775002:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734257098.775006:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734257098.775009:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:1.0:1734257098.775078:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257098.775082:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257098.775083:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257098.775087:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098177152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257108 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257098.775093:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098177152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257108 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257098.775119:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257098.775123:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734257098.775125:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257103.771753:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257103.771773:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257103.771825:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257103.771832:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257103.771843:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257103.771851:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257103.771856:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257103.771862:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098177280, portal 25 00000400:00000010:3.0:1734257103.771866:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734257103.771868:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098177280, offset 0 00000400:00000200:3.0:1734257103.771875:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257103.771885:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257103.771891:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257103.771894:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257103.771896:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257103.771898:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257103.771901:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [117:117:256:4294967295] 192.168.202.108@tcp LPNI seq info [116:116:8:4294967295] 00000400:00000200:3.0:1734257103.771908:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257103.771913:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257103.771917:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734257103.771932:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257103.771939:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257103.771942:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734257103.772031:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257103.772036:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257103.772038:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257103.772041:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098177408, portal 10 00000400:00000010:1.0:1734257103.772045:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734257103.772046:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098177408, offset 0 00000400:00000200:1.0:1734257103.772050:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257103.772095:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257103.772098:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257103.772100:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257103.772102:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257103.772103:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257103.772105:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [118:118:255:4294967295] 192.168.202.108@tcp LPNI seq info [117:117:7:4294967295] 00000400:00000200:1.0:1734257103.772110:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257103.772114:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257103.772117:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734257103.772119:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257103.772123:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257103.772124:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257103.772253:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257103.772256:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734257103.772263:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257103.772267:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257103.772271:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734257103.772272:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734257103.772277:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098177280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257119 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257103.772314:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257103.772316:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734257103.772318:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257103.772321:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257103.772322:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:0.0:1734257103.772323:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:0.0:1734257103.772326:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098177408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257113 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257103.776367:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257103.776382:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603900 00000400:00000200:0.0:1734257103.776389:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x499 [1] + 224 00000400:00000200:0.0:1734257103.776397:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257103.776400:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257103.776408:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098177280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257119 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257103.776443:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257103.776446:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603980 00000400:00000200:0.0:1734257103.776451:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x4a1 [1] + 0 00000400:00000200:0.0:1734257103.776464:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257103.776467:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257103.776471:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098177408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257113 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257103.776555:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257103.776559:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257103.776560:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257103.776564:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098177408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257113 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257103.776619:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098177408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257113 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:1.0:1734257103.776646:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 00000400:00000010:3.0:1734257103.777658:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257103.777663:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257103.777664:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257103.777670:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098177280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257119 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257103.777675:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098177280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257119 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257103.777689:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257103.777694:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734257103.777697:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 02000000:00000010:1.0:1734257103.780138:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257103.780148:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734257103.780152:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257108.779683:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257108.779707:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734257108.779751:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257108.779755:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734257108.779775:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734257108.779782:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257108.779788:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257108.779794:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098177536, portal 25 00000400:00000010:2.0:1734257108.779799:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734257108.779801:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098177536, offset 0 00000400:00000200:2.0:1734257108.779808:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257108.779818:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257108.779823:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257108.779827:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257108.779829:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257108.779831:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257108.779834:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [119:119:256:4294967295] 192.168.202.108@tcp LPNI seq info [118:118:8:4294967295] 02000000:00000010:1.0:1734257108.779835:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257108.779839:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000200:2.0:1734257108.779841:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734257108.779842:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257108.779845:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098177664, portal 10 00000800:00000200:2.0:1734257108.779846:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734257108.779849:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734257108.779850:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098177664, offset 0 00000800:00000010:2.0:1734257108.779850:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734257108.779855:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734257108.779855:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734257108.779859:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734257108.779861:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734257108.779862:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257108.779864:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257108.779866:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257108.779867:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257108.779869:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [120:120:255:4294967295] 192.168.202.108@tcp LPNI seq info [119:119:7:4294967295] 00000800:00000200:2.0:1734257108.779869:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734257108.779875:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257108.779878:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257108.779881:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734257108.779883:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257108.779886:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257108.779888:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257108.779957:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257108.779959:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257108.779963:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257108.779966:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257108.779969:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734257108.779971:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734257108.779977:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098177536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257124 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257108.780034:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257108.780036:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734257108.780038:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257108.780041:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257108.780043:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:0.0:1734257108.780044:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:0.0:1734257108.780047:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098177664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257118 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257108.781344:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257108.781355:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603a00 00000400:00000200:0.0:1734257108.781360:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x4a9 [1] + 224 00000400:00000200:0.0:1734257108.781368:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257108.781371:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257108.781377:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098177536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257124 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257108.781410:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257108.781414:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603a80 00000400:00000200:0.0:1734257108.781417:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x4b1 [1] + 0 00000400:00000200:0.0:1734257108.781428:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257108.781435:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257108.781439:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098177664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257118 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257108.781496:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257108.781499:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257108.781501:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257108.781505:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098177664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257118 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257108.781512:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098177664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257118 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257108.781519:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257108.781523:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257108.781524:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257108.781528:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098177536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257124 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257108.781534:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098177536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257124 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257108.781537:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257108.781542:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734257108.781558:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 02000000:00000010:2.0:1734257108.781603:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734257108.781606:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734257108.781608:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734257113.787662:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257113.787678:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734257113.787721:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257113.787725:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734257113.787751:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257113.787760:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257113.787766:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257113.787771:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098177792, portal 25 02000000:00000010:1.0:1734257113.787775:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:3.0:1734257113.787775:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734257113.787777:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098177792, offset 0 00000400:00000010:1.0:1734257113.787780:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000200:3.0:1734257113.787784:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734257113.787788:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257113.787791:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098177920, portal 10 00000400:00000010:1.0:1734257113.787795:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000400:00000200:3.0:1734257113.787795:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:1.0:1734257113.787796:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098177920, offset 0 00000400:00000200:3.0:1734257113.787799:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257113.787801:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257113.787802:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257113.787805:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257113.787807:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257113.787809:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [121:121:256:4294967295] 192.168.202.108@tcp LPNI seq info [120:120:8:4294967295] 00000400:00000200:3.0:1734257113.787817:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734257113.787822:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734257113.787822:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257113.787825:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734257113.787825:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000400:00000200:1.0:1734257113.787826:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257113.787828:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257113.787830:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734257113.787830:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734257113.787832:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [122:122:255:4294967295] 192.168.202.108@tcp LPNI seq info [121:121:7:4294967295] 00000800:00000200:3.0:1734257113.787837:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734257113.787839:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257113.787842:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257113.787845:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734257113.787848:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257113.787851:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257113.787851:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257113.787853:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257113.787914:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257113.787917:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734257113.787921:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257113.787925:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257113.787929:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734257113.787930:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734257113.787937:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098177792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257129 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257113.787987:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257113.787989:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734257113.787991:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257113.787994:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257113.787996:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734257113.787997:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734257113.788000:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098177920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257123 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257113.789402:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257113.789412:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603b00 00000400:00000200:0.0:1734257113.789418:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x4b9 [1] + 224 00000400:00000200:0.0:1734257113.789426:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257113.789429:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257113.789435:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098177792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257129 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257113.789463:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257113.789473:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603b80 00000400:00000200:0.0:1734257113.789477:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x4c1 [1] + 0 00000400:00000200:0.0:1734257113.789486:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257113.789488:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257113.789491:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098177920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257123 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257113.789545:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257113.789549:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257113.789550:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257113.789554:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098177920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257123 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257113.789561:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098177920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257123 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257113.789616:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257113.789619:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257113.789620:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257113.789624:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098177792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257129 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257113.789625:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257113.789630:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000200:3.0:1734257113.789631:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098177792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257129 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:1.0:1734257113.789633:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 02000000:00000010:3.0:1734257113.789646:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257113.789650:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734257113.789651:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257118.796672:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257118.796691:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734257118.796750:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257118.796756:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734257118.796790:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257118.796798:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257118.796804:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257118.796810:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098178048, portal 25 00000400:00000010:3.0:1734257118.796813:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734257118.796815:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098178048, offset 0 02000000:00000010:1.0:1734257118.796816:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257118.796821:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000200:3.0:1734257118.796822:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734257118.796826:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257118.796828:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098178176, portal 10 00000400:00000010:1.0:1734257118.796831:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734257118.796833:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098178176, offset 0 00000400:00000200:3.0:1734257118.796833:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257118.796837:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257118.796837:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257118.796841:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257118.796844:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257118.796846:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257118.796848:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [123:123:256:4294967295] 192.168.202.108@tcp LPNI seq info [122:122:8:4294967295] 00000400:00000200:3.0:1734257118.796855:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257118.796860:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257118.796861:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257118.796863:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734257118.796863:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000400:00000200:1.0:1734257118.796864:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257118.796865:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257118.796867:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257118.796868:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [124:124:255:4294967295] 192.168.202.108@tcp LPNI seq info [123:123:7:4294967295] 00000800:00000200:3.0:1734257118.796868:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734257118.796872:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257118.796874:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734257118.796875:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:1.0:1734257118.796876:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734257118.796878:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257118.796878:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257118.796881:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257118.796883:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257118.797150:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257118.797152:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734257118.797159:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257118.797163:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257118.797166:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734257118.797167:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734257118.797173:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098178176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257128 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257118.797321:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257118.797323:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734257118.797326:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257118.797337:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257118.797339:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734257118.797340:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734257118.797344:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098178048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257134 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257118.801033:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257118.801050:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603c80 00000400:00000200:0.0:1734257118.801057:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x4d1 [1] + 0 00000400:00000200:0.0:1734257118.801075:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257118.801085:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257118.801095:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098178176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257128 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257118.801161:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257118.801165:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257118.801167:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257118.801172:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098178176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257128 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257118.801179:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098178176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257128 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257118.801209:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257118.801213:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734257118.801217:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734257118.803806:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257118.803822:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603c00 00000400:00000200:0.0:1734257118.803829:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x4c9 [1] + 224 00000400:00000200:0.0:1734257118.803846:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257118.803849:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257118.803858:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098178048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257134 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257118.803924:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257118.803929:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257118.803931:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257118.803937:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098178048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257134 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257118.803944:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098178048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257134 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257118.803962:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257118.803966:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734257118.803970:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734257123.804298:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257123.804315:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 02000000:00000010:3.0:1734257123.805040:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257123.805046:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257123.805051:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257123.805056:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098178304, portal 25 00000400:00000010:3.0:1734257123.805060:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734257123.805062:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098178304, offset 0 00000400:00000200:3.0:1734257123.805070:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257123.805080:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257123.805085:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257123.805088:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257123.805090:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257123.805092:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257123.805094:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [125:125:256:4294967295] 192.168.202.108@tcp LPNI seq info [124:124:8:4294967295] 00000400:00000200:3.0:1734257123.805101:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257123.805105:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257123.805108:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734257123.805112:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257123.805119:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257123.805122:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257123.805801:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257123.805811:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734257123.805844:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734257123.805847:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50aa8. 00000400:00000010:0.0:1734257123.805850:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734257123.805853:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098178432, portal 10 00000400:00000010:0.0:1734257123.805856:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000100:00000200:0.0:1734257123.805857:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098178432, offset 0 00000400:00000200:0.0:1734257123.805861:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257123.805866:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257123.805868:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257123.805870:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257123.805872:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257123.805874:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257123.805876:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [126:126:255:4294967295] 192.168.202.108@tcp LPNI seq info [125:125:7:4294967295] 00000400:00000200:0.0:1734257123.805882:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257123.805885:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257123.805896:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734257123.805899:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257123.805903:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257123.805904:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257123.805994:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257123.805997:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734257123.806001:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257123.806005:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257123.806008:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:1.0:1734257123.806010:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:1.0:1734257123.806015:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098178304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257139 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257123.806076:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257123.806078:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734257123.806080:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257123.806082:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257123.806085:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:1.0:1734257123.806086:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:1.0:1734257123.806089:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098178432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257133 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257123.808157:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257123.808169:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603d00 00000400:00000200:0.0:1734257123.808175:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x4d9 [1] + 224 00000400:00000200:0.0:1734257123.808184:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257123.808187:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257123.808194:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098178304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257139 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257123.808521:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257123.808526:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603d80 00000400:00000010:3.0:1734257123.808526:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257123.808535:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257123.808537:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000400:00000200:0.0:1734257123.808541:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x4e1 [1] + 0 00000100:00000200:3.0:1734257123.808541:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098178304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257139 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257123.808547:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098178304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257139 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257123.808552:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257123.808554:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257123.808558:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098178432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257133 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257123.808565:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257123.808589:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734257123.808592:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:1.0:1734257123.808641:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50aa8. 00000400:00000200:1.0:1734257123.808644:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:1.0:1734257123.808645:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:1.0:1734257123.808648:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098178432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257133 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257123.808652:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098178432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257133 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257123.808663:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257123.808665:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734257123.808667:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257128.811713:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257128.811738:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257128.811798:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257128.811805:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734257128.811904:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734257128.811913:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257128.811920:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257128.811927:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098178560, portal 25 00000400:00000010:2.0:1734257128.811932:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734257128.811934:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098178560, offset 0 00000400:00000200:2.0:1734257128.811944:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257128.811959:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257128.811965:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257128.811969:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257128.811972:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257128.811974:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257128.811977:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [127:127:256:4294967295] 192.168.202.108@tcp LPNI seq info [126:126:8:4294967295] 00000400:00000200:2.0:1734257128.811986:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257128.811992:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257128.811996:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257128.812001:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257128.812009:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257128.812013:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257128.812560:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257128.812563:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257128.812584:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257128.812588:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257128.812591:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734257128.812593:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734257128.812600:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098178560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257144 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257128.812897:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257128.812916:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257128.812922:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257128.812928:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098178688, portal 10 00000400:00000010:1.0:1734257128.812933:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734257128.812935:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098178688, offset 0 00000400:00000200:1.0:1734257128.812943:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257128.812952:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257128.812956:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257128.812959:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257128.812961:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257128.812963:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257128.812966:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [128:128:256:4294967295] 192.168.202.108@tcp LPNI seq info [127:127:8:4294967295] 00000400:00000200:1.0:1734257128.812973:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257128.812977:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257128.812980:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734257128.812985:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257128.812992:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257128.812995:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257128.813322:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257128.813326:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734257128.813329:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257128.813333:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257128.813336:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:0.0:1734257128.813337:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:0.0:1734257128.813343:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098178688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257138 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257128.816214:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257128.816235:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603e80 00000400:00000200:0.0:1734257128.816243:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x4f1 [1] + 0 00000400:00000200:0.0:1734257128.816256:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257128.816260:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257128.816270:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098178688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257138 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257128.819137:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257128.819149:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257128.819151:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257128.819163:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098178688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257138 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257128.819172:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098178688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257138 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257128.819206:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257128.819213:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734257128.819218:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734257128.819338:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257128.819350:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603e00 00000400:00000200:0.0:1734257128.819358:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x4e9 [1] + 224 00000400:00000200:0.0:1734257128.819390:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257128.819394:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257128.819401:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098178560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257144 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257128.819488:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257128.819492:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257128.819494:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257128.819499:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098178560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257144 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257128.819504:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098178560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257144 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257128.819515:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734257128.819518:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734257128.819520:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257133.820522:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257133.820546:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257133.820615:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257133.820620:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257133.820834:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257133.820842:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257133.820849:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257133.820856:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098178816, portal 25 00000400:00000010:3.0:1734257133.820859:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734257133.820861:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098178816, offset 0 00000400:00000200:3.0:1734257133.820870:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257133.820883:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257133.820888:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257133.820892:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257133.820895:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257133.820897:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257133.820900:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [129:129:256:4294967295] 192.168.202.108@tcp LPNI seq info [128:128:8:4294967295] 00000400:00000200:3.0:1734257133.820907:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257133.820912:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257133.820916:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257133.820920:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257133.820928:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257133.820932:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257133.821391:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257133.821394:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:3.0:1734257133.821397:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257133.821413:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257133.821417:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734257133.821419:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734257133.821426:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098178816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257149 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257133.822142:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257133.822149:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257133.822159:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257133.822162:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098178944, portal 10 00000400:00000010:1.0:1734257133.822168:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734257133.822169:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098178944, offset 0 00000400:00000200:1.0:1734257133.822175:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257133.822181:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257133.822184:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257133.822187:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257133.822189:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257133.822191:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257133.822193:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [130:130:256:4294967295] 192.168.202.108@tcp LPNI seq info [129:129:8:4294967295] 00000400:00000200:1.0:1734257133.822199:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257133.822203:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257133.822206:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734257133.822210:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257133.822215:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257133.822217:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257133.822702:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257133.822705:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:2.0:1734257133.822708:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257133.822711:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257133.822714:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:2.0:1734257133.822715:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:2.0:1734257133.822720:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098178944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257143 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257133.827296:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257133.827319:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c603f00 00000400:00000200:0.0:1734257133.827350:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x4f9 [1] + 224 00000400:00000200:0.0:1734257133.827365:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257133.827369:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257133.827381:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098178816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257149 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257133.827418:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257133.827423:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c603f80 00000400:00000200:0.0:1734257133.827428:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x501 [1] + 0 00000400:00000200:0.0:1734257133.827442:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257133.827445:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257133.827450:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098178944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257143 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257133.827954:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257133.827960:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257133.827962:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257133.827968:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098178816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257149 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257133.827974:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098178816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257149 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257133.827998:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257133.828003:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734257133.828007:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:1.0:1734257133.834472:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257133.834484:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257133.834486:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257133.834499:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098178944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257143 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257133.834508:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098178944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257143 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257133.834540:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257133.834547:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734257133.834552:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257138.828501:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257138.828523:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257138.829047:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257138.829055:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734257138.829251:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257138.829264:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257138.829271:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257138.829277:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098179072, portal 25 00000400:00000010:3.0:1734257138.829281:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734257138.829283:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098179072, offset 0 00000400:00000200:3.0:1734257138.829291:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257138.829317:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257138.829321:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257138.829325:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257138.829327:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257138.829329:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257138.829332:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [131:131:256:4294967295] 192.168.202.108@tcp LPNI seq info [130:130:8:4294967295] 00000400:00000200:3.0:1734257138.829339:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257138.829344:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257138.829347:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257138.829362:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257138.829369:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257138.829373:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257138.829485:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257138.829488:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:3.0:1734257138.829490:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257138.829495:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257138.829498:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734257138.829500:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734257138.829505:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098179072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257154 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257138.829700:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257138.829708:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257138.829713:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257138.829728:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098179200, portal 10 00000400:00000010:1.0:1734257138.829734:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734257138.829736:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098179200, offset 0 00000400:00000200:1.0:1734257138.829744:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257138.829753:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257138.829757:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257138.829760:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257138.829762:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257138.829764:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257138.829766:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [132:132:256:4294967295] 192.168.202.108@tcp LPNI seq info [131:131:8:4294967295] 00000400:00000200:1.0:1734257138.829774:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257138.829778:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257138.829782:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734257138.829786:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257138.829792:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257138.829795:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257138.830081:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257138.830094:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:2.0:1734257138.830097:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257138.830101:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257138.830105:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:2.0:1734257138.830107:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:2.0:1734257138.830112:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098179200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257148 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257138.831260:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257138.831272:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604000 00000400:00000200:0.0:1734257138.831280:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x509 [1] + 224 00000400:00000200:0.0:1734257138.831296:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257138.831300:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257138.831317:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098179072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257154 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257138.831504:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257138.831508:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257138.831511:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257138.831516:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098179072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257154 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257138.831524:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000100:00000200:3.0:1734257138.831524:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098179072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257154 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257138.831534:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604080 00000400:00000200:0.0:1734257138.831541:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x511 [1] + 0 02000000:00000010:3.0:1734257138.831545:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257138.831550:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734257138.831554:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734257138.831555:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257138.831564:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257138.831604:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098179200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257138.831766:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257138.831770:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257138.831771:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257138.831776:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098179200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257148 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257138.831782:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098179200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257148 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257138.831805:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257138.831810:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734257138.831815:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734257143.836058:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257143.836077:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257143.836124:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257143.836131:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257143.836182:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257143.836195:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257143.836203:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257143.836210:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098179328, portal 25 00000400:00000010:3.0:1734257143.836216:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734257143.836218:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098179328, offset 0 00000400:00000200:3.0:1734257143.836227:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257143.836242:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:1.0:1734257143.836245:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000200:3.0:1734257143.836248:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257143.836251:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:1.0:1734257143.836253:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000200:3.0:1734257143.836255:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:1.0:1734257143.836259:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257143.836277:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098179456, portal 10 00000400:00000200:3.0:1734257143.836278:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257143.836281:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [133:133:256:4294967295] 192.168.202.108@tcp LPNI seq info [132:132:8:4294967295] 00000400:00000200:3.0:1734257143.836293:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734257143.836294:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734257143.836296:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098179456, offset 0 00000800:00000200:3.0:1734257143.836299:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257143.836304:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257143.836304:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257143.836310:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734257143.836314:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257143.836318:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:3.0:1734257143.836320:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734257143.836322:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257143.836324:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734257143.836324:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734257143.836326:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257143.836328:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [134:134:255:4294967295] 192.168.202.108@tcp LPNI seq info [133:133:7:4294967295] 00000400:00000200:1.0:1734257143.836335:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257143.836340:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257143.836343:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734257143.836348:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257143.836354:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257143.836357:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257143.836391:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257143.836395:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:2.0:1734257143.836400:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257143.836404:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257143.836408:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:2.0:1734257143.836410:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:2.0:1734257143.836421:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098179328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257159 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257143.836492:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257143.836493:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:2.0:1734257143.836496:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257143.836498:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257143.836500:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:2.0:1734257143.836502:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:2.0:1734257143.836506:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098179456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257153 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257143.840091:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257143.840108:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604180 00000400:00000200:0.0:1734257143.840116:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x521 [1] + 0 00000400:00000200:0.0:1734257143.840136:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257143.840140:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257143.840149:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098179456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257143.840366:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257143.840370:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257143.840372:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257143.840377:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098179456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257153 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257143.840383:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098179456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257153 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257143.840405:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257143.840409:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734257143.840414:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734257143.840652:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257143.840658:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604100 00000400:00000200:0.0:1734257143.840663:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x519 [1] + 224 00000400:00000200:0.0:1734257143.840673:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257143.840676:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257143.840681:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098179328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257159 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257143.841474:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257143.841479:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257143.841480:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257143.841484:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098179328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257159 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257143.841490:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098179328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257159 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257143.841501:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257143.841504:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734257143.841506:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734257148.843631:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257148.843651:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257148.843700:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257148.843706:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257148.843710:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734257148.843717:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257148.843722:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257148.843728:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098179584, portal 25 00000400:00000010:2.0:1734257148.843732:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734257148.843733:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098179584, offset 0 00000400:00000200:2.0:1734257148.843740:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257148.843750:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257148.843753:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257148.843757:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257148.843759:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257148.843761:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:1.0:1734257148.843762:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000200:2.0:1734257148.843763:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [135:135:256:4294967295] 192.168.202.108@tcp LPNI seq info [134:134:8:4294967295] 00000400:00000010:1.0:1734257148.843766:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000200:2.0:1734257148.843770:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734257148.843772:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257148.843774:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098179712, portal 10 00000800:00000200:2.0:1734257148.843774:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734257148.843777:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000800:00000010:2.0:1734257148.843777:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257148.843781:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:1.0:1734257148.843786:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098179712, offset 0 00000800:00000200:2.0:1734257148.843787:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734257148.843789:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734257148.843790:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734257148.843793:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257148.843794:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257148.843796:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257148.843797:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257148.843798:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257148.843800:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [136:136:255:4294967295] 192.168.202.108@tcp LPNI seq info [135:135:7:4294967295] 00000400:00000200:1.0:1734257148.843805:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257148.843809:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257148.843811:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734257148.843814:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257148.843817:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257148.843820:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734257148.843842:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257148.843845:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:3.0:1734257148.843850:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257148.843853:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257148.843856:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:3.0:1734257148.843858:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:3.0:1734257148.843865:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098179584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257164 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734257148.843915:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257148.843916:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:3.0:1734257148.843917:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257148.843919:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257148.843920:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:3.0:1734257148.843925:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:3.0:1734257148.843929:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098179712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257158 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257148.846436:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257148.846449:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604200 00000400:00000200:0.0:1734257148.846457:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x529 [1] + 224 00000400:00000200:0.0:1734257148.846476:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257148.846479:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257148.846487:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098179584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257164 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257148.846523:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257148.846528:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604280 00000400:00000200:0.0:1734257148.846533:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x531 [1] + 0 00000400:00000200:0.0:1734257148.846559:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:2.0:1734257148.846560:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:0.0:1734257148.846562:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257148.846564:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257148.846612:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257148.846619:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098179584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257164 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734257148.846621:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098179712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257158 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257148.846626:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098179584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257164 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257148.846646:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734257148.846650:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734257148.846653:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:1.0:1734257148.846689:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257148.846694:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257148.846695:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257148.846701:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098179712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257158 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257148.846708:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098179712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257158 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257148.846725:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257148.846729:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734257148.846731:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:2.0:1734257153.852558:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734257153.852599:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734257153.852641:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734257153.852646:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734257153.852731:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3be00. 00000400:00000010:0.0:1734257153.852739:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50aa8. 00000400:00000010:0.0:1734257153.852745:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:0.0:1734257153.852750:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098179840, portal 25 00000400:00000010:0.0:1734257153.852754:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000100:00000200:0.0:1734257153.852755:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098179840, offset 0 00000400:00000200:0.0:1734257153.852762:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257153.852772:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257153.852776:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257153.852780:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257153.852783:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257153.852784:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257153.852787:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [137:137:256:4294967295] 192.168.202.108@tcp LPNI seq info [136:136:8:4294967295] 00000400:00000200:0.0:1734257153.852794:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257153.852798:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257153.852801:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734257153.852805:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257153.852812:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257153.852823:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734257153.853059:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257153.853063:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257153.853066:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257153.853069:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098179968, portal 10 00000400:00000010:1.0:1734257153.853072:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734257153.853073:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098179968, offset 0 00000400:00000200:1.0:1734257153.853082:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257153.853086:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257153.853088:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257153.853090:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257153.853091:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257153.853093:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257153.853095:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [138:138:255:4294967295] 192.168.202.108@tcp LPNI seq info [137:137:7:4294967295] 00000400:00000200:1.0:1734257153.853101:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257153.853104:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257153.853107:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734257153.853115:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257153.853118:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257153.853120:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257153.853585:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257153.853589:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:0.0:1734257153.853592:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257153.853600:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257153.853603:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:0.0:1734257153.853605:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:0.0:1734257153.853611:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098179840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257169 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257153.853726:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257153.853729:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734257153.853731:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257153.853734:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257153.853737:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734257153.853738:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734257153.853741:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098179968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257163 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257153.855113:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257153.855126:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604300 00000400:00000200:0.0:1734257153.855132:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x539 [1] + 224 00000400:00000200:0.0:1734257153.855147:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257153.855150:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257153.855157:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098179840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257169 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257153.855596:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50aa8. 00000400:00000200:2.0:1734257153.855601:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:2.0:1734257153.855603:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:2.0:1734257153.855607:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098179840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257169 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257153.855614:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098179840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257169 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257153.855632:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3be00. 02000000:00000010:2.0:1734257153.855636:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734257153.855640:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000200:0.0:1734257153.856358:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257153.856365:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604380 00000400:00000200:0.0:1734257153.856371:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x541 [1] + 0 00000400:00000200:0.0:1734257153.856382:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257153.856385:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257153.856391:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098179968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257163 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257153.856601:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257153.856605:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257153.856607:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257153.856611:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098179968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257163 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257153.856622:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098179968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257163 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257153.856638:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257153.856642:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734257153.856645:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:0.0:1734257158.860248:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257158.860269:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257158.860335:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257158.860345:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734257158.860399:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734257158.860406:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50688. 00000400:00000010:0.0:1734257158.860411:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000100:00000200:0.0:1734257158.860420:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098180224, portal 10 00000400:00000010:0.0:1734257158.860428:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734257158.860430:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098180224, offset 0 00000400:00000200:0.0:1734257158.860438:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257158.860453:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257158.860458:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257158.860462:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257158.860465:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257158.860467:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257158.860471:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [139:139:256:4294967295] 192.168.202.108@tcp LPNI seq info [138:138:8:4294967295] 00000400:00000200:0.0:1734257158.860481:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257158.860485:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257158.860488:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734257158.860497:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257158.860504:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257158.860507:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257158.860611:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257158.860614:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:0.0:1734257158.860616:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257158.860619:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257158.860623:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:0.0:1734257158.860624:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734257158.860630:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098180224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257168 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257158.860643:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257158.860648:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257158.860651:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257158.860653:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098180096, portal 25 00000400:00000010:3.0:1734257158.860656:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734257158.860657:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098180096, offset 0 00000400:00000200:3.0:1734257158.860662:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257158.860666:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257158.863209:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257158.863216:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257158.863219:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257158.863222:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257158.863225:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [140:140:256:4294967295] 192.168.202.108@tcp LPNI seq info [139:139:8:4294967295] 00000400:00000200:3.0:1734257158.863233:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257158.863238:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257158.863242:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734257158.863246:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257158.863253:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257158.863256:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257158.863354:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257158.863357:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734257158.863361:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257158.863364:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257158.863368:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734257158.863369:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734257158.863376:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098180096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257174 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257158.868640:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257158.868657:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604480 00000400:00000200:0.0:1734257158.868664:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x549 [1] + 0 00000400:00000200:0.0:1734257158.868674:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257158.868677:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257158.868685:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098180224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257168 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257158.868973:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257158.868978:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604400 00000400:00000200:0.0:1734257158.868983:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x551 [1] + 224 00000400:00000200:0.0:1734257158.868996:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257158.868998:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257158.869003:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098180096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257174 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257158.869192:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50688. 00000400:00000200:2.0:1734257158.869197:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:2.0:1734257158.869198:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:2.0:1734257158.869203:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098180224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257168 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257158.869209:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098180224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257168 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257158.869234:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:2.0:1734257158.869238:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257158.869249:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:3.0:1734257158.869322:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257158.869326:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257158.869327:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257158.869331:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098180096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257174 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257158.869336:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098180096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257174 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257158.869346:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257158.869354:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734257158.869355:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257163.867799:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257163.867818:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734257163.867870:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257163.867875:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:0.0:1734257163.867909:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257163.867980:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734257163.867986:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257163.867991:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257163.867997:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098180352, portal 25 00000400:00000010:2.0:1734257163.868001:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257163.868003:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098180352, offset 0 00000400:00000200:2.0:1734257163.868010:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257163.868022:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257163.868026:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257163.868030:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257163.868033:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257163.868035:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257163.868037:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [141:141:256:4294967295] 192.168.202.108@tcp LPNI seq info [140:140:8:4294967295] 00000400:00000200:2.0:1734257163.868043:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257163.868047:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257163.868050:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257163.868056:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257163.868063:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257163.868066:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:0.0:1734257163.868308:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d506e0. 00000400:00000010:0.0:1734257163.868320:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734257163.868322:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098180480, portal 10 00000400:00000010:0.0:1734257163.868326:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734257163.868328:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098180480, offset 0 00000400:00000200:0.0:1734257163.868332:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257163.868335:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257163.868337:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257163.868339:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257163.868341:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257163.868342:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257163.868345:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [142:142:255:4294967295] 192.168.202.108@tcp LPNI seq info [141:141:7:4294967295] 00000400:00000200:0.0:1734257163.868350:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257163.868353:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257163.868355:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734257163.868357:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257163.868361:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257163.868363:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257163.869741:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257163.869746:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734257163.869753:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257163.869758:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257163.869762:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:1.0:1734257163.869764:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:1.0:1734257163.869773:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098180352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257179 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257163.869844:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257163.869846:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734257163.869848:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257163.869851:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257163.869854:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:1.0:1734257163.869855:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:1.0:1734257163.869858:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098180480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257173 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257163.872075:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257163.872089:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604500 00000400:00000200:0.0:1734257163.872097:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x559 [1] + 224 00000400:00000200:0.0:1734257163.872124:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257163.872127:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257163.872136:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098180352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257179 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257163.873252:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257163.873259:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257163.873261:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257163.873266:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098180352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257179 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257163.873274:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098180352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257179 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257163.873393:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734257163.873397:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:2.0:1734257163.873400:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000200:2.0:1734257163.873781:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:2.0:1734257163.873790:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604580 00000400:00000200:2.0:1734257163.873795:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x561 [1] + 0 00000400:00000200:2.0:1734257163.873808:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257163.873811:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:2.0:1734257163.873816:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098180480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257173 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:0.0:1734257163.873887:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d506e0. 00000400:00000200:0.0:1734257163.873890:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:0.0:1734257163.873891:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734257163.873896:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098180480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257173 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734257163.873901:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098180480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257173 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:0.0:1734257163.873922:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:0.0:1734257163.873925:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:0.0:1734257163.873926:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257168.875901:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257168.875921:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257168.877145:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257168.877156:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734257168.877353:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734257168.877359:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257168.877365:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257168.877370:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098180608, portal 25 00000400:00000010:2.0:1734257168.877374:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734257168.877375:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098180608, offset 0 00000400:00000200:2.0:1734257168.877382:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257168.877393:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257168.877396:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257168.877400:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257168.877402:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257168.877404:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257168.877406:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [143:143:256:4294967295] 192.168.202.108@tcp LPNI seq info [142:142:8:4294967295] 00000400:00000200:2.0:1734257168.877413:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257168.877416:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257168.877419:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257168.877423:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257168.877430:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257168.877432:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734257168.877453:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734257168.877462:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257168.877465:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257168.877468:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098180736, portal 10 00000400:00000010:1.0:1734257168.877472:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 00000100:00000200:1.0:1734257168.877474:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098180736, offset 0 00000400:00000200:1.0:1734257168.877478:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257168.877483:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257168.877485:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257168.877487:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257168.877489:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257168.877490:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257168.877492:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [144:144:255:4294967295] 192.168.202.108@tcp LPNI seq info [143:143:7:4294967295] 00000400:00000200:1.0:1734257168.877503:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257168.877507:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257168.877513:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734257168.877516:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257168.877519:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257168.877521:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257168.877526:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257168.877528:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257168.877532:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257168.877535:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257168.877539:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734257168.877540:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734257168.877546:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098180608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257184 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257168.877615:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257168.877617:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734257168.877619:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257168.877622:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257168.877624:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:0.0:1734257168.877625:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:0.0:1734257168.877628:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098180736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257178 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257168.881823:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257168.881838:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604680 00000400:00000200:0.0:1734257168.881845:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x571 [1] + 0 00000400:00000200:0.0:1734257168.881861:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257168.881864:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257168.881873:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098180736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257168.881948:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257168.881953:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257168.881955:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257168.881965:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098180736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257178 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257168.881972:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098180736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257178 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257168.881998:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734257168.882003:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734257168.882007:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734257168.884513:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257168.884528:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604600 00000400:00000200:0.0:1734257168.884535:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x569 [1] + 224 00000400:00000200:0.0:1734257168.884552:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257168.884555:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257168.884564:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098180608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257184 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257168.886263:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257168.886271:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257168.886273:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257168.886281:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098180608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257184 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257168.886296:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098180608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257184 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257168.886315:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734257168.886319:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734257168.886322:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257173.884066:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257173.884085:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257173.885553:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257173.885563:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734257173.885634:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257173.885641:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257173.885646:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257173.885651:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098180864, portal 25 00000400:00000010:3.0:1734257173.885654:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734257173.885656:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098180864, offset 0 00000400:00000200:3.0:1734257173.885663:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257173.885673:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257173.885677:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257173.885680:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257173.885683:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257173.885685:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257173.885688:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [145:145:256:4294967295] 192.168.202.108@tcp LPNI seq info [144:144:8:4294967295] 00000400:00000200:3.0:1734257173.885695:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257173.885699:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257173.885702:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734257173.885707:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257173.885713:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257173.885717:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257173.885814:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257173.885816:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:3.0:1734257173.885819:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257173.885823:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257173.885825:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:3.0:1734257173.885827:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734257173.885832:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098180864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257189 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:0.0:1734257173.886204:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734257173.886209:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d506e0. 00000400:00000010:0.0:1734257173.886212:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734257173.886214:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098180992, portal 10 00000400:00000010:0.0:1734257173.886218:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734257173.886219:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098180992, offset 0 00000400:00000200:0.0:1734257173.886223:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257173.886227:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257173.886229:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257173.886231:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257173.886233:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257173.886234:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257173.886236:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [146:146:256:4294967295] 192.168.202.108@tcp LPNI seq info [145:145:8:4294967295] 00000400:00000200:0.0:1734257173.886242:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257173.886245:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257173.886248:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734257173.886250:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257173.886263:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257173.886264:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257173.886404:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257173.886407:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:2.0:1734257173.886409:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257173.886412:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257173.886414:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:2.0:1734257173.886415:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:2.0:1734257173.886418:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098180992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257183 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257173.888550:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257173.888563:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604700 00000400:00000200:0.0:1734257173.888589:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x579 [1] + 224 00000400:00000200:0.0:1734257173.888606:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257173.888609:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257173.888617:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098180864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257189 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257173.888699:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257173.888702:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257173.888710:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257173.888714:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098180864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257189 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257173.888721:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098180864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257189 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257173.888737:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257173.888741:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734257173.888744:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734257173.890641:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257173.890653:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604780 00000400:00000200:0.0:1734257173.890659:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x581 [1] + 0 00000400:00000200:0.0:1734257173.890672:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257173.890675:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257173.890682:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098180992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257173.891344:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d506e0. 00000400:00000200:2.0:1734257173.891350:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:2.0:1734257173.891352:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:2.0:1734257173.891356:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098180992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257183 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257173.891364:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098180992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257183 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257173.891384:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734257173.891388:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257173.891391:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257178.891783:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257178.891801:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 02000000:00000010:3.0:1734257178.891902:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257178.891909:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257178.891914:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257178.891919:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098181120, portal 25 00000400:00000010:3.0:1734257178.891923:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734257178.891925:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098181120, offset 0 00000400:00000200:3.0:1734257178.891932:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257178.891942:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257178.891947:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257178.891950:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257178.891954:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257178.891956:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257178.891958:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [147:147:256:4294967295] 192.168.202.108@tcp LPNI seq info [146:146:8:4294967295] 00000400:00000200:3.0:1734257178.891965:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257178.891970:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257178.891973:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734257178.892003:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257178.892011:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257178.892014:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257178.892077:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257178.892084:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 00000800:00000200:2.0:1734257178.892147:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257178.892150:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:2.0:1734257178.892153:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 02000000:00000010:3.0:1734257178.892154:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000200:2.0:1734257178.892157:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:3.0:1734257178.892158:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c60. 00000400:00000010:3.0:1734257178.892160:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000400:00000200:2.0:1734257178.892162:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:2.0:1734257178.892163:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:2.0:1734257178.892169:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098181120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257194 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257178.892170:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098181248, portal 10 00000400:00000010:3.0:1734257178.892174:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734257178.892176:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098181248, offset 0 00000400:00000200:3.0:1734257178.892180:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257178.892184:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257178.892186:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257178.892187:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257178.892189:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257178.892191:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257178.892192:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [148:148:255:4294967295] 192.168.202.108@tcp LPNI seq info [147:147:7:4294967295] 00000400:00000200:3.0:1734257178.892198:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257178.892201:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257178.892203:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257178.892205:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257178.892208:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257178.892210:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257178.892418:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257178.892420:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:2.0:1734257178.892422:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257178.892425:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257178.892427:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:2.0:1734257178.892428:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:2.0:1734257178.892432:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098181248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257188 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257178.895036:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257178.895051:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604800 00000400:00000200:0.0:1734257178.895058:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x589 [1] + 224 00000400:00000200:0.0:1734257178.895068:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257178.895071:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257178.895079:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098181120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257178.895114:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257178.895128:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604880 00000400:00000200:0.0:1734257178.895132:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x591 [1] + 0 00000400:00000200:0.0:1734257178.895149:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257178.895152:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257178.895156:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098181248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257178.895354:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257178.895358:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257178.895360:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257178.895364:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098181120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257194 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257178.895370:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098181120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257194 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257178.895388:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257178.895392:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734257178.895394:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:2.0:1734257178.895457:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c60. 00000400:00000200:2.0:1734257178.895460:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:2.0:1734257178.895462:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:2.0:1734257178.895465:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098181248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257188 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257178.895471:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098181248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257188 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257178.895485:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:2.0:1734257178.895486:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257178.895489:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734257183.899713:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257183.899731:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257183.899781:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257183.899787:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734257183.899821:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257183.899823:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:0.0:1734257183.899825:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50738. 00000400:00000010:2.0:1734257183.899828:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:0.0:1734257183.899831:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000400:00000010:2.0:1734257183.899832:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734257183.899837:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098181504, portal 10 00000100:00000200:2.0:1734257183.899837:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098181376, portal 25 00000400:00000010:0.0:1734257183.899841:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000400:00000010:2.0:1734257183.899841:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734257183.899843:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098181504, offset 0 00000100:00000200:2.0:1734257183.899843:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098181376, offset 0 00000400:00000200:0.0:1734257183.899850:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257183.899856:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257183.899861:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257183.899865:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257183.899869:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257183.899872:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257183.899873:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257183.899876:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [149:149:256:4294967295] 192.168.202.108@tcp LPNI seq info [148:148:8:4294967295] 00000400:00000200:0.0:1734257183.899883:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257183.899887:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257183.899889:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734257183.899890:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000400:00000200:2.0:1734257183.899891:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257183.899893:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:0.0:1734257183.899895:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257183.899895:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257183.899896:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257183.899899:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [150:150:255:4294967295] 192.168.202.108@tcp LPNI seq info [149:149:7:4294967295] 00000800:00000200:0.0:1734257183.899901:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257183.899904:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734257183.899915:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257183.899919:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257183.899921:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257183.899924:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257183.899928:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257183.899930:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257183.900014:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257183.900017:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734257183.900021:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257183.900026:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257183.900029:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:1.0:1734257183.900031:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:1.0:1734257183.900037:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098181504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257193 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257183.900100:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257183.900103:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734257183.900105:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257183.900108:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257183.900110:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:1.0:1734257183.900111:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:1.0:1734257183.900114:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098181376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257199 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257183.902094:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257183.902107:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604980 00000400:00000200:0.0:1734257183.902113:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x599 [1] + 0 00000400:00000200:0.0:1734257183.902127:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257183.902130:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257183.902137:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098181504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257193 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257183.902333:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50738. 00000400:00000200:2.0:1734257183.902338:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:2.0:1734257183.902340:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:2.0:1734257183.902345:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098181504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257193 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257183.902352:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098181504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257193 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257183.902376:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257183.902380:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257183.902383:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000200:0.0:1734257183.902586:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257183.902592:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604900 00000400:00000200:0.0:1734257183.902596:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x59d [1] + 224 00000400:00000200:0.0:1734257183.902606:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257183.902610:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257183.902614:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098181376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257199 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257183.902743:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257183.902746:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257183.902747:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257183.902751:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098181376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257199 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257183.902757:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098181376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257199 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257183.902767:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734257183.902770:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:2.0:1734257183.902772:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:2.0:1734257188.907762:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734257188.907781:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734257188.907829:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734257188.907842:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257188.907870:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257188.907875:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257188.907881:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257188.907886:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098181760, portal 10 00000400:00000010:2.0:1734257188.907890:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734257188.907891:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098181760, offset 0 00000400:00000200:2.0:1734257188.907924:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257188.907935:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257188.907939:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257188.907942:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257188.907945:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257188.907947:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257188.907949:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [151:151:256:4294967295] 192.168.202.108@tcp LPNI seq info [150:150:8:4294967295] 00000400:00000200:2.0:1734257188.907957:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257188.907962:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257188.907965:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257188.907969:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257188.907975:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257188.907978:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734257188.908073:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257188.908077:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257188.908080:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257188.908082:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098181632, portal 25 00000400:00000010:3.0:1734257188.908084:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734257188.908101:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098181632, offset 0 00000400:00000200:3.0:1734257188.908105:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257188.908109:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257188.908111:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257188.908113:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257188.908114:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257188.908116:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257188.908118:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [152:152:255:4294967295] 192.168.202.108@tcp LPNI seq info [151:151:7:4294967295] 00000400:00000200:3.0:1734257188.908124:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257188.908127:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257188.908130:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734257188.908132:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257188.908135:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257188.908137:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257188.908241:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257188.908244:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734257188.908248:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257188.908252:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257188.908255:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:1.0:1734257188.908256:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:1.0:1734257188.908261:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098181760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257198 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257188.908315:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257188.908320:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:1.0:1734257188.908323:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257188.908326:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257188.908328:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:1.0:1734257188.908329:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:1.0:1734257188.908332:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098181632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257204 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257188.910146:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257188.910160:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604a80 00000400:00000200:0.0:1734257188.910167:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x5a9 [1] + 0 00000400:00000200:0.0:1734257188.910176:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257188.910179:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257188.910186:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098181760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257188.910223:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257188.910227:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604a00 00000400:00000200:0.0:1734257188.910231:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x5b1 [1] + 224 00000400:00000200:0.0:1734257188.910242:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257188.910244:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257188.910248:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098181632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257204 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257188.910309:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257188.910314:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257188.910315:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257188.910320:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098181632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257204 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257188.910327:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098181632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257204 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257188.910344:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257188.910348:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734257188.910351:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000010:2.0:1734257188.910411:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257188.910415:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257188.910416:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257188.910421:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098181760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257198 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257188.910427:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098181760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257198 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257188.910442:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257188.910446:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734257188.910448:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734257193.915938:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734257193.915956:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734257193.916009:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734257193.916014:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734257193.916029:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 02000000:00000010:2.0:1734257193.916037:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:3.0:1734257193.916037:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:2.0:1734257193.916041:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:3.0:1734257193.916043:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000010:2.0:1734257193.916044:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257193.916049:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098182016, portal 10 00000100:00000200:3.0:1734257193.916049:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098181888, portal 25 00000400:00000010:3.0:1734257193.916052:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000400:00000010:2.0:1734257193.916053:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000100:00000200:2.0:1734257193.916054:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098182016, offset 0 00000100:00000200:3.0:1734257193.916054:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098181888, offset 0 00000400:00000200:3.0:1734257193.916062:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257193.916084:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257193.916088:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257193.916092:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257193.916096:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257193.916098:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257193.916100:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [153:153:256:4294967295] 192.168.202.108@tcp LPNI seq info [152:152:8:4294967295] 00000400:00000200:3.0:1734257193.916108:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257193.916113:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257193.916116:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734257193.916121:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257193.916128:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257193.916132:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257193.916392:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257193.916395:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734257193.916398:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257193.916403:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257193.916429:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257193.916434:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257193.916436:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257193.916438:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257193.916440:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257193.916441:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257193.916444:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [154:154:255:4294967295] 192.168.202.108@tcp LPNI seq info [153:153:7:4294967295] 00000400:00000200:2.0:1734257193.916450:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257193.916465:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257193.916468:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257193.916471:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257193.916475:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257193.916477:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734257193.916550:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734257193.916553:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734257193.916561:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098181888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257209 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257193.916615:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257193.916617:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257193.916619:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257193.916622:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257193.916623:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734257193.916624:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734257193.916627:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098182016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257203 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257193.919227:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257193.919241:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604b80 00000400:00000200:0.0:1734257193.919254:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x5bd [1] + 0 00000400:00000200:0.0:1734257193.919265:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257193.919268:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257193.919276:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098182016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257203 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257193.919315:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257193.919319:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604b00 00000400:00000200:0.0:1734257193.919323:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x5b9 [1] + 224 00000400:00000200:0.0:1734257193.919338:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257193.919341:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257193.919345:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098181888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257209 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257193.919440:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257193.919444:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257193.919445:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257193.919450:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098182016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257203 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257193.919456:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098182016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257203 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257193.919490:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257193.919494:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734257193.919497:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000400:00000010:3.0:1734257193.919897:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257193.919901:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257193.919902:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257193.919908:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098181888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257209 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257193.919916:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098181888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257209 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257193.919928:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257193.919931:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734257193.919934:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734257198.924126:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734257198.924146:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734257198.924200:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734257198.924206:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257198.924238:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734257198.924241:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:2.0:1734257198.924243:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:3.0:1734257198.924245:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:2.0:1734257198.924249:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000400:00000010:3.0:1734257198.924252:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:2.0:1734257198.924254:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098182272, portal 10 00000100:00000200:3.0:1734257198.924255:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098182144, portal 25 00000400:00000010:3.0:1734257198.924257:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000400:00000010:2.0:1734257198.924258:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:3.0:1734257198.924259:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098182144, offset 0 00000100:00000200:2.0:1734257198.924260:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098182272, offset 0 00000400:00000200:3.0:1734257198.924266:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257198.924275:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257198.924275:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257198.924279:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257198.924291:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257198.924293:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257198.924295:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257198.924297:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [155:155:256:4294967295] 192.168.202.108@tcp LPNI seq info [154:154:8:4294967295] 00000400:00000200:3.0:1734257198.924304:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257198.924308:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257198.924310:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734257198.924311:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000400:00000200:2.0:1734257198.924313:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257198.924315:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734257198.924316:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257198.924317:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257198.924319:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257198.924321:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [156:156:255:4294967295] 192.168.202.108@tcp LPNI seq info [155:155:7:4294967295] 00000800:00000200:3.0:1734257198.924322:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257198.924326:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257198.924327:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257198.924330:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257198.924333:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257198.924336:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257198.924339:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257198.924341:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257198.924406:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257198.924409:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734257198.924413:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257198.924417:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257198.924420:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734257198.924422:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734257198.924428:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098182144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257214 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257198.924489:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257198.924491:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257198.924493:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257198.924496:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257198.924498:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734257198.924499:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734257198.924503:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098182272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257208 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257198.926264:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257198.926275:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604c00 00000400:00000200:0.0:1734257198.926281:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x5cd [1] + 224 00000400:00000200:0.0:1734257198.926297:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257198.926301:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257198.926306:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098182144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257214 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257198.926367:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257198.926372:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257198.926374:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257198.926378:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098182144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257214 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257198.926385:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098182144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257214 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257198.926401:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257198.926405:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734257198.926408:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000400:00000200:0.0:1734257198.926564:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257198.926591:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604c80 00000400:00000200:0.0:1734257198.926595:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x5c9 [1] + 0 00000400:00000200:0.0:1734257198.926606:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257198.926610:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257198.926615:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098182272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257208 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257198.926763:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257198.926767:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257198.926769:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257198.926778:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098182272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257208 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257198.926783:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098182272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257208 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257198.926798:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257198.926801:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734257198.926803:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:3.0:1734257203.931770:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734257203.931814:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db600. 00000100:00000010:3.0:1734257203.931863:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734257203.931868:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806400. 02000000:00000010:1.0:1734257203.931960:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734257203.931967:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257203.931972:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257203.931977:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098182400, portal 25 00000400:00000010:1.0:1734257203.931980:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734257203.931982:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098182400, offset 0 00000400:00000200:1.0:1734257203.931988:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257203.931998:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257203.932002:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257203.932006:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257203.932008:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257203.932010:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257203.932012:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [157:157:256:4294967295] 192.168.202.108@tcp LPNI seq info [156:156:8:4294967295] 00000400:00000200:1.0:1734257203.932020:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257203.932025:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257203.932028:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734257203.932032:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257203.932044:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257203.932047:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257203.932142:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257203.932145:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:1.0:1734257203.932147:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257203.932151:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257203.932154:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:1.0:1734257203.932164:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734257203.932169:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098182400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257219 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257203.932225:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257203.932229:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257203.932232:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257203.932234:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098182528, portal 10 00000400:00000010:2.0:1734257203.932238:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734257203.932239:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098182528, offset 0 00000400:00000200:2.0:1734257203.932243:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257203.932246:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257203.932248:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257203.932250:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257203.932251:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257203.932253:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257203.932254:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [158:158:256:4294967295] 192.168.202.108@tcp LPNI seq info [157:157:8:4294967295] 00000400:00000200:2.0:1734257203.932259:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257203.932262:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257203.932264:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257203.932267:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257203.932270:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257203.932272:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257203.932321:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257203.932324:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257203.932327:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257203.932330:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257203.932333:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734257203.932334:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734257203.932337:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098182528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257213 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257203.934444:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257203.934459:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604d80 00000400:00000200:0.0:1734257203.934465:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x5e1 [1] + 0 00000400:00000200:0.0:1734257203.934474:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257203.934477:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257203.934485:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098182528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257213 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257203.934519:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000010:2.0:1734257203.934742:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257203.934746:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257203.934748:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257203.934752:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098182528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257213 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257203.934767:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098182528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257213 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257203.934799:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257203.934805:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806400. 00000100:00000010:2.0:1734257203.934808:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000200:0.0:1734257203.935206:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604d00 00000400:00000200:0.0:1734257203.935212:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x5d9 [1] + 224 00000400:00000200:0.0:1734257203.935225:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257203.935227:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257203.935232:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098182400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257219 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257203.935349:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257203.935352:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257203.935354:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257203.935358:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098182400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257219 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257203.935364:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098182400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257219 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257203.935374:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734257203.935376:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db600. 00000100:00000010:1.0:1734257203.935378:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734257208.939672:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734257208.939690:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db700. 00000100:00000010:3.0:1734257208.939750:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734257208.939759:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:1.0:1734257208.939782:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734257208.939789:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257208.939794:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257208.939800:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098182656, portal 25 00000400:00000010:1.0:1734257208.939803:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734257208.939805:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098182656, offset 0 00000400:00000200:1.0:1734257208.939813:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257208.939823:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257208.939827:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257208.939829:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257208.939831:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 02000000:00000010:2.0:1734257208.939832:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:1.0:1734257208.939833:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257208.939835:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [159:159:256:4294967295] 192.168.202.108@tcp LPNI seq info [158:158:8:4294967295] 00000400:00000010:2.0:1734257208.939836:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257208.939838:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000400:00000200:1.0:1734257208.939840:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:2.0:1734257208.939840:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098182784, portal 10 00000800:00000200:1.0:1734257208.939843:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734257208.939844:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000100:00000200:2.0:1734257208.939844:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098182784, offset 0 00000800:00000010:1.0:1734257208.939846:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000400:00000200:2.0:1734257208.939848:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734257208.939850:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257208.939852:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257208.939854:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734257208.939855:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257208.939857:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257208.939858:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257208.939860:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257208.939862:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [160:160:255:4294967295] 192.168.202.108@tcp LPNI seq info [159:159:7:4294967295] 00000800:00000200:1.0:1734257208.939866:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257208.939868:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257208.939871:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257208.939874:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257208.939876:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257208.939880:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257208.939882:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257208.939921:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257208.939924:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734257208.939927:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257208.939930:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257208.939933:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:0.0:1734257208.939934:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:0.0:1734257208.939942:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098182656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257224 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257208.939988:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257208.939990:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257208.939992:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257208.939994:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257208.939996:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734257208.939997:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734257208.940000:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098182784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257218 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257208.941352:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257208.941366:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604e00 00000400:00000200:0.0:1734257208.941372:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x5e9 [1] + 224 00000400:00000200:0.0:1734257208.941379:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257208.941382:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257208.941386:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098182656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257224 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257208.941409:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257208.941412:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604e80 00000400:00000200:0.0:1734257208.941415:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x5f1 [1] + 0 00000400:00000200:0.0:1734257208.941429:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257208.941432:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:1.0:1734257208.941432:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257208.941436:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257208.941437:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:0.0:1734257208.941441:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098182784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257218 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257208.941441:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098182656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257224 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257208.941448:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098182656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257224 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257208.941464:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734257208.941468:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db700. 00000100:00000010:1.0:1734257208.941470:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:2.0:1734257208.941482:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257208.941485:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257208.941486:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257208.941490:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098182784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257218 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257208.941506:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098182784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257218 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257208.941520:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257208.941524:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:2.0:1734257208.941526:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734257213.947724:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734257213.947775:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db700. 00000100:00000010:3.0:1734257213.947844:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734257213.947850:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:1.0:1734257213.947892:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734257213.947900:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257213.947905:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257213.947911:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098182912, portal 25 00000400:00000010:1.0:1734257213.947915:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:1.0:1734257213.947916:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098182912, offset 0 00000400:00000200:1.0:1734257213.947924:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257213.947935:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257213.947940:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257213.947944:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257213.947947:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257213.947948:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257213.947951:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [161:161:256:4294967295] 192.168.202.108@tcp LPNI seq info [160:160:8:4294967295] 00000400:00000200:1.0:1734257213.947959:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257213.947964:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257213.947967:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734257213.947972:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257213.947978:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257213.947981:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257213.947984:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257213.947989:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257213.947992:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257213.947995:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098183040, portal 10 00000400:00000010:2.0:1734257213.947999:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734257213.948000:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098183040, offset 0 00000400:00000200:2.0:1734257213.948005:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257213.948009:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257213.948011:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257213.948013:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257213.948015:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257213.948017:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257213.948018:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [162:162:255:4294967295] 192.168.202.108@tcp LPNI seq info [161:161:7:4294967295] 00000400:00000200:2.0:1734257213.948024:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257213.948027:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257213.948030:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257213.948032:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257213.948036:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257213.948038:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257213.948108:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257213.948111:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734257213.948115:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257213.948119:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257213.948123:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:0.0:1734257213.948128:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:0.0:1734257213.948137:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098182912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257229 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257213.948199:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257213.948201:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257213.948203:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257213.948206:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257213.948208:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734257213.948209:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734257213.948212:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098183040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257223 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257213.949471:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257213.949480:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c604f00 00000400:00000200:0.0:1734257213.949485:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x5f9 [1] + 224 00000400:00000200:0.0:1734257213.949492:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257213.949494:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257213.949499:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098182912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257229 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257213.949527:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257213.949530:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c604f80 00000400:00000200:0.0:1734257213.949534:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x601 [1] + 0 00000400:00000200:0.0:1734257213.949544:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257213.949547:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257213.949550:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098183040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257223 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257213.949733:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257213.949736:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257213.949738:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257213.949742:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098182912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257229 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257213.949748:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098182912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257229 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257213.949764:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734257213.949767:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db700. 00000100:00000010:1.0:1734257213.949770:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:2.0:1734257213.950352:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257213.950355:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257213.950356:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257213.950360:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098183040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257223 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257213.950375:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098183040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257223 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257213.950389:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257213.950391:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:2.0:1734257213.950393:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:0.0:1734257218.956077:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257218.956096:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257218.956155:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257218.956160:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257218.956263:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 02000000:00000010:3.0:1734257218.956269:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:2.0:1734257218.956270:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:3.0:1734257218.956274:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:2.0:1734257218.956276:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000400:00000010:3.0:1734257218.956278:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:2.0:1734257218.956281:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098183168, portal 25 00000100:00000200:3.0:1734257218.956281:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098183296, portal 10 00000400:00000010:2.0:1734257218.956285:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000400:00000010:3.0:1734257218.956285:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:2.0:1734257218.956287:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098183168, offset 0 00000100:00000200:3.0:1734257218.956287:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098183296, offset 0 00000400:00000200:2.0:1734257218.956294:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257218.956299:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257218.956304:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257218.956308:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257218.956312:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257218.956314:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257218.956316:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257218.956318:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [163:163:256:4294967295] 192.168.202.108@tcp LPNI seq info [162:162:8:4294967295] 00000400:00000200:2.0:1734257218.956326:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257218.956331:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257218.956332:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734257218.956334:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:3.0:1734257218.956334:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257218.956337:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734257218.956339:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257218.956339:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257218.956340:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257218.956342:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [164:164:255:4294967295] 192.168.202.108@tcp LPNI seq info [163:163:7:4294967295] 00000800:00000200:2.0:1734257218.956345:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257218.956348:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734257218.956349:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257218.956352:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257218.956355:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734257218.956357:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257218.956361:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257218.956363:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257218.956407:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257218.956410:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257218.956414:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257218.956418:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257218.956422:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:0.0:1734257218.956423:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734257218.956430:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098183168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257234 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257218.956487:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257218.956489:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734257218.956491:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257218.956494:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257218.956496:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734257218.956497:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734257218.956501:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098183296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257228 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257218.958308:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257218.958321:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605000 00000400:00000200:0.0:1734257218.958328:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x609 [1] + 224 00000400:00000200:0.0:1734257218.958338:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257218.958340:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257218.958348:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098183168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257234 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257218.958384:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257218.958388:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605080 00000400:00000200:0.0:1734257218.958392:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x60d [1] + 0 00000400:00000200:0.0:1734257218.958406:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257218.958408:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257218.958413:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098183296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257228 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257218.958621:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:2.0:1734257218.958625:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734257218.958627:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257218.958631:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098183168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257234 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257218.958645:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098183168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257234 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257218.958689:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734257218.958694:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:2.0:1734257218.958697:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:3.0:1734257218.958753:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257218.958756:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257218.958757:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257218.958762:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098183296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257228 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257218.958767:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098183296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257228 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257218.958780:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257218.958783:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734257218.958790:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257223.963702:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257223.963720:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257223.963773:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257223.963779:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734257223.963799:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734257223.963806:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c8f0. 00000400:00000010:2.0:1734257223.963812:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257223.963817:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098183424, portal 25 00000400:00000010:2.0:1734257223.963820:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734257223.963822:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098183424, offset 0 00000400:00000200:2.0:1734257223.963829:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257223.963839:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257223.963843:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257223.963846:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257223.963849:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257223.963851:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257223.963853:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [165:165:256:4294967295] 192.168.202.108@tcp LPNI seq info [164:164:8:4294967295] 00000400:00000200:2.0:1734257223.963860:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257223.963865:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257223.963868:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257223.963873:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257223.963879:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257223.963882:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257223.964020:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257223.964023:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257223.964026:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257223.964030:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257223.964033:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734257223.964034:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734257223.964040:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098183424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257239 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257223.964245:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257223.964249:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257223.964252:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257223.964254:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098183552, portal 10 00000400:00000010:3.0:1734257223.964258:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734257223.964260:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098183552, offset 0 00000400:00000200:3.0:1734257223.964264:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257223.964268:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257223.964270:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257223.964272:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257223.964274:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257223.964276:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257223.964278:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [166:166:256:4294967295] 192.168.202.108@tcp LPNI seq info [165:165:8:4294967295] 00000400:00000200:3.0:1734257223.964284:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257223.964287:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257223.964289:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734257223.964292:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257223.964295:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257223.964297:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734257223.965982:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257223.965992:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605100 00000400:00000200:0.0:1734257223.965997:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x619 [1] + 224 00000800:00000200:2.0:1734257223.966002:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257223.966005:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:2.0:1734257223.966008:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257223.966012:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257223.966012:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257223.966014:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000200:0.0:1734257223.966015:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:2.0:1734257223.966022:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734257223.966035:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098183424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257239 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257223.966035:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098183552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257233 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257223.966194:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c8f0. 00000400:00000200:3.0:1734257223.966197:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:3.0:1734257223.966198:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:3.0:1734257223.966202:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098183424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257239 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257223.966208:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098183424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257239 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257223.966224:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:3.0:1734257223.966227:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734257223.966230:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734257223.968559:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257223.968585:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605180 00000400:00000200:0.0:1734257223.968591:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x621 [1] + 0 00000400:00000200:0.0:1734257223.968604:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257223.968607:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257223.968625:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098183552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257233 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257223.968722:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257223.968725:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257223.968726:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257223.968730:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098183552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257233 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257223.968736:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098183552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257233 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257223.968753:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257223.968756:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734257223.968759:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257228.972210:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257228.972227:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257228.972289:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257228.972294:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257228.972333:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734257228.972339:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 02000000:00000010:2.0:1734257228.972645:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257228.972650:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257228.972655:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257228.972660:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098183808, portal 10 00000400:00000010:2.0:1734257228.972665:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734257228.972666:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098183808, offset 0 00000400:00000200:2.0:1734257228.972673:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257228.972683:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257228.972688:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257228.972691:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257228.972694:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257228.972696:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257228.972699:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [167:167:256:4294967295] 192.168.202.108@tcp LPNI seq info [166:166:8:4294967295] 00000400:00000200:2.0:1734257228.972706:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257228.972711:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257228.972715:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257228.972720:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257228.972727:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257228.972730:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734257228.972880:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257228.972884:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734257228.972888:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257228.972892:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257228.972895:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:3.0:1734257228.972896:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:3.0:1734257228.972902:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098183808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257238 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257228.972955:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257228.972957:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098183680, portal 25 00000400:00000010:1.0:1734257228.972960:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734257228.972962:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098183680, offset 0 00000400:00000200:1.0:1734257228.972966:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257228.972970:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257228.972972:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257228.972975:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257228.972976:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257228.972978:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257228.972980:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [168:168:256:4294967295] 192.168.202.108@tcp LPNI seq info [167:167:8:4294967295] 00000400:00000200:1.0:1734257228.972986:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257228.972989:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257228.972991:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734257228.972994:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257228.972998:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257228.973000:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257228.973634:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257228.973637:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734257228.973641:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257228.973644:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257228.973646:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:0.0:1734257228.973648:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:0.0:1734257228.973652:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098183680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257244 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257228.975808:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257228.975821:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605280 00000400:00000200:0.0:1734257228.975828:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x629 [1] + 0 00000400:00000200:0.0:1734257228.975852:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257228.975855:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257228.975863:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098183808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257238 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257228.976047:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257228.976051:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257228.976053:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257228.976057:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098183808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257238 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257228.976063:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098183808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257238 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257228.976083:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257228.976094:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257228.976098:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734257228.977218:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257228.977225:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605200 00000400:00000200:0.0:1734257228.977229:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x631 [1] + 224 00000400:00000200:0.0:1734257228.977239:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257228.977241:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257228.977245:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098183680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257244 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257228.977860:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257228.977869:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257228.977870:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257228.977875:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098183680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257244 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257228.977881:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098183680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257244 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257228.977895:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734257228.977898:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734257228.977900:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734257233.981654:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257233.981675:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257233.981734:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257233.981744:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734257233.981756:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734257233.981763:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257233.981769:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257233.981775:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098183936, portal 25 00000400:00000010:1.0:1734257233.981778:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734257233.981780:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098183936, offset 0 00000400:00000200:1.0:1734257233.981788:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257233.981799:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257233.981803:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257233.981807:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257233.981810:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257233.981812:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257233.981814:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [169:169:256:4294967295] 192.168.202.108@tcp LPNI seq info [168:168:8:4294967295] 00000400:00000200:1.0:1734257233.981821:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257233.981825:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257233.981829:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734257233.981834:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257233.981841:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257233.981844:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257233.981945:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257233.981948:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:1.0:1734257233.981951:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257233.981963:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257233.981966:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:1.0:1734257233.981968:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734257233.981974:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098183936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257249 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257233.983629:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257233.983637:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257233.983642:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257233.983646:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098184064, portal 10 00000400:00000010:3.0:1734257233.983650:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734257233.983652:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098184064, offset 0 00000400:00000200:3.0:1734257233.983658:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257233.983666:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257233.983675:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257233.983678:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257233.983680:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257233.983682:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257233.983686:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [170:170:256:4294967295] 192.168.202.108@tcp LPNI seq info [169:169:8:4294967295] 00000400:00000200:3.0:1734257233.983692:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257233.983703:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257233.983706:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734257233.983710:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257233.983718:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257233.983720:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257233.984073:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257233.984079:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734257233.984082:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257233.984086:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257233.984088:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734257233.984090:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734257233.984095:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098184064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257243 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257233.985372:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257233.985383:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605380 00000400:00000200:0.0:1734257233.985388:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x641 [1] + 0 00000400:00000200:0.0:1734257233.985403:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257233.985406:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257233.985413:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098184064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257243 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257233.985556:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257233.985560:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257233.985561:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257233.985565:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098184064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257243 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257233.985587:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098184064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257243 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257233.985608:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257233.985612:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734257233.985615:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734257233.987547:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257233.987559:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605300 00000400:00000200:0.0:1734257233.987566:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x639 [1] + 224 00000400:00000200:0.0:1734257233.987600:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257233.987604:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257233.987611:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098183936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257249 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257233.987903:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257233.987907:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257233.987909:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257233.987914:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098183936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257249 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257233.987920:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098183936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257249 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257233.987934:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734257233.987937:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734257233.987940:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257238.987831:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257238.987855:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257238.987907:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257238.987913:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257238.987967:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734257238.987979:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257238.987986:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257238.987992:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098184192, portal 25 00000400:00000010:2.0:1734257238.987996:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734257238.987998:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098184192, offset 0 00000400:00000200:2.0:1734257238.988006:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257238.988017:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257238.988022:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257238.988025:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257238.988028:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257238.988031:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257238.988033:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [171:171:256:4294967295] 192.168.202.108@tcp LPNI seq info [170:170:8:4294967295] 00000400:00000200:2.0:1734257238.988041:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257238.988045:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257238.988049:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257238.988053:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257238.988060:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257238.988064:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257238.988226:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257238.988231:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257238.988234:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257238.988237:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098184320, portal 10 00000400:00000010:3.0:1734257238.988241:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734257238.988242:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098184320, offset 0 00000400:00000200:3.0:1734257238.988246:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257238.988250:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257238.988253:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257238.988255:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257238.988256:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257238.988258:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257238.988260:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [172:172:255:4294967295] 192.168.202.108@tcp LPNI seq info [171:171:7:4294967295] 00000400:00000200:3.0:1734257238.988265:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257238.988269:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257238.988282:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734257238.988285:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257238.988288:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257238.988290:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257238.989532:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257238.989537:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257238.989544:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257238.989550:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257238.989556:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734257238.989566:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734257238.989595:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098184192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257254 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257238.989669:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257238.989671:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734257238.989674:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257238.989677:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257238.989679:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734257238.989680:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734257238.989684:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098184320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257248 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257238.995553:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257238.995599:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605480 00000400:00000200:0.0:1734257238.995608:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x651 [1] + 0 00000400:00000200:0.0:1734257238.995619:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257238.995622:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257238.995633:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098184320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257248 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257238.995666:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257238.995670:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605400 00000400:00000200:0.0:1734257238.995674:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x649 [1] + 224 00000400:00000200:0.0:1734257238.995688:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257238.995691:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257238.995696:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098184192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257254 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257238.995796:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257238.995807:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257238.995809:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257238.995820:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098184192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257254 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257238.995829:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098184192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257254 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257238.995852:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734257238.995857:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734257238.995871:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:3.0:1734257238.997238:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257238.997244:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257238.997246:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257238.997253:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098184320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257248 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257238.997260:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098184320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257248 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257238.997277:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257238.997281:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734257238.997284:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257243.995673:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257243.995698:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257243.995758:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257243.995764:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257243.995779:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257243.995786:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257243.995792:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257243.995798:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098184448, portal 25 00000400:00000010:3.0:1734257243.995801:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734257243.995803:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098184448, offset 0 00000400:00000200:3.0:1734257243.995810:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257243.995820:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257243.995824:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257243.995827:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257243.995830:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257243.995832:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257243.995834:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [173:173:256:4294967295] 192.168.202.108@tcp LPNI seq info [172:172:8:4294967295] 00000400:00000200:3.0:1734257243.995841:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257243.995846:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257243.995850:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257243.995858:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257243.995865:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257243.995868:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257243.996009:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257243.996014:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257243.996017:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257243.996020:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098184576, portal 10 00000400:00000010:2.0:1734257243.996024:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734257243.996025:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098184576, offset 0 00000400:00000200:2.0:1734257243.996029:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257243.996034:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257243.996036:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257243.996038:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257243.996039:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257243.996041:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257243.996043:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [174:174:255:4294967295] 192.168.202.108@tcp LPNI seq info [173:173:7:4294967295] 00000400:00000200:2.0:1734257243.996048:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257243.996052:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257243.996054:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257243.996057:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257243.996060:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257243.996062:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257243.996092:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257243.996094:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734257243.996098:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257243.996102:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257243.996105:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:0.0:1734257243.996106:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734257243.996112:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098184448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257259 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257243.996136:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257243.996138:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257243.996140:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257243.996142:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257243.996143:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734257243.996144:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734257243.996146:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098184576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257253 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257243.997229:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257243.997238:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605500 00000400:00000200:0.0:1734257243.997244:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x659 [1] + 224 00000400:00000200:0.0:1734257243.997257:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257243.997260:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257243.997265:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098184448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257259 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257243.997330:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257243.997333:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257243.997334:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257243.997337:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098184448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257259 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257243.997342:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098184448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257259 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257243.997358:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257243.997362:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734257243.997365:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734257243.997520:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257243.997526:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605580 00000400:00000200:0.0:1734257243.997530:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x661 [1] + 0 00000400:00000200:0.0:1734257243.997539:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257243.997541:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257243.997545:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098184576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257253 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257243.997644:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257243.997648:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257243.997649:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257243.997652:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098184576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257253 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257243.997658:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098184576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257253 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257243.997672:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257243.997675:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257243.997678:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257249.004289:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257249.004312:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734257249.004375:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257249.004382:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257249.004472:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257249.004480:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257249.004487:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257249.004495:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098184704, portal 25 00000400:00000010:3.0:1734257249.004502:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734257249.004504:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098184704, offset 0 00000400:00000200:3.0:1734257249.004514:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257249.004528:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257249.004533:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257249.004537:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257249.004539:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257249.004541:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257249.004544:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [175:175:256:4294967295] 192.168.202.108@tcp LPNI seq info [174:174:8:4294967295] 00000400:00000200:3.0:1734257249.004552:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257249.004557:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257249.004561:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734257249.004601:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257249.004610:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257249.004629:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257249.004873:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257249.004879:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:1.0:1734257249.004884:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257249.004891:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257249.004895:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:1.0:1734257249.004896:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:1.0:1734257249.004905:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098184704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257265 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257249.005054:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257249.005059:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257249.005063:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257249.005066:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098184832, portal 10 00000400:00000010:2.0:1734257249.005071:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257249.005073:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098184832, offset 0 00000400:00000200:2.0:1734257249.005078:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257249.005083:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257249.005085:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257249.005088:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257249.005089:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257249.005091:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257249.005094:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [176:176:256:4294967295] 192.168.202.108@tcp LPNI seq info [175:175:8:4294967295] 00000400:00000200:2.0:1734257249.005100:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257249.005104:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257249.005107:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257249.005110:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257249.005114:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257249.005116:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257249.005259:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257249.005261:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257249.005265:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257249.005269:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257249.005272:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:0.0:1734257249.005273:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:0.0:1734257249.005278:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098184832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257259 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257249.007283:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257249.007299:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605680 00000400:00000200:0.0:1734257249.007306:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x671 [1] + 0 00000400:00000200:0.0:1734257249.007316:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257249.007319:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257249.007334:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098184832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257259 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257249.007423:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257249.007428:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605600 00000400:00000200:0.0:1734257249.007433:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x669 [1] + 224 00000400:00000200:0.0:1734257249.007452:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257249.007455:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257249.007460:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098184704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257265 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257249.007544:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257249.007549:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257249.007550:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257249.007555:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098184832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257259 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257249.007562:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098184832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257259 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257249.007615:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 02000000:00000010:2.0:1734257249.007618:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 00000400:00000200:3.0:1734257249.007620:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257249.007622:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 02000000:00000010:2.0:1734257249.007625:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000200:3.0:1734257249.007626:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098184704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257265 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734257249.007630:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000200:3.0:1734257249.007632:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098184704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257265 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257249.007642:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257249.007646:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734257249.007647:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734257254.011695:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257254.011716:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257254.011788:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257254.011794:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257254.011826:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734257254.011839:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257254.011846:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257254.011852:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098184960, portal 25 00000400:00000010:1.0:1734257254.011862:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734257254.011864:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098184960, offset 0 00000400:00000200:1.0:1734257254.011872:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257254.011884:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257254.011888:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257254.011901:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257254.011904:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257254.011905:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257254.011908:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [177:177:256:4294967295] 192.168.202.108@tcp LPNI seq info [176:176:8:4294967295] 00000400:00000200:1.0:1734257254.011915:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257254.011920:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257254.011924:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734257254.011929:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257254.011936:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257254.011940:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257254.012050:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257254.012057:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257254.012063:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257254.012068:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098185088, portal 10 00000400:00000010:3.0:1734257254.012073:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734257254.012075:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098185088, offset 0 00000400:00000200:3.0:1734257254.012081:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257254.012091:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257254.012095:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257254.012098:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257254.012101:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257254.012103:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257254.012105:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [178:178:255:4294967295] 192.168.202.108@tcp LPNI seq info [177:177:7:4294967295] 00000400:00000200:3.0:1734257254.012122:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257254.012127:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257254.012131:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257254.012135:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257254.012143:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257254.012146:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257254.012190:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257254.012193:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734257254.012197:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257254.012201:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257254.012205:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:0.0:1734257254.012207:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:0.0:1734257254.012214:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098184960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257270 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257254.012302:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257254.012304:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734257254.012307:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257254.012310:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257254.012312:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734257254.012313:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734257254.012316:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098185088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257264 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257254.015315:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257254.015330:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605780 00000400:00000200:0.0:1734257254.015337:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x681 [1] + 0 00000400:00000200:0.0:1734257254.015345:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257254.015349:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257254.015357:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098185088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257264 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257254.015400:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257254.015404:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605700 00000400:00000200:0.0:1734257254.015408:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x679 [1] + 224 00000400:00000200:0.0:1734257254.015421:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257254.015424:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257254.015434:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098184960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257270 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257254.019449:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257254.019457:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257254.019459:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257254.019469:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098184960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257270 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257254.019477:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098184960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257270 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257254.019497:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734257254.019502:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:1.0:1734257254.019506:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:3.0:1734257254.019629:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257254.019632:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257254.019633:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257254.019638:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098185088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257264 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257254.019644:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098185088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257264 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:3.0:1734257254.019656:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:3.0:1734257254.022924:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257254.022935:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734257254.022938:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734257259.019722:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257259.019741:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257259.020744:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257259.020753:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734257259.020850:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 02000000:00000010:3.0:1734257259.020850:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:1.0:1734257259.020857:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:3.0:1734257259.020857:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:1.0:1734257259.020862:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:3.0:1734257259.020862:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:1.0:1734257259.020868:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098185216, portal 25 00000400:00000010:1.0:1734257259.020871:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:3.0:1734257259.020871:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098185344, portal 10 00000100:00000200:1.0:1734257259.020873:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098185216, offset 0 00000400:00000010:3.0:1734257259.020876:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000400:00000200:1.0:1734257259.020882:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257259.020967:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:3.0:1734257259.020971:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098185344, offset 0 00000400:00000200:1.0:1734257259.020972:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257259.020976:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257259.020977:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257259.020979:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257259.020991:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257259.020994:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [179:179:256:4294967295] 192.168.202.108@tcp LPNI seq info [178:178:8:4294967295] 00000400:00000200:1.0:1734257259.021001:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257259.021006:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257259.021007:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734257259.021009:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000400:00000200:3.0:1734257259.021010:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257259.021012:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734257259.021014:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257259.021014:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257259.021015:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257259.021018:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [180:180:255:4294967295] 192.168.202.108@tcp LPNI seq info [179:179:7:4294967295] 00000800:00000200:1.0:1734257259.021021:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257259.021024:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734257259.021024:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257259.021027:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257259.021030:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734257259.021033:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257259.021037:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257259.021039:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257259.021248:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257259.021250:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734257259.021254:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257259.021258:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257259.021261:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:0.0:1734257259.021262:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:0.0:1734257259.021270:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098185216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257259.021321:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257259.021323:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734257259.021325:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257259.021327:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257259.021354:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734257259.021355:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734257259.021358:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098185344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257269 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257259.023376:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257259.023396:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605880 00000400:00000200:0.0:1734257259.023404:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x68d [1] + 0 00000400:00000200:0.0:1734257259.023426:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257259.023430:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257259.023440:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098185344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257269 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257259.024285:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257259.024300:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605800 00000400:00000200:0.0:1734257259.024306:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x689 [1] + 224 00000400:00000200:0.0:1734257259.024314:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257259.024317:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257259.024322:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098185216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257275 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257259.024394:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257259.024399:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257259.024401:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257259.024407:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098185344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257269 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257259.024414:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098185344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257269 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257259.024443:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257259.024447:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734257259.024452:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:1.0:1734257259.024519:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257259.024523:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257259.024524:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257259.024529:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098185216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257259.024534:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098185216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257275 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257259.024544:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734257259.024548:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734257259.024549:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734257264.028128:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257264.028144:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734257264.028194:0:299:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257264.028199:0:299:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257264.028228:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734257264.028235:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257264.028245:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257264.028251:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098185472, portal 25 02000000:00000010:2.0:1734257264.028252:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:1.0:1734257264.028255:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000100:00000200:1.0:1734257264.028257:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098185472, offset 0 00000400:00000200:1.0:1734257264.028264:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734257264.028265:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257264.028268:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257264.028271:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098185600, portal 10 00000400:00000200:1.0:1734257264.028274:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734257264.028275:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734257264.028276:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098185600, offset 0 00000400:00000200:1.0:1734257264.028278:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257264.028281:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257264.028281:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257264.028284:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257264.028286:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257264.028315:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [181:181:256:4294967295] 192.168.202.108@tcp LPNI seq info [180:180:8:4294967295] 00000400:00000200:1.0:1734257264.028328:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257264.028333:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257264.028336:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734257264.028341:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257264.028348:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257264.028351:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257264.028480:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257264.028483:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257264.028484:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257264.028486:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257264.028487:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257264.028489:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [182:182:255:4294967295] 192.168.202.108@tcp LPNI seq info [181:181:7:4294967295] 00000400:00000200:2.0:1734257264.028498:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257264.028501:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257264.028503:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257264.028506:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257264.028509:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257264.028511:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257264.028855:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257264.028857:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734257264.028861:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257264.028865:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257264.028869:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:0.0:1734257264.028870:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:0.0:1734257264.028877:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098185472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257264.028935:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257264.028937:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257264.028940:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257264.028942:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257264.028944:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734257264.028945:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734257264.028949:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098185600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257274 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257264.033322:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257264.033339:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605900 00000400:00000200:0.0:1734257264.033346:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x699 [1] + 224 00000400:00000200:0.0:1734257264.033364:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257264.033373:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257264.033382:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098185472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257280 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257264.034637:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257264.034643:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257264.034645:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257264.034652:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098185472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257264.034659:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098185472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257280 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257264.034677:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734257264.034682:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734257264.034685:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734257264.035203:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257264.035212:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605980 00000400:00000200:0.0:1734257264.035218:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x6a1 [1] + 0 00000400:00000200:0.0:1734257264.035231:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257264.035235:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257264.035241:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098185600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257264.036172:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257264.036178:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257264.036179:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257264.036185:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098185600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257274 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257264.036191:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098185600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257274 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257264.036208:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257264.036213:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257264.036215:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257269.036852:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257269.036875:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257269.036939:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257269.036946:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257269.036984:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734257269.036996:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257269.037003:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257269.037009:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098185728, portal 25 02000000:00000010:2.0:1734257269.037014:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:1.0:1734257269.037015:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000100:00000200:1.0:1734257269.037017:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098185728, offset 0 00000400:00000010:2.0:1734257269.037020:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:1.0:1734257269.037025:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734257269.037033:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000400:00000200:1.0:1734257269.037036:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:2.0:1734257269.037036:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098185856, portal 10 00000400:00000200:1.0:1734257269.037040:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734257269.037040:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734257269.037042:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098185856, offset 0 00000400:00000200:1.0:1734257269.037044:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257269.037046:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257269.037046:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257269.037048:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257269.037051:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [183:183:256:4294967295] 192.168.202.108@tcp LPNI seq info [182:182:8:4294967295] 00000400:00000200:1.0:1734257269.037058:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257269.037068:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257269.037072:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000400:00000200:2.0:1734257269.037072:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257269.037074:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257269.037076:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734257269.037077:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257269.037078:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257269.037080:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257269.037081:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [184:184:255:4294967295] 192.168.202.108@tcp LPNI seq info [183:183:7:4294967295] 00000800:00000200:1.0:1734257269.037083:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257269.037086:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257269.037088:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257269.037091:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257269.037094:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257269.037096:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257269.037100:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257269.037102:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257269.037668:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257269.037672:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734257269.037677:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257269.037684:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257269.037689:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:0.0:1734257269.037691:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:0.0:1734257269.037699:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098185728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257285 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257269.042407:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257269.042416:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257269.042425:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257269.042434:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257269.042441:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734257269.042444:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734257269.042455:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098185856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257279 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257269.044376:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257269.044404:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605a80 00000400:00000200:0.0:1734257269.044413:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x6b1 [1] + 0 00000400:00000200:0.0:1734257269.044424:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257269.044427:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257269.044436:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098185856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257269.045673:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257269.045682:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605a00 00000400:00000200:0.0:1734257269.045689:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x6a9 [1] + 224 00000400:00000200:0.0:1734257269.045708:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257269.045712:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257269.045718:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098185728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257285 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257269.045933:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257269.045938:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257269.045940:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257269.045947:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098185856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257279 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257269.045954:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098185856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257279 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257269.045986:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257269.045991:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257269.045996:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:1.0:1734257269.046136:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257269.046140:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257269.046142:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257269.046147:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098185728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257285 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257269.046153:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098185728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257285 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257269.046165:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734257269.046169:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734257269.046171:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257274.043675:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257274.043695:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257274.043751:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257274.043758:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734257274.043793:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734257274.043800:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257274.043806:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257274.043819:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098185984, portal 25 00000400:00000010:2.0:1734257274.043823:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734257274.043825:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098185984, offset 0 00000400:00000200:2.0:1734257274.043833:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257274.043843:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257274.043848:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257274.043851:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257274.043854:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257274.043856:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257274.043858:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [185:185:256:4294967295] 192.168.202.108@tcp LPNI seq info [184:184:8:4294967295] 00000400:00000200:2.0:1734257274.043865:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257274.043869:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257274.043872:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257274.043876:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257274.043884:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257274.043887:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257274.044249:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257274.044254:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257274.044257:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257274.044259:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098186112, portal 10 00000400:00000010:3.0:1734257274.044263:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734257274.044264:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098186112, offset 0 00000400:00000200:3.0:1734257274.044268:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257274.044272:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257274.044275:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257274.044277:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257274.044278:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257274.044280:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257274.044282:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [186:186:255:4294967295] 192.168.202.108@tcp LPNI seq info [185:185:7:4294967295] 00000400:00000200:3.0:1734257274.044287:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257274.044290:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257274.044293:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734257274.044295:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257274.044299:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257274.044301:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257274.044401:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257274.044404:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257274.044408:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257274.044412:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257274.044416:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734257274.044417:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734257274.044423:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098185984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257290 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257274.044483:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257274.044485:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734257274.044488:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257274.044491:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257274.044493:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734257274.044498:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734257274.044503:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098186112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257284 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257274.051350:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257274.051370:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605b00 00000400:00000200:0.0:1734257274.051380:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x6b9 [1] + 224 00000400:00000200:0.0:1734257274.051404:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257274.051408:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257274.051417:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098185984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257290 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257274.051663:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257274.051673:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257274.051675:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257274.051685:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098185984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257290 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257274.051694:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098185984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257290 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257274.051717:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734257274.051721:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734257274.051724:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000200:0.0:1734257274.052292:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257274.052300:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605b80 00000400:00000200:0.0:1734257274.052305:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x6c1 [1] + 0 00000400:00000200:0.0:1734257274.052316:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257274.052320:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257274.052325:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098186112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257284 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257274.052388:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257274.052401:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257274.052403:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257274.052407:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098186112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257284 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257274.052413:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098186112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257284 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257274.052429:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257274.052431:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257274.052434:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257279.051748:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257279.051767:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734257279.051822:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257279.051828:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257279.051839:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734257279.051845:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257279.051850:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257279.051855:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098186240, portal 25 00000400:00000010:2.0:1734257279.051858:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734257279.051869:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098186240, offset 0 00000400:00000200:2.0:1734257279.051876:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257279.051886:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257279.051890:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257279.051894:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257279.051897:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257279.051898:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257279.051901:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [187:187:256:4294967295] 192.168.202.108@tcp LPNI seq info [186:186:8:4294967295] 00000400:00000200:2.0:1734257279.051908:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257279.051912:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257279.051915:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257279.051920:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257279.051926:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257279.051929:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257279.052233:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257279.052236:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257279.052239:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257279.052244:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257279.052247:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734257279.052249:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734257279.052254:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098186240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257295 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257279.052321:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257279.052326:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257279.052329:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257279.052334:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098186368, portal 10 00000400:00000010:3.0:1734257279.052339:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734257279.052340:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098186368, offset 0 00000400:00000200:3.0:1734257279.052345:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257279.052349:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257279.052352:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257279.052354:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257279.052356:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257279.052357:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257279.052359:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [188:188:256:4294967295] 192.168.202.108@tcp LPNI seq info [187:187:8:4294967295] 00000400:00000200:3.0:1734257279.052366:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257279.052369:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257279.052371:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734257279.052374:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257279.052378:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257279.052380:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257279.052592:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257279.052595:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734257279.052597:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257279.052600:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257279.052602:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734257279.052603:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734257279.052607:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098186368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257289 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257279.056468:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257279.056485:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605c00 00000400:00000200:0.0:1734257279.056492:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x6c9 [1] + 224 00000400:00000200:0.0:1734257279.056503:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257279.056506:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257279.056514:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098186240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257295 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257279.056548:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257279.056551:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605c80 00000400:00000200:0.0:1734257279.056555:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x6d1 [1] + 0 00000400:00000010:2.0:1734257279.056650:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257279.056654:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257279.056656:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257279.056660:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098186240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257295 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257279.056666:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098186240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257295 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257279.056728:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257279.056732:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257279.056737:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098186368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257289 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257279.056837:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257279.056841:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257279.056849:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257279.056853:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098186368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257289 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257279.056858:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098186368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257289 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257279.057493:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257279.057499:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734257279.057502:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 02000000:00000010:2.0:1734257279.057540:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734257279.057544:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734257279.057546:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734257284.059707:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257284.059734:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257284.059798:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257284.059805:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257284.059841:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734257284.059858:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257284.059865:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257284.059872:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098186496, portal 25 00000400:00000010:1.0:1734257284.059876:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734257284.059878:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098186496, offset 0 00000400:00000200:1.0:1734257284.059887:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257284.059900:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257284.059905:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257284.059909:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257284.059912:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257284.059914:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257284.059917:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [189:189:256:4294967295] 192.168.202.108@tcp LPNI seq info [188:188:8:4294967295] 00000400:00000200:1.0:1734257284.059927:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257284.059932:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257284.059949:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734257284.059955:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257284.059963:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257284.059966:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257284.060185:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257284.060191:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257284.060195:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257284.060198:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098186624, portal 10 00000400:00000010:2.0:1734257284.060203:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734257284.060205:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098186624, offset 0 00000400:00000200:2.0:1734257284.060210:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257284.060220:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257284.060222:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257284.060224:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257284.060226:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257284.060228:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257284.060230:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [190:190:255:4294967295] 192.168.202.108@tcp LPNI seq info [189:189:7:4294967295] 00000400:00000200:2.0:1734257284.060236:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257284.060240:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257284.060242:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257284.060245:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257284.060249:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257284.060250:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257284.060766:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257284.060769:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734257284.060779:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257284.060783:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257284.060787:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:0.0:1734257284.060789:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:0.0:1734257284.060796:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098186496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257300 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257284.060861:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257284.060864:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257284.060867:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257284.060869:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257284.060872:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734257284.060872:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734257284.060876:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098186624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257284.075046:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257284.075062:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605d00 00000400:00000200:0.0:1734257284.075069:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x6d9 [1] + 224 00000400:00000200:0.0:1734257284.075078:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257284.075082:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257284.075090:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098186496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257300 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257284.075156:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257284.075161:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605d80 00000400:00000200:0.0:1734257284.075166:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x6e1 [1] + 0 00000400:00000200:0.0:1734257284.075178:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257284.075181:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257284.075186:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098186624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257294 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257284.075494:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257284.075498:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257284.075500:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257284.075505:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098186496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257300 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257284.075512:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098186496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257300 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257284.075531:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734257284.075535:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734257284.075538:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:2.0:1734257284.075613:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257284.075616:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257284.075617:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257284.075621:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098186624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257284.075627:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098186624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257294 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257284.075641:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257284.075645:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257284.075647:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257289.067959:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257289.067985:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257289.068033:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257289.068039:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257289.068068:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257289.068074:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257289.068079:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257289.068085:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098186752, portal 25 00000400:00000010:3.0:1734257289.068114:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734257289.068116:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098186752, offset 0 00000400:00000200:3.0:1734257289.068123:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257289.068134:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257289.068138:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257289.068141:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257289.068144:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257289.068145:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257289.068152:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [191:191:256:4294967295] 192.168.202.108@tcp LPNI seq info [190:190:8:4294967295] 00000400:00000200:3.0:1734257289.068158:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257289.068162:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257289.068165:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734257289.068170:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257289.068176:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257289.068179:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257289.068375:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257289.068380:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257289.068383:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257289.068385:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098186880, portal 10 00000400:00000010:2.0:1734257289.068389:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734257289.068390:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098186880, offset 0 00000400:00000200:2.0:1734257289.068394:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257289.068398:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257289.068405:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257289.068408:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257289.068409:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257289.068410:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257289.068412:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [192:192:255:4294967295] 192.168.202.108@tcp LPNI seq info [191:191:7:4294967295] 00000400:00000200:2.0:1734257289.068417:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257289.068419:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257289.068421:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257289.068424:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257289.068427:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257289.068429:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257289.068480:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257289.068483:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734257289.068486:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257289.068490:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257289.068493:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734257289.068494:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734257289.068500:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098186752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257305 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257289.068527:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257289.068529:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257289.068531:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257289.068534:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257289.068535:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734257289.068536:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734257289.068539:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098186880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257299 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257289.070959:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257289.070971:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605e00 00000400:00000200:0.0:1734257289.070978:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x6e9 [1] + 224 00000400:00000200:0.0:1734257289.070987:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257289.070990:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257289.070998:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098186752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257305 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257289.071932:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257289.071938:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605e80 00000400:00000200:0.0:1734257289.071943:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x6f1 [1] + 0 00000400:00000200:0.0:1734257289.071957:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257289.071966:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257289.071971:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098186880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257299 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257289.072114:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257289.072118:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257289.072119:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257289.072124:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098186880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257299 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257289.072130:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098186880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257299 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257289.072152:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257289.072158:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257289.072162:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:3.0:1734257289.072948:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257289.072952:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257289.072953:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257289.072958:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098186752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257305 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257289.072970:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098186752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257305 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257289.072981:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257289.072984:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734257289.072986:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257294.075715:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257294.075742:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257294.075806:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257294.075813:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734257294.075952:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257294.075963:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257294.075971:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257294.075977:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098187136, portal 10 00000400:00000010:3.0:1734257294.075983:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734257294.075985:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098187136, offset 0 00000400:00000200:3.0:1734257294.075993:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734257294.076001:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734257294.076005:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:3.0:1734257294.076006:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734257294.076008:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257294.076010:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098187008, portal 25 00000400:00000200:3.0:1734257294.076010:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734257294.076012:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000400:00000200:3.0:1734257294.076013:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:2.0:1734257294.076014:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098187008, offset 0 00000400:00000200:3.0:1734257294.076016:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257294.076018:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257294.076019:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257294.076021:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [193:193:256:4294967295] 192.168.202.108@tcp LPNI seq info [192:192:8:4294967295] 00000400:00000200:3.0:1734257294.076028:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257294.076032:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257294.076035:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000400:00000200:2.0:1734257294.076037:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257294.076039:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:3.0:1734257294.076041:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257294.076065:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257294.076067:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257294.076069:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257294.076071:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [194:194:255:4294967295] 192.168.202.108@tcp LPNI seq info [193:193:7:4294967295] 00000800:00000200:3.0:1734257294.076074:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257294.076077:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257294.076078:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257294.076081:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257294.076084:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257294.076086:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257294.076090:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257294.076092:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257294.077810:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257294.077815:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734257294.077819:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257294.077824:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257294.077827:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734257294.077829:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734257294.077836:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098187136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257304 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257294.077895:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257294.077896:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257294.077899:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257294.077902:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257294.077904:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734257294.077905:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734257294.077908:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098187008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257310 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257294.085598:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257294.085615:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c605f80 00000400:00000200:0.0:1734257294.085623:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x6f9 [1] + 0 00000400:00000200:0.0:1734257294.085643:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257294.085647:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257294.085656:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098187136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257304 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257294.085978:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257294.085983:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257294.085985:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257294.085989:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098187136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257304 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257294.086004:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098187136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257304 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257294.086028:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257294.086032:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257294.086035:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000200:0.0:1734257294.087362:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257294.087371:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c605f00 00000400:00000200:0.0:1734257294.087377:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x701 [1] + 224 00000400:00000200:0.0:1734257294.087391:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257294.087395:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257294.087402:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098187008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257294.087738:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257294.087743:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257294.087744:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257294.087749:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098187008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257310 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257294.087754:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098187008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257310 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257294.087771:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734257294.087775:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734257294.087778:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257299.083679:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257299.083698:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 02000000:00000010:2.0:1734257299.083793:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000100:00000010:0.0:1734257299.083794:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 00000400:00000010:2.0:1734257299.083800:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257299.083807:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 02000000:00000010:0.0:1734257299.083810:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 00000100:00000200:2.0:1734257299.083813:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098187264, portal 25 00000400:00000010:2.0:1734257299.083816:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734257299.083818:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098187264, offset 0 00000400:00000200:2.0:1734257299.083828:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257299.083840:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257299.083845:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257299.083848:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257299.083851:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257299.083863:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257299.083867:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [195:195:256:4294967295] 192.168.202.108@tcp LPNI seq info [194:194:8:4294967295] 00000400:00000200:2.0:1734257299.083874:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257299.083879:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257299.083882:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257299.083886:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257299.083893:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257299.083896:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257299.083983:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257299.083987:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257299.083990:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257299.083992:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098187392, portal 10 00000400:00000010:3.0:1734257299.083997:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734257299.083998:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098187392, offset 0 00000400:00000200:3.0:1734257299.084001:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257299.084019:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257299.084021:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257299.084022:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257299.084024:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257299.084025:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257299.084026:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [196:196:255:4294967295] 192.168.202.108@tcp LPNI seq info [195:195:7:4294967295] 00000400:00000200:3.0:1734257299.084031:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257299.084037:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257299.084040:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734257299.084042:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257299.084045:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257299.084047:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257299.084064:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257299.084067:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257299.084070:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257299.084074:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257299.084077:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734257299.084078:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734257299.084084:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098187264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257315 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257299.084110:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257299.084112:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734257299.084114:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257299.084116:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257299.084117:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:0.0:1734257299.084118:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:0.0:1734257299.084121:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098187392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257309 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257299.087386:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257299.087404:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606080 00000400:00000200:0.0:1734257299.087421:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x711 [1] + 0 00000400:00000200:0.0:1734257299.087437:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257299.087441:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257299.087450:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098187392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257299.087486:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257299.087490:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606000 00000400:00000200:0.0:1734257299.087494:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x709 [1] + 224 00000400:00000200:0.0:1734257299.087525:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257299.087528:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257299.087533:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098187264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257315 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257299.087599:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257299.087604:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257299.087606:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257299.087611:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098187264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257315 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257299.087617:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098187264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257315 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257299.087637:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734257299.087641:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734257299.087644:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:3.0:1734257299.087664:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257299.087669:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257299.087670:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257299.087675:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098187392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257309 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257299.087691:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098187392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257309 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257299.087708:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257299.087873:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734257299.087877:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734257304.091750:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257304.091767:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 02000000:00000010:3.0:1734257304.091868:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257304.091875:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000100:00000010:0.0:1734257304.091876:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 00000400:00000010:3.0:1734257304.091881:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 02000000:00000010:0.0:1734257304.091882:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 00000100:00000200:3.0:1734257304.091886:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098187520, portal 25 00000400:00000010:3.0:1734257304.091889:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734257304.091891:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098187520, offset 0 00000400:00000200:3.0:1734257304.091898:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257304.091908:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257304.091913:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257304.091916:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257304.091919:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257304.091922:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257304.091924:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [197:197:256:4294967295] 192.168.202.108@tcp LPNI seq info [196:196:8:4294967295] 00000400:00000200:3.0:1734257304.091931:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257304.091935:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257304.091939:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734257304.091944:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257304.091950:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257304.091953:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257304.092115:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257304.092118:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:3.0:1734257304.092120:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257304.092124:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257304.092127:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:3.0:1734257304.092137:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734257304.092143:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098187520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257320 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257304.092627:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257304.092632:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257304.092635:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257304.092638:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098187648, portal 10 00000400:00000010:2.0:1734257304.092642:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734257304.092644:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098187648, offset 0 00000400:00000200:2.0:1734257304.092648:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257304.092652:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257304.092659:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257304.092661:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257304.092663:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257304.092664:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257304.092666:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [198:198:256:4294967295] 192.168.202.108@tcp LPNI seq info [197:197:8:4294967295] 00000400:00000200:2.0:1734257304.092677:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257304.092681:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257304.092684:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257304.092687:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257304.092691:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257304.092693:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257304.092898:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257304.092900:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734257304.092903:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257304.092906:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257304.092908:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:1.0:1734257304.092909:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:1.0:1734257304.092912:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098187648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257314 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257304.093776:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257304.093787:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606100 00000400:00000200:0.0:1734257304.093793:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x719 [1] + 224 00000400:00000200:0.0:1734257304.093811:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257304.093814:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257304.093820:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098187520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257320 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257304.093894:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257304.093899:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257304.093900:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257304.093904:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098187520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257320 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257304.093911:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098187520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257320 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257304.093926:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257304.093930:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734257304.093933:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000200:0.0:1734257304.095009:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257304.095017:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606180 00000400:00000200:0.0:1734257304.095022:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x721 [1] + 0 00000400:00000200:0.0:1734257304.095034:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257304.095043:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257304.095049:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098187648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257314 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257304.096164:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257304.096169:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257304.096171:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257304.096177:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098187648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257314 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257304.096184:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098187648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257314 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257304.096203:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257304.096207:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257304.096211:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734257309.099697:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257309.099721:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257309.099764:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257309.099769:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257309.099792:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257309.099802:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257309.099808:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257309.099813:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098187776, portal 25 00000400:00000010:1.0:1734257309.099817:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734257309.099818:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098187776, offset 0 00000400:00000200:1.0:1734257309.099825:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734257309.099833:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:1.0:1734257309.099836:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734257309.099838:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:1.0:1734257309.099841:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734257309.099841:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257309.099844:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098187904, portal 10 00000400:00000010:2.0:1734257309.099849:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000400:00000200:1.0:1734257309.099853:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:2.0:1734257309.099855:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098187904, offset 0 00000400:00000200:1.0:1734257309.099856:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257309.099858:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257309.099860:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257309.099861:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [199:199:256:4294967295] 192.168.202.108@tcp LPNI seq info [198:198:8:4294967295] 00000400:00000200:1.0:1734257309.099868:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257309.099874:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257309.099876:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734257309.099877:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000400:00000200:2.0:1734257309.099878:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257309.099880:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734257309.099883:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257309.099886:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257309.099887:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734257309.099889:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257309.099892:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257309.099892:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [200:200:255:4294967295] 192.168.202.108@tcp LPNI seq info [199:199:7:4294967295] 00000400:00000200:2.0:1734257309.099899:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257309.099910:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257309.099913:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257309.099915:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257309.099919:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257309.099921:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257309.099967:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257309.099970:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734257309.099974:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257309.099979:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257309.099982:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:0.0:1734257309.099983:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:0.0:1734257309.099989:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098187776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257325 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257309.100041:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257309.100043:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257309.100045:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257309.100047:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257309.100049:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734257309.100050:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734257309.100053:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098187904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257319 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257309.101498:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257309.101507:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606200 00000400:00000200:0.0:1734257309.101512:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x729 [1] + 224 00000400:00000200:0.0:1734257309.101526:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257309.101529:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257309.101535:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098187776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257325 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257309.101771:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257309.101775:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257309.101776:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257309.101780:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098187776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257325 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257309.101787:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098187776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257325 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257309.101803:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257309.101807:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734257309.101810:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734257309.102105:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257309.102116:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606280 00000400:00000200:0.0:1734257309.102120:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x731 [1] + 0 00000400:00000200:0.0:1734257309.102129:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257309.102131:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257309.102135:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098187904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257319 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257309.102391:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257309.102395:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257309.102396:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257309.102400:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098187904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257319 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257309.102406:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098187904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257319 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257309.102421:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257309.102424:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257309.102426:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734257314.109452:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257314.109471:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257314.109524:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257314.109530:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257314.109551:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257314.109558:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257314.110121:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257314.110129:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098188032, portal 25 00000400:00000010:1.0:1734257314.110133:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734257314.110135:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098188032, offset 0 00000400:00000200:1.0:1734257314.110143:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257314.110155:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257314.110159:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257314.110162:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257314.110165:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257314.110178:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257314.110181:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [201:201:256:4294967295] 192.168.202.108@tcp LPNI seq info [200:200:8:4294967295] 00000400:00000200:1.0:1734257314.110188:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257314.110193:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257314.110196:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734257314.110202:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257314.110209:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257314.110212:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257314.110247:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257314.110252:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257314.110255:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257314.110257:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098188160, portal 10 00000400:00000010:3.0:1734257314.110261:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734257314.110262:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098188160, offset 0 00000400:00000200:3.0:1734257314.110267:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257314.110271:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257314.110274:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257314.110276:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257314.110277:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257314.110279:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257314.110281:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [202:202:255:4294967295] 192.168.202.108@tcp LPNI seq info [201:201:7:4294967295] 00000400:00000200:3.0:1734257314.110287:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257314.110290:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257314.110292:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734257314.110295:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257314.110304:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257314.110311:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257314.112174:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257314.112179:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734257314.112185:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257314.112190:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257314.112194:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:0.0:1734257314.112196:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:0.0:1734257314.112204:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098188032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257330 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257314.112259:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257314.112261:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734257314.112264:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257314.112266:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257314.112268:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734257314.112269:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734257314.112273:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098188160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257324 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257314.115728:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257314.115746:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606300 00000400:00000200:0.0:1734257314.115753:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x739 [1] + 224 00000400:00000200:0.0:1734257314.115763:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257314.115775:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257314.115784:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098188032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257330 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257314.115823:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257314.115827:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606380 00000400:00000200:0.0:1734257314.115832:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x741 [1] + 0 00000400:00000200:0.0:1734257314.115843:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257314.115846:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257314.115850:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098188160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257324 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257314.115944:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257314.115948:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257314.115950:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257314.115955:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098188032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257330 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257314.115961:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098188032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257330 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257314.115981:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257314.115984:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:1.0:1734257314.115988:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:3.0:1734257314.116048:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257314.116051:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257314.116052:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257314.116056:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098188160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257324 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257314.116061:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098188160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257324 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257314.116074:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257314.116077:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257314.116080:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257319.115999:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257319.116092:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734257319.116147:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257319.116155:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257319.116190:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257319.116197:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257319.116202:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257319.116207:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098188288, portal 25 00000400:00000010:1.0:1734257319.116215:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:1.0:1734257319.116217:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098188288, offset 0 00000400:00000200:1.0:1734257319.116224:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257319.116235:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257319.116239:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257319.116242:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257319.116244:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257319.116246:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257319.116248:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [203:203:256:4294967295] 192.168.202.108@tcp LPNI seq info [202:202:8:4294967295] 00000400:00000200:1.0:1734257319.116267:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257319.116273:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257319.116276:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734257319.116280:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257319.116287:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257319.116290:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257319.116383:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257319.116502:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:1.0:1734257319.116506:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257319.116509:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257319.116512:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:1.0:1734257319.116514:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:1.0:1734257319.116519:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098188288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257335 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257319.117599:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257319.117604:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257319.117608:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257319.117611:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098188416, portal 10 00000400:00000010:3.0:1734257319.117615:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734257319.117616:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098188416, offset 0 00000400:00000200:3.0:1734257319.117621:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257319.117625:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257319.117628:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257319.117630:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257319.117631:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257319.117633:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257319.117635:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [204:204:256:4294967295] 192.168.202.108@tcp LPNI seq info [203:203:8:4294967295] 00000400:00000200:3.0:1734257319.117641:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257319.117644:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257319.117646:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734257319.117649:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257319.117653:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257319.117655:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257319.117711:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257319.117713:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734257319.117716:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257319.117719:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257319.117722:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734257319.117723:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734257319.117726:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098188416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257329 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257319.119778:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257319.119790:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606400 00000400:00000200:0.0:1734257319.119797:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x749 [1] + 224 00000400:00000200:0.0:1734257319.119805:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257319.119808:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257319.119814:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098188288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257335 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257319.119870:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257319.119874:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606480 00000400:00000200:0.0:1734257319.119879:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x751 [1] + 0 00000400:00000200:0.0:1734257319.119889:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257319.119892:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257319.119896:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098188416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257329 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257319.120038:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257319.120041:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257319.120043:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257319.120047:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098188288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257335 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257319.120053:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098188288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257335 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257319.120069:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257319.120072:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734257319.120075:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:3.0:1734257319.120241:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257319.120245:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257319.120246:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257319.120250:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098188416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257329 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257319.120256:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098188416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257329 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257319.120271:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257319.120273:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257319.120276:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734257324.123692:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257324.123710:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257324.123765:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257324.123771:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257324.123882:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734257324.123882:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:2.0:1734257324.123892:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734257324.123893:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:2.0:1734257324.123900:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257324.123907:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098188672, portal 10 00000400:00000010:2.0:1734257324.123914:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734257324.123916:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098188672, offset 0 00000400:00000200:2.0:1734257324.123924:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257324.123938:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257324.123943:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257324.123946:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257324.123949:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257324.123951:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257324.123954:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [205:205:256:4294967295] 192.168.202.108@tcp LPNI seq info [204:204:8:4294967295] 00000400:00000200:2.0:1734257324.123962:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257324.123968:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257324.123985:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257324.123991:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257324.123999:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257324.124003:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000400:00000010:3.0:1734257324.124445:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257324.124451:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098188544, portal 25 00000400:00000010:3.0:1734257324.124454:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734257324.124455:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098188544, offset 0 00000400:00000200:3.0:1734257324.124459:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257324.124462:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257324.124464:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257324.124466:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257324.124467:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257324.124468:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257324.124470:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [206:206:255:4294967295] 192.168.202.108@tcp LPNI seq info [205:205:7:4294967295] 00000400:00000200:3.0:1734257324.124473:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257324.124476:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257324.124478:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734257324.124479:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257324.124482:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257324.124483:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257324.124672:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257324.124675:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734257324.124680:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257324.124687:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257324.124690:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:1.0:1734257324.124692:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:1.0:1734257324.124699:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098188672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257334 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257324.125484:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257324.125487:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:1.0:1734257324.125490:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257324.125493:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257324.125496:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:1.0:1734257324.125497:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:1.0:1734257324.125501:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098188544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257340 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257324.126360:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257324.126372:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606500 00000400:00000200:0.0:1734257324.126378:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x761 [1] + 224 00000400:00000200:0.0:1734257324.126392:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257324.126395:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257324.126400:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098188544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257340 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257324.126556:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257324.126608:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257324.126610:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257324.126618:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098188544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257340 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257324.126627:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098188544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257340 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257324.126652:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257324.126658:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734257324.126662:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734257324.127108:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257324.127115:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606580 00000400:00000200:0.0:1734257324.127120:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x759 [1] + 0 00000400:00000200:0.0:1734257324.127130:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257324.127133:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257324.127137:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098188672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257334 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257324.127222:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257324.127227:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257324.127228:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257324.127234:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098188672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257334 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257324.127242:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098188672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257334 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257324.127261:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257324.127267:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257324.127270:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257329.131724:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257329.131761:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 02000000:00000010:1.0:1734257329.131879:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734257329.131888:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257329.131900:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257329.131907:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098188800, portal 25 00000400:00000010:1.0:1734257329.131912:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:1.0:1734257329.131914:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098188800, offset 0 00000100:00000010:0.0:1734257329.131921:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 00000400:00000200:1.0:1734257329.131924:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:0.0:1734257329.131929:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 00000400:00000200:1.0:1734257329.131937:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257329.131943:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257329.131947:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257329.131951:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257329.131952:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257329.131955:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [207:207:256:4294967295] 192.168.202.108@tcp LPNI seq info [206:206:8:4294967295] 00000400:00000200:1.0:1734257329.131964:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257329.131970:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257329.131973:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734257329.131979:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257329.131987:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257329.131992:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257329.132029:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257329.132034:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257329.132037:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257329.132039:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098188928, portal 10 00000400:00000010:2.0:1734257329.132043:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734257329.132044:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098188928, offset 0 00000400:00000200:2.0:1734257329.132048:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257329.132052:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257329.132054:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257329.132055:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257329.132057:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257329.132058:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257329.132059:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [208:208:255:4294967295] 192.168.202.108@tcp LPNI seq info [207:207:7:4294967295] 00000400:00000200:2.0:1734257329.132063:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257329.132066:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257329.132067:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257329.132073:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257329.132076:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257329.132078:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257329.132140:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257329.132143:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734257329.132148:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257329.132153:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257329.132157:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:0.0:1734257329.132159:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:0.0:1734257329.132165:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098188800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257345 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257329.132237:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257329.132239:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257329.132242:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257329.132245:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257329.132246:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734257329.132247:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734257329.132251:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098188928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257329.135620:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257329.135639:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606680 00000400:00000200:0.0:1734257329.135647:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x771 [1] + 0 00000400:00000200:0.0:1734257329.135658:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257329.135661:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257329.135670:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098188928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257339 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257329.135712:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257329.135716:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606600 00000400:00000200:0.0:1734257329.135721:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x769 [1] + 224 00000400:00000200:0.0:1734257329.135737:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257329.135748:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257329.135753:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098188800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257345 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257329.135922:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257329.135927:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257329.135928:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257329.135933:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098188928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257329.135939:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098188928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257339 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257329.135968:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257329.135974:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257329.135979:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:1.0:1734257329.136053:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257329.136057:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257329.136078:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257329.136088:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098188800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257345 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257329.136093:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098188800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257345 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257329.136104:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734257329.136107:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734257329.136108:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257334.139966:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257334.139985:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257334.140041:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257334.140047:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257334.140069:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734257334.140076:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257334.140082:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257334.140087:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098189056, portal 25 00000400:00000010:1.0:1734257334.140090:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734257334.140092:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098189056, offset 0 00000400:00000200:1.0:1734257334.140100:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257334.140112:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257334.140116:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257334.140120:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257334.140122:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257334.140124:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257334.140127:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [209:209:256:4294967295] 192.168.202.108@tcp LPNI seq info [208:208:8:4294967295] 00000400:00000200:1.0:1734257334.140134:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:3.0:1734257334.140138:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000800:00000200:1.0:1734257334.140140:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734257334.140142:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000800:00000010:1.0:1734257334.140143:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000400:00000010:3.0:1734257334.140145:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000800:00000200:1.0:1734257334.140148:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:3.0:1734257334.140148:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098189184, portal 10 00000400:00000010:3.0:1734257334.140151:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734257334.140153:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098189184, offset 0 00000800:00000200:1.0:1734257334.140156:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257334.140159:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257334.140273:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257334.140276:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734257334.140279:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257334.140284:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257334.140287:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:0.0:1734257334.140289:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:0.0:1734257334.140295:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098189056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257350 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734257334.141016:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257334.141021:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257334.141024:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257334.141026:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257334.141028:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257334.141029:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257334.141031:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [210:210:256:4294967295] 192.168.202.108@tcp LPNI seq info [209:209:8:4294967295] 00000400:00000200:3.0:1734257334.141037:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257334.141039:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257334.141042:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734257334.141044:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257334.141048:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257334.141050:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257334.143989:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257334.143995:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734257334.144001:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257334.144003:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257334.144006:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257334.144010:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734257334.144012:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000400:00000200:2.0:1734257334.144016:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606700 00000100:00000200:0.0:1734257334.144019:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098189184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734257334.144021:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x779 [1] + 224 00000400:00000200:2.0:1734257334.144039:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257334.144042:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:2.0:1734257334.144047:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098189056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257350 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257334.144396:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257334.144401:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257334.144402:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257334.144406:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098189056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257350 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257334.144424:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098189056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257350 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257334.144441:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734257334.144445:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734257334.144448:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000200:0.0:1734257334.147840:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257334.147856:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606780 00000400:00000200:0.0:1734257334.147862:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x781 [1] + 0 00000400:00000200:0.0:1734257334.147881:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257334.147885:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257334.147893:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098189184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257344 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257334.147981:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257334.147985:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257334.147987:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257334.147998:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098189184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257334.148004:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098189184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257344 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257334.148025:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257334.148029:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257334.148033:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734257339.147650:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257339.147677:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257339.147753:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257339.147758:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257339.147779:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734257339.147786:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257339.147792:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257339.147797:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098189312, portal 25 00000400:00000010:2.0:1734257339.147801:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734257339.147802:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098189312, offset 0 00000400:00000200:2.0:1734257339.147810:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257339.147821:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257339.147826:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257339.147829:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257339.147836:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257339.147838:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257339.147841:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [211:211:256:4294967295] 192.168.202.108@tcp LPNI seq info [210:210:8:4294967295] 00000400:00000200:2.0:1734257339.147847:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257339.147852:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257339.147859:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257339.147864:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257339.147870:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257339.147873:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257339.148758:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257339.148765:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257339.148768:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257339.148772:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098189440, portal 10 00000400:00000010:3.0:1734257339.148776:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734257339.148778:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098189440, offset 0 00000400:00000200:3.0:1734257339.148783:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257339.148787:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257339.148790:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257339.148793:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257339.148795:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257339.148796:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257339.148799:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [212:212:255:4294967295] 192.168.202.108@tcp LPNI seq info [211:211:7:4294967295] 00000400:00000200:3.0:1734257339.148805:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257339.148808:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257339.148811:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734257339.148814:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257339.148819:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257339.148821:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257339.148840:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257339.148843:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257339.148847:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257339.148851:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257339.148855:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:0.0:1734257339.148856:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734257339.148862:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098189312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257355 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257339.148886:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257339.148887:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734257339.148889:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257339.148892:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257339.148893:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734257339.148894:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734257339.148897:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098189440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257349 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257339.151406:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257339.151420:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606800 00000400:00000200:0.0:1734257339.151427:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x789 [1] + 224 00000400:00000200:0.0:1734257339.151436:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257339.151439:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257339.151447:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098189312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257355 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257339.151483:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257339.151487:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606880 00000400:00000200:0.0:1734257339.151491:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x791 [1] + 0 00000400:00000200:0.0:1734257339.151506:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257339.151514:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257339.151518:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098189440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257349 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257339.151611:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257339.151616:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257339.151617:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257339.151622:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098189312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257355 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257339.151627:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098189312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257355 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257339.151645:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734257339.151649:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:2.0:1734257339.151652:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:3.0:1734257339.151719:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257339.151722:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257339.151723:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257339.151728:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098189440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257349 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257339.151738:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098189440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257349 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257339.151753:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257339.151756:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257339.151758:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734257344.155779:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257344.155805:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257344.155863:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257344.155871:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257344.155904:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734257344.155916:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257344.155923:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257344.155928:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098189568, portal 25 00000400:00000010:3.0:1734257344.155933:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734257344.155935:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098189568, offset 0 00000400:00000200:3.0:1734257344.155943:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257344.155954:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257344.155959:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257344.156069:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257344.156073:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257344.156075:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257344.156077:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [213:213:256:4294967295] 192.168.202.108@tcp LPNI seq info [212:212:8:4294967295] 00000400:00000200:3.0:1734257344.156085:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257344.156090:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257344.156093:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257344.156098:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257344.156105:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257344.156109:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257344.156229:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257344.156232:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:1.0:1734257344.156236:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257344.156240:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257344.156243:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:1.0:1734257344.156245:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:1.0:1734257344.156251:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098189568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257360 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257344.156415:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257344.156422:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257344.156427:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257344.156432:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098189696, portal 10 00000400:00000010:2.0:1734257344.156438:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734257344.156439:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098189696, offset 0 00000400:00000200:2.0:1734257344.156446:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257344.156454:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257344.156458:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257344.156460:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257344.156462:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257344.156464:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257344.156476:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [214:214:256:4294967295] 192.168.202.108@tcp LPNI seq info [213:213:8:4294967295] 00000400:00000200:2.0:1734257344.156481:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257344.156485:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257344.156488:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257344.156491:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257344.156496:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257344.156498:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257344.156677:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257344.156680:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257344.156684:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257344.156687:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257344.156691:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:0.0:1734257344.156692:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:0.0:1734257344.156697:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098189696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257354 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257344.158637:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257344.158668:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606900 00000400:00000200:0.0:1734257344.158675:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x799 [1] + 224 00000400:00000200:0.0:1734257344.158693:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257344.158697:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257344.158705:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098189568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257360 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257344.159103:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257344.159107:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257344.159108:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257344.159113:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098189568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257360 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257344.159129:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098189568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257360 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257344.159148:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257344.159152:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734257344.159155:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734257344.159531:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257344.159538:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606980 00000400:00000200:0.0:1734257344.159544:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x7a1 [1] + 0 00000400:00000200:0.0:1734257344.159554:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257344.159557:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257344.159561:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098189696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257354 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257344.159655:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257344.159662:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257344.159664:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257344.159673:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098189696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257354 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257344.159681:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098189696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257354 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257344.159705:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257344.159711:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257344.159714:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257349.163687:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257349.163706:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257349.163761:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257349.163768:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257349.163864:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257349.163871:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257349.163876:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257349.163882:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098189952, portal 10 00000400:00000010:2.0:1734257349.163887:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734257349.163888:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098189952, offset 0 00000400:00000200:2.0:1734257349.163896:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257349.163907:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257349.163911:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257349.163915:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257349.163917:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257349.163919:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257349.163923:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [215:215:256:4294967295] 192.168.202.108@tcp LPNI seq info [214:214:8:4294967295] 00000400:00000200:2.0:1734257349.163940:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257349.163945:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257349.163948:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257349.163953:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257349.163959:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257349.163962:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734257349.164005:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257349.164010:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257349.164014:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257349.164016:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098189824, portal 25 00000400:00000010:1.0:1734257349.164019:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 00000100:00000200:1.0:1734257349.164020:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098189824, offset 0 00000400:00000200:1.0:1734257349.164024:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257349.164029:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257349.164031:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257349.164033:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257349.164035:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257349.164037:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257349.164040:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [216:216:255:4294967295] 192.168.202.108@tcp LPNI seq info [215:215:7:4294967295] 00000400:00000200:1.0:1734257349.164045:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257349.164049:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257349.164052:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734257349.164054:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257349.164063:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257349.164064:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257349.164102:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257349.164104:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257349.164108:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257349.164112:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257349.164115:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734257349.164116:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734257349.164122:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098189952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257359 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257349.164147:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257349.164148:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734257349.164150:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257349.164153:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257349.164154:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:0.0:1734257349.164155:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:0.0:1734257349.164158:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098189824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257365 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257349.166231:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257349.166247:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606a80 00000400:00000200:0.0:1734257349.166253:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x7a9 [1] + 0 00000400:00000200:0.0:1734257349.166268:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257349.166272:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257349.166283:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098189952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257359 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257349.166744:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257349.166749:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257349.166751:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257349.166756:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098189952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257359 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257349.166762:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098189952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257359 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257349.166784:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257349.166788:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257349.166791:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000200:0.0:1734257349.167255:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257349.167262:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606a00 00000400:00000200:0.0:1734257349.167273:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x7b1 [1] + 224 00000400:00000200:0.0:1734257349.167281:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257349.167284:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257349.167288:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098189824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257365 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257349.167381:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257349.167384:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257349.167385:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257349.167389:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098189824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257365 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257349.167394:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098189824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257365 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257349.167404:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257349.167407:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734257349.167409:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257354.171983:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257354.172132:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257354.172202:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257354.172209:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257354.172327:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257354.172335:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257354.172341:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257354.172348:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098190080, portal 25 00000400:00000010:1.0:1734257354.172353:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734257354.172356:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098190080, offset 0 00000400:00000200:1.0:1734257354.172364:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257354.172380:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257354.172385:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257354.172389:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257354.172392:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257354.172394:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257354.172397:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [217:217:256:4294967295] 192.168.202.108@tcp LPNI seq info [216:216:8:4294967295] 02000000:00000010:3.0:1734257354.173004:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257354.173015:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257354.173021:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257354.173027:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098190208, portal 10 00000400:00000010:3.0:1734257354.173033:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734257354.173035:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098190208, offset 0 00000400:00000200:3.0:1734257354.173042:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257354.173059:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257354.173066:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257354.173069:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734257354.173070:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000400:00000200:3.0:1734257354.173074:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734257354.173076:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257354.173077:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257354.173080:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257354.173082:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734257354.173084:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734257354.173085:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [218:218:255:4294967295] 192.168.202.108@tcp LPNI seq info [217:217:7:4294967295] 00000400:00000200:3.0:1734257354.173093:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257354.173098:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734257354.173100:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:3.0:1734257354.173101:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734257354.173106:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257354.173112:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257354.173115:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257354.173238:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257354.173242:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734257354.173247:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257354.173252:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257354.173257:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734257354.173258:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734257354.173266:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098190080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257370 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257354.173333:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257354.173334:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734257354.173337:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257354.173340:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257354.173342:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734257354.173343:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734257354.173347:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098190208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257364 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257354.176803:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257354.176818:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606b00 00000400:00000200:0.0:1734257354.176826:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x7b9 [1] + 224 00000400:00000200:0.0:1734257354.176835:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257354.176839:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257354.176856:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098190080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257370 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257354.176888:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257354.176892:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606b80 00000400:00000200:0.0:1734257354.176896:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x7c1 [1] + 0 00000400:00000200:0.0:1734257354.176907:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257354.176910:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257354.176914:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098190208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257354.176946:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257354.176955:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257354.176957:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257354.176967:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098190080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257370 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257354.176976:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098190080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257370 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257354.177001:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257354.177007:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734257354.177011:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:3.0:1734257354.177084:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257354.177088:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257354.177090:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257354.177095:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098190208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257364 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257354.177110:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098190208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257364 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257354.177135:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257354.177138:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257354.177141:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734257359.179699:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257359.179723:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257359.179780:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257359.179786:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257359.179849:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257359.179856:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257359.179861:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257359.179867:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098190464, portal 10 00000400:00000010:3.0:1734257359.179872:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734257359.179874:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098190464, offset 0 02000000:00000010:1.0:1734257359.179879:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000200:3.0:1734257359.179881:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734257359.179884:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257359.179887:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257359.179890:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098190336, portal 25 00000400:00000200:3.0:1734257359.179892:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734257359.179893:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734257359.179894:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098190336, offset 0 00000400:00000200:3.0:1734257359.179896:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257359.179899:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257359.179899:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257359.179902:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257359.179905:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257359.179907:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [219:219:256:4294967295] 192.168.202.108@tcp LPNI seq info [218:218:8:4294967295] 00000400:00000200:3.0:1734257359.179914:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257359.179919:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257359.179922:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734257359.179927:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257359.179934:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257359.179938:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734257359.179990:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257359.179993:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257359.179995:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257359.179997:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257359.179998:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257359.180000:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [220:220:255:4294967295] 192.168.202.108@tcp LPNI seq info [219:219:7:4294967295] 00000400:00000200:1.0:1734257359.180006:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257359.180009:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257359.180012:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734257359.180015:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257359.180018:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257359.180020:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257359.180768:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257359.180772:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734257359.180776:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257359.180780:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257359.180784:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734257359.180785:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734257359.180792:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098190464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257369 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257359.180851:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257359.180853:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734257359.180855:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257359.180858:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257359.180860:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:0.0:1734257359.180861:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:0.0:1734257359.180865:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098190336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257375 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257359.182621:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257359.182648:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606c80 00000400:00000200:0.0:1734257359.182655:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x7c9 [1] + 0 00000400:00000200:0.0:1734257359.182672:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257359.182675:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257359.182683:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098190464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257359.182776:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257359.182780:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257359.182782:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257359.182786:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098190464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257369 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257359.182801:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098190464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257369 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257359.182824:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257359.182828:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257359.182833:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734257359.191119:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257359.191134:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606c00 00000400:00000200:0.0:1734257359.191142:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x7d1 [1] + 224 00000400:00000200:0.0:1734257359.191160:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257359.191164:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257359.191172:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098190336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257375 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257359.191350:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257359.191355:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257359.191357:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257359.191361:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098190336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257375 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257359.191368:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098190336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257375 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257359.191387:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257359.191391:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734257359.191394:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734257364.188238:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257364.188256:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 02000000:00000010:3.0:1734257364.188396:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734257364.188404:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257364.188410:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257364.188416:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098190592, portal 25 00000400:00000010:3.0:1734257364.188420:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734257364.188422:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098190592, offset 0 00000400:00000200:3.0:1734257364.188429:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257364.188440:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257364.188443:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257364.188447:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257364.188449:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257364.188451:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257364.188454:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [221:221:256:4294967295] 192.168.202.108@tcp LPNI seq info [220:220:8:4294967295] 00000400:00000200:3.0:1734257364.188461:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257364.188465:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257364.188469:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257364.188473:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257364.188509:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257364.188512:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257364.188642:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257364.188646:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:3.0:1734257364.188648:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257364.188652:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257364.188655:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:3.0:1734257364.188665:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734257364.188670:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098190592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257380 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257364.189076:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257364.189083:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734257364.189529:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257364.189534:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16cb8. 00000400:00000010:3.0:1734257364.189538:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734257364.189541:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098190720, portal 10 00000400:00000010:3.0:1734257364.189545:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734257364.189546:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098190720, offset 0 00000400:00000200:3.0:1734257364.189551:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257364.189556:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257364.189559:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257364.189561:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257364.189562:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257364.189564:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257364.189566:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [222:222:256:4294967295] 192.168.202.108@tcp LPNI seq info [221:221:8:4294967295] 00000400:00000200:3.0:1734257364.189586:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257364.189590:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257364.189592:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257364.189595:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257364.189599:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257364.189601:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257364.189678:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257364.189680:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734257364.189682:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257364.189686:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257364.189688:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734257364.189689:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734257364.189693:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098190720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257364.191192:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257364.191205:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606d80 00000400:00000200:0.0:1734257364.191212:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x7e1 [1] + 0 00000400:00000200:0.0:1734257364.191232:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257364.191242:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257364.191250:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098190720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257364.191591:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16cb8. 00000400:00000200:3.0:1734257364.191595:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:3.0:1734257364.191597:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734257364.191602:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098190720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257364.191608:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098190720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257374 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257364.191629:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257364.191637:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734257364.191641:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000200:0.0:1734257364.192193:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257364.192200:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606d00 00000400:00000200:0.0:1734257364.192205:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x7d9 [1] + 224 00000400:00000200:0.0:1734257364.192218:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257364.192221:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257364.192226:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098190592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257380 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257364.192726:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257364.192730:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257364.192731:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257364.192736:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098190592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257380 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257364.192743:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098190592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257380 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257364.192754:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257364.192759:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734257364.192761:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257369.196881:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257369.196900:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257369.196954:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257369.196959:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734257369.196993:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734257369.197000:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257369.197005:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257369.197011:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098190848, portal 25 00000400:00000010:3.0:1734257369.197014:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734257369.197015:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098190848, offset 0 00000400:00000200:3.0:1734257369.197023:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257369.197033:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257369.197037:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257369.197041:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257369.197044:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257369.197046:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257369.197048:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [223:223:256:4294967295] 192.168.202.108@tcp LPNI seq info [222:222:8:4294967295] 00000400:00000200:3.0:1734257369.197055:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257369.197059:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257369.197062:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734257369.197067:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257369.197073:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257369.197076:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257369.197690:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257369.197696:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257369.197700:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257369.197702:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098190976, portal 10 00000400:00000010:2.0:1734257369.197706:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257369.197708:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098190976, offset 0 00000400:00000200:2.0:1734257369.197713:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257369.197718:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257369.197720:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257369.197722:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257369.197724:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257369.197726:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257369.197727:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [224:224:255:4294967295] 192.168.202.108@tcp LPNI seq info [223:223:7:4294967295] 00000400:00000200:2.0:1734257369.197733:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257369.197743:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257369.197746:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257369.197748:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257369.197752:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257369.197755:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257369.200640:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257369.200647:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734257369.200653:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257369.200660:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257369.200665:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734257369.200667:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734257369.200675:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098190848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257385 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257369.200738:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257369.200739:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257369.200742:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257369.200745:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257369.200747:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734257369.200748:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734257369.200752:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098190976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257369.205506:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257369.205531:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606e00 00000400:00000200:0.0:1734257369.205539:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x7e9 [1] + 224 00000400:00000200:0.0:1734257369.205549:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257369.205552:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257369.205562:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098190848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257385 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257369.205619:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257369.205623:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606e80 00000400:00000200:0.0:1734257369.205628:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x7f1 [1] + 0 00000400:00000200:0.0:1734257369.205640:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257369.205643:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257369.205647:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098190976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257379 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257369.205853:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257369.205857:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257369.205859:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257369.205864:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098190976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257369.205869:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098190976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257379 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257369.205893:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257369.205897:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257369.205901:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:3.0:1734257369.205966:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257369.205969:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257369.205971:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257369.205975:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098190848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257385 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257369.205980:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098190848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257385 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257369.205991:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257369.205995:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734257369.205997:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257374.203729:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257374.203755:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257374.203813:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257374.203819:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257374.203862:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257374.203872:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257374.203878:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257374.203884:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098191104, portal 25 00000400:00000010:1.0:1734257374.203887:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734257374.203889:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098191104, offset 0 00000400:00000200:1.0:1734257374.203896:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257374.203906:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257374.203910:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257374.203914:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257374.203917:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257374.203919:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257374.203922:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [225:225:256:4294967295] 192.168.202.108@tcp LPNI seq info [224:224:8:4294967295] 00000400:00000200:1.0:1734257374.203930:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257374.203934:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257374.203937:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734257374.203942:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257374.203948:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257374.203952:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257374.204181:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257374.204192:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:1.0:1734257374.204194:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257374.204198:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257374.204201:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:1.0:1734257374.204203:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734257374.204207:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098191104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257374.204363:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257374.204370:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257374.204376:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257374.204381:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098191232, portal 10 00000400:00000010:3.0:1734257374.204387:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734257374.204389:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098191232, offset 0 00000400:00000200:3.0:1734257374.204431:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257374.204441:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257374.204445:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257374.204448:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257374.204451:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257374.204453:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257374.204455:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [226:226:256:4294967295] 192.168.202.108@tcp LPNI seq info [225:225:8:4294967295] 00000400:00000200:3.0:1734257374.204462:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257374.204466:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257374.204470:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734257374.204474:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257374.204480:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257374.204483:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257374.204639:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257374.204642:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734257374.204645:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257374.204649:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257374.204653:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734257374.204654:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734257374.204714:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098191232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257374.206728:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257374.206742:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c606f00 00000400:00000200:0.0:1734257374.206749:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x7f9 [1] + 224 00000400:00000200:0.0:1734257374.206765:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257374.206774:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257374.206781:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098191104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257390 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257374.206878:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:0.0:1734257374.206879:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257374.206883:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c606f80 00000400:00000200:1.0:1734257374.206885:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257374.206887:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000400:00000200:0.0:1734257374.206892:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x801 [1] + 0 00000100:00000200:1.0:1734257374.206895:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098191104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257374.206900:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257374.206902:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:1.0:1734257374.206904:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098191104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257390 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734257374.206906:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098191232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257384 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257374.206923:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257374.206928:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734257374.206931:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:3.0:1734257374.206978:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257374.206985:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257374.206986:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257374.206990:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098191232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257374.206994:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098191232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257384 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257374.207012:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257374.207015:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257374.207018:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257379.211686:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257379.211706:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734257379.211762:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257379.211768:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257379.211892:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257379.211900:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 02000000:00000010:3.0:1734257379.211904:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:1.0:1734257379.211905:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:3.0:1734257379.211908:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257379.211910:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:1.0:1734257379.211911:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098191360, portal 25 00000100:00000200:3.0:1734257379.211912:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098191488, portal 10 00000400:00000010:1.0:1734257379.211914:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734257379.211916:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098191360, offset 0 00000400:00000010:3.0:1734257379.211916:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734257379.211917:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098191488, offset 0 00000400:00000200:1.0:1734257379.211924:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257379.211927:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257379.211935:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257379.211939:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257379.211943:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257379.211945:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257379.211947:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257379.211950:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [227:227:256:4294967295] 192.168.202.108@tcp LPNI seq info [226:226:8:4294967295] 00000400:00000200:1.0:1734257379.211957:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257379.211973:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257379.211973:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257379.211975:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734257379.211977:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000400:00000200:3.0:1734257379.211977:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257379.211978:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257379.211979:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257379.211981:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [228:228:255:4294967295] 192.168.202.108@tcp LPNI seq info [227:227:7:4294967295] 00000800:00000200:1.0:1734257379.211982:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257379.211987:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257379.211989:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257379.211989:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257379.211991:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:1.0:1734257379.211992:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257379.211993:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257379.211996:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257379.211997:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257379.212129:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257379.212132:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734257379.212137:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257379.212140:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257379.212144:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:0.0:1734257379.212145:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734257379.212151:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098191360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257395 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257379.212979:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257379.212983:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734257379.212986:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257379.212995:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257379.212997:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:0.0:1734257379.212998:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734257379.213003:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098191488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257389 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257379.217269:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257379.217298:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607080 00000400:00000200:0.0:1734257379.217307:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x80d [1] + 0 00000400:00000200:0.0:1734257379.217326:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257379.217329:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257379.217339:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098191488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257389 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257379.217467:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257379.217472:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257379.217479:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257379.217484:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098191488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257389 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257379.217490:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098191488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257389 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257379.217515:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257379.217519:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257379.217524:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000200:0.0:1734257379.218050:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257379.218057:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607000 00000400:00000200:0.0:1734257379.218062:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x809 [1] + 224 00000400:00000200:0.0:1734257379.218072:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257379.218075:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257379.218080:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098191360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257395 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257379.218304:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257379.218308:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257379.218309:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257379.218313:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098191360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257395 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257379.218319:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098191360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257395 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257379.218330:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257379.218334:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734257379.218335:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:2.0:1734257384.220770:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734257384.220793:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734257384.220850:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734257384.220856:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257384.220894:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257384.220901:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257384.220908:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257384.220915:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098191744, portal 10 00000400:00000010:2.0:1734257384.220921:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734257384.220923:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098191744, offset 0 00000400:00000200:2.0:1734257384.220934:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257384.220948:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257384.220954:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257384.220958:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257384.220961:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257384.220975:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257384.220979:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [229:229:256:4294967295] 192.168.202.108@tcp LPNI seq info [228:228:8:4294967295] 00000400:00000200:2.0:1734257384.220987:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257384.220993:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257384.220998:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257384.221004:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257384.221012:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257384.221017:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257384.221177:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257384.221180:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257384.221184:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257384.221188:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257384.221192:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734257384.221193:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734257384.221199:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098191744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257394 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257384.221392:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734257384.221397:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257384.221400:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257384.221403:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098191616, portal 25 00000400:00000010:3.0:1734257384.221405:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734257384.221406:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098191616, offset 0 00000400:00000200:3.0:1734257384.221410:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257384.221414:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257384.221416:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257384.221418:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257384.221419:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257384.221421:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257384.221423:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [230:230:256:4294967295] 192.168.202.108@tcp LPNI seq info [229:229:8:4294967295] 00000400:00000200:3.0:1734257384.221427:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257384.221430:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257384.221433:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734257384.221435:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257384.221439:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257384.221441:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257384.221835:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257384.221838:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734257384.221840:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257384.221847:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257384.221849:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734257384.221851:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734257384.221854:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098191616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257400 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257384.223800:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257384.223825:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607180 00000400:00000200:0.0:1734257384.223832:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x819 [1] + 0 00000400:00000200:0.0:1734257384.223844:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257384.223847:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257384.223856:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098191744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257394 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257384.224743:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257384.224749:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607100 00000400:00000200:0.0:1734257384.224754:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x821 [1] + 224 00000400:00000200:0.0:1734257384.224766:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257384.224769:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257384.224775:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098191616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257400 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257384.224864:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257384.224868:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257384.224870:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257384.224875:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098191616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257400 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257384.224892:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098191616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257400 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257384.224910:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257384.224916:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734257384.224919:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:2.0:1734257384.224979:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257384.224982:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257384.224983:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257384.224988:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098191744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257394 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257384.224994:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098191744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257394 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257384.225009:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257384.225013:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734257384.225014:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:0.0:1734257389.228910:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257389.228936:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257389.229000:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257389.229007:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257389.229068:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257389.229078:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257389.229084:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257389.229090:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098192000, portal 10 00000400:00000010:2.0:1734257389.229095:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734257389.229097:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098192000, offset 0 02000000:00000010:1.0:1734257389.229101:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000200:2.0:1734257389.229104:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734257389.229109:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257389.229114:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000200:2.0:1734257389.229115:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:1.0:1734257389.229120:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098191872, portal 25 00000400:00000200:2.0:1734257389.229120:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257389.229122:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:1.0:1734257389.229123:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734257389.229125:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098191872, offset 0 00000400:00000200:2.0:1734257389.229125:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257389.229128:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257389.229131:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257389.229141:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [231:231:256:4294967295] 192.168.202.108@tcp LPNI seq info [230:230:8:4294967295] 00000400:00000200:2.0:1734257389.229154:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257389.229159:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257389.229163:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257389.229168:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734257389.229169:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257389.229174:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:2.0:1734257389.229176:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734257389.229178:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734257389.229179:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734257389.229180:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257389.229182:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257389.229185:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [232:232:255:4294967295] 192.168.202.108@tcp LPNI seq info [231:231:7:4294967295] 00000400:00000200:1.0:1734257389.229192:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257389.229196:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257389.229209:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734257389.229213:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257389.229219:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257389.229222:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257389.229314:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257389.229317:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257389.229321:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257389.229325:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257389.229328:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734257389.229329:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734257389.229336:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098192000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257399 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257389.229395:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257389.229397:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734257389.229399:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257389.229402:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257389.229404:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:0.0:1734257389.229409:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:0.0:1734257389.229413:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098191872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257405 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257389.231187:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257389.231199:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607280 00000400:00000200:0.0:1734257389.231206:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x829 [1] + 0 00000400:00000200:0.0:1734257389.231216:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257389.231220:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257389.231227:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098192000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257399 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257389.231262:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257389.231267:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607200 00000400:00000200:0.0:1734257389.231271:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x831 [1] + 224 00000400:00000200:0.0:1734257389.231297:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257389.231300:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257389.231304:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098191872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257405 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257389.231527:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257389.231531:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257389.231533:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257389.231538:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098192000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257399 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257389.231544:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098192000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257399 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257389.231588:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257389.231593:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257389.231597:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:1.0:1734257389.231793:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257389.231797:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257389.231798:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257389.231802:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098191872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257405 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257389.231808:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098191872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257405 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257389.231818:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257389.231821:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734257389.231822:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257394.236080:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257394.236098:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257394.236157:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257394.236163:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257394.236446:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734257394.236453:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257394.236459:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257394.236465:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098192128, portal 25 00000400:00000010:2.0:1734257394.236468:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734257394.236470:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098192128, offset 0 00000400:00000200:2.0:1734257394.236478:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257394.236489:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257394.236494:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257394.236497:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257394.236501:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257394.236503:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257394.236505:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [233:233:256:4294967295] 192.168.202.108@tcp LPNI seq info [232:232:8:4294967295] 00000400:00000200:2.0:1734257394.236522:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257394.236527:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257394.236530:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257394.236535:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257394.236542:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257394.236545:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257394.236904:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257394.236908:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257394.236912:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257394.236914:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098192256, portal 10 00000400:00000010:3.0:1734257394.236918:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734257394.236920:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098192256, offset 0 00000400:00000200:3.0:1734257394.236924:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257394.236928:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257394.236931:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257394.236932:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257394.236934:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257394.236936:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257394.236938:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [234:234:255:4294967295] 192.168.202.108@tcp LPNI seq info [233:233:7:4294967295] 00000400:00000200:3.0:1734257394.236943:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257394.236947:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257394.236949:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734257394.236952:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257394.236955:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257394.236957:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257394.237507:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257394.237509:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257394.237513:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257394.237517:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257394.237520:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734257394.237522:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734257394.237528:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098192128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257410 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257394.237593:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257394.237599:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734257394.237602:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257394.237605:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257394.237607:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:0.0:1734257394.237608:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734257394.237612:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098192256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257404 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257394.240687:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257394.240702:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607380 00000400:00000200:0.0:1734257394.240709:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x841 [1] + 0 00000400:00000200:0.0:1734257394.240718:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257394.240721:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257394.240729:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098192256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257404 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257394.240761:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257394.240764:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607300 00000400:00000200:0.0:1734257394.240768:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x839 [1] + 224 00000400:00000200:0.0:1734257394.240782:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257394.240784:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257394.240788:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098192128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257410 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257394.240870:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257394.240874:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257394.240876:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257394.240879:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098192256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257404 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257394.240895:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098192256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257404 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257394.240916:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257394.240919:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734257394.240923:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:2.0:1734257394.241612:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257394.241615:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257394.241617:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257394.241621:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098192128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257410 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257394.241627:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098192128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257410 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257394.241639:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734257394.241641:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734257394.241643:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257399.243908:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257399.243930:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734257399.243983:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257399.243989:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257399.244071:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734257399.244077:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 02000000:00000010:3.0:1734257399.244079:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:1.0:1734257399.244083:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257399.244088:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098192384, portal 25 00000400:00000010:3.0:1734257399.244088:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257399.244091:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000010:1.0:1734257399.244092:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734257399.244094:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098192384, offset 0 00000100:00000200:3.0:1734257399.244094:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098192512, portal 10 00000400:00000010:3.0:1734257399.244098:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000400:00000200:1.0:1734257399.244101:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257399.244112:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257399.244116:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257399.244120:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257399.244122:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257399.244124:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257399.244126:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [235:235:256:4294967295] 192.168.202.108@tcp LPNI seq info [234:234:8:4294967295] 00000400:00000200:1.0:1734257399.244133:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257399.244138:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257399.244141:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734257399.244154:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257399.244160:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257399.244163:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:3.0:1734257399.244382:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098192512, offset 0 00000400:00000200:3.0:1734257399.244388:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257399.244393:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257399.244395:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257399.244397:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257399.244399:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257399.244400:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257399.244402:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [236:236:255:4294967295] 192.168.202.108@tcp LPNI seq info [235:235:7:4294967295] 00000400:00000200:3.0:1734257399.244407:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257399.244411:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257399.244413:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734257399.244416:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257399.244419:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257399.244421:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257399.245168:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257399.245172:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734257399.245176:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257399.245181:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257399.245184:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:0.0:1734257399.245190:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:0.0:1734257399.245208:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098192384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257415 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257399.245300:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257399.245303:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734257399.245305:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257399.245308:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257399.245310:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:0.0:1734257399.245312:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734257399.245315:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098192512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257409 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257399.247194:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257399.247216:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607400 00000400:00000200:0.0:1734257399.247223:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x849 [1] + 224 00000400:00000200:0.0:1734257399.247231:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257399.247233:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257399.247240:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098192384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257415 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257399.247274:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257399.247278:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607480 00000400:00000200:0.0:1734257399.247282:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x84d [1] + 0 00000400:00000200:0.0:1734257399.247294:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257399.247297:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257399.247301:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098192512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257409 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257399.247442:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257399.247446:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257399.247447:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257399.247451:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098192512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257409 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257399.247468:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098192512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257409 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257399.247490:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257399.247493:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257399.247496:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:1.0:1734257399.247563:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257399.247630:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257399.247631:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257399.247635:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098192384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257415 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257399.247641:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098192384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257415 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257399.247651:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734257399.247653:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734257399.247655:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734257404.251817:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257404.251836:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734257404.251886:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257404.251891:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257404.252155:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734257404.252188:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257404.252194:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257404.252200:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098192640, portal 25 00000400:00000010:3.0:1734257404.252204:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734257404.252206:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098192640, offset 0 00000400:00000200:3.0:1734257404.252212:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257404.252223:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257404.252227:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257404.252231:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257404.252234:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257404.252236:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257404.252238:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [237:237:256:4294967295] 192.168.202.108@tcp LPNI seq info [236:236:8:4294967295] 00000400:00000200:3.0:1734257404.252245:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257404.252249:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257404.252253:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734257404.252258:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257404.252264:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257404.252267:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257404.252351:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257404.252355:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257404.252358:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257404.252361:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098192768, portal 10 00000400:00000010:2.0:1734257404.252365:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734257404.252367:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098192768, offset 0 00000400:00000200:2.0:1734257404.252370:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257404.252374:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257404.252377:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257404.252378:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257404.252380:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257404.252381:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257404.252383:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [238:238:255:4294967295] 192.168.202.108@tcp LPNI seq info [237:237:7:4294967295] 00000400:00000200:2.0:1734257404.252388:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257404.252397:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257404.252399:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257404.252402:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257404.252404:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257404.252406:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257404.252473:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257404.252475:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734257404.252479:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257404.252483:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257404.252486:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:0.0:1734257404.252487:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:0.0:1734257404.252493:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098192640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257404.252552:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257404.252554:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257404.252557:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257404.252559:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257404.252561:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734257404.252562:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734257404.252565:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098192768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257414 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257404.256045:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257404.256065:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607500 00000400:00000200:0.0:1734257404.256074:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x859 [1] + 224 00000400:00000200:0.0:1734257404.256086:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257404.256091:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257404.256101:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098192640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257404.256136:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257404.256139:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607580 00000400:00000200:0.0:1734257404.256144:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x861 [1] + 0 00000400:00000200:0.0:1734257404.256169:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257404.256172:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257404.256177:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098192768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257414 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257404.256201:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257404.256220:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257404.256222:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257404.256232:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098192640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257404.256256:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098192640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257420 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257404.256276:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257404.256280:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734257404.256284:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:2.0:1734257404.256557:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257404.256561:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257404.256562:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257404.256628:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098192768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257414 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257404.256636:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098192768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257414 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734257404.256647:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:2.0:1734257404.262142:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257404.262164:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257404.262169:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734257409.259685:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257409.259702:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 02000000:00000010:1.0:1734257409.259772:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734257409.259780:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257409.259785:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257409.259792:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098192896, portal 25 00000400:00000010:1.0:1734257409.259796:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734257409.259797:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098192896, offset 0 00000400:00000200:1.0:1734257409.259805:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257409.259815:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257409.259819:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257409.259822:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257409.259824:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257409.259826:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257409.259828:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [239:239:256:4294967295] 192.168.202.108@tcp LPNI seq info [238:238:8:4294967295] 00000400:00000200:1.0:1734257409.259835:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257409.259839:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257409.259842:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734257409.259847:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257409.259853:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257409.259866:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257409.259970:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257409.259973:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:1.0:1734257409.259976:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257409.259979:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257409.259983:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:1.0:1734257409.259984:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734257409.259989:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098192896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257425 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257409.260404:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257409.260411:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257409.260868:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257409.260872:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257409.260876:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257409.260878:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098193024, portal 10 00000400:00000010:2.0:1734257409.260882:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734257409.260884:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098193024, offset 0 00000400:00000200:2.0:1734257409.260888:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257409.260893:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257409.260895:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257409.260897:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257409.260899:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257409.260901:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257409.260902:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [240:240:256:4294967295] 192.168.202.108@tcp LPNI seq info [239:239:8:4294967295] 00000400:00000200:2.0:1734257409.260908:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257409.260917:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257409.260920:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257409.260923:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257409.260927:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257409.260929:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257409.261053:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257409.261056:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257409.261059:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257409.261062:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257409.261065:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734257409.261066:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734257409.261070:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098193024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257419 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257409.263237:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257409.263251:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607600 00000400:00000200:0.0:1734257409.263257:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x869 [1] + 224 00000400:00000200:0.0:1734257409.263272:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257409.263275:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257409.263283:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098192896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257425 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257409.263469:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257409.263473:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257409.263475:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257409.263479:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098192896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257425 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257409.263485:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098192896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257425 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257409.263501:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734257409.263504:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734257409.263507:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734257409.263816:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257409.263823:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607680 00000400:00000200:0.0:1734257409.263828:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x871 [1] + 0 00000400:00000200:0.0:1734257409.263836:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257409.263839:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257409.263844:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098193024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257419 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257409.264007:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257409.264010:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257409.264011:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257409.264015:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098193024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257419 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257409.264021:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098193024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257419 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257409.264036:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257409.264039:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257409.264041:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257414.267804:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257414.267822:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257414.267889:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257414.267895:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257414.267909:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734257414.267917:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257414.267923:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257414.267929:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098193152, portal 25 00000400:00000010:1.0:1734257414.267933:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734257414.267935:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098193152, offset 0 00000400:00000200:1.0:1734257414.267943:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257414.267953:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257414.267957:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257414.267961:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257414.267963:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257414.267965:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257414.267967:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [241:241:256:4294967295] 192.168.202.108@tcp LPNI seq info [240:240:8:4294967295] 00000400:00000200:1.0:1734257414.267980:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257414.267985:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257414.267988:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734257414.267993:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:3.0:1734257414.267994:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000800:00000200:1.0:1734257414.268000:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257414.268003:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:3.0:1734257414.268004:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257414.268010:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257414.268015:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098193280, portal 10 00000400:00000010:3.0:1734257414.268021:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734257414.268023:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098193280, offset 0 00000400:00000200:3.0:1734257414.268030:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257414.268040:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257414.268044:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257414.268047:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257414.268050:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257414.268051:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257414.268054:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [242:242:255:4294967295] 192.168.202.108@tcp LPNI seq info [241:241:7:4294967295] 00000400:00000200:3.0:1734257414.268062:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257414.268066:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257414.268069:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734257414.268074:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257414.268095:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257414.268099:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257414.268143:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257414.268146:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734257414.268150:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257414.268154:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257414.268158:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:0.0:1734257414.268159:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:0.0:1734257414.268164:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098193152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257430 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257414.268188:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257414.268190:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734257414.268192:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257414.268195:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257414.268197:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:0.0:1734257414.268198:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:0.0:1734257414.268201:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098193280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257424 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257414.270039:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257414.270048:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607780 00000400:00000200:0.0:1734257414.270053:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x881 [1] + 0 00000400:00000200:0.0:1734257414.270060:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257414.270062:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257414.270068:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098193280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257424 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257414.270187:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257414.270192:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607700 00000400:00000200:0.0:1734257414.270196:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x879 [1] + 224 00000400:00000200:0.0:1734257414.270210:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257414.270213:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257414.270222:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098193152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257430 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257414.270292:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257414.270296:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257414.270298:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257414.270302:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098193280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257424 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257414.270318:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098193280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257424 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257414.270344:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257414.270349:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257414.270352:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:1.0:1734257414.270374:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257414.270378:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257414.270379:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257414.270383:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098193152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257430 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257414.270389:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098193152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257430 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257414.270399:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734257414.270402:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734257414.270404:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734257419.275835:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257419.275857:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257419.275920:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257419.275927:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257419.276025:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 02000000:00000010:1.0:1734257419.276051:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734257419.276056:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257419.276062:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:3.0:1734257419.276063:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000100:00000200:1.0:1734257419.276069:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098193408, portal 25 00000400:00000010:3.0:1734257419.276069:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257419.276072:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098193536, portal 10 00000400:00000010:1.0:1734257419.276073:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734257419.276075:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098193408, offset 0 00000400:00000010:3.0:1734257419.276077:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734257419.276078:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098193536, offset 0 00000400:00000200:1.0:1734257419.276083:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257419.276510:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257419.276516:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257419.276519:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257419.276522:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257419.276524:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257419.276526:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [243:243:256:4294967295] 192.168.202.108@tcp LPNI seq info [242:242:8:4294967295] 00000400:00000200:1.0:1734257419.276534:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257419.276549:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257419.276553:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734257419.276558:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257419.276565:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257419.276632:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734257419.276666:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257419.276672:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257419.276674:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257419.276676:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257419.276678:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257419.276680:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257419.276681:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [244:244:255:4294967295] 192.168.202.108@tcp LPNI seq info [243:243:7:4294967295] 00000400:00000200:3.0:1734257419.276688:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257419.276691:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257419.276694:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734257419.276697:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257419.276700:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257419.276702:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257419.276936:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257419.276938:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734257419.276943:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257419.276947:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257419.276951:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734257419.276953:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734257419.276959:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098193408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257435 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257419.277448:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257419.277450:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734257419.277452:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257419.277455:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257419.277457:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734257419.277458:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:0.0:1734257419.277462:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098193536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257429 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257419.280107:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257419.280122:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607800 00000400:00000200:0.0:1734257419.280129:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x889 [1] + 224 00000400:00000200:0.0:1734257419.280149:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257419.280152:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257419.280161:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098193408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257435 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257419.280292:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257419.280296:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257419.280298:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257419.280303:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098193408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257435 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257419.280310:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098193408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257435 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257419.280329:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734257419.280333:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734257419.280337:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000200:0.0:1734257419.280869:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257419.280883:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607880 00000400:00000200:0.0:1734257419.280888:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x88d [1] + 0 00000400:00000200:0.0:1734257419.280898:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257419.280901:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257419.280906:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098193536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257429 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257419.281125:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257419.281129:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257419.281131:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257419.281136:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098193536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257429 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257419.281151:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098193536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257429 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257419.281171:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257419.281174:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257419.281178:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734257424.283792:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257424.283812:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 02000000:00000010:3.0:1734257424.284772:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734257424.284780:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257424.284785:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257424.284790:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098193664, portal 25 00000400:00000010:3.0:1734257424.284794:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734257424.284795:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098193664, offset 0 00000400:00000200:3.0:1734257424.284802:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257424.284813:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257424.284817:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257424.284820:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257424.284822:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257424.284824:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257424.284826:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [245:245:256:4294967295] 192.168.202.108@tcp LPNI seq info [244:244:8:4294967295] 00000400:00000200:3.0:1734257424.284834:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257424.284838:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257424.284841:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734257424.284846:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257424.284852:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257424.284856:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257424.285123:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257424.285131:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 00000800:00000200:3.0:1734257424.285195:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257424.285198:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:3.0:1734257424.285201:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257424.285205:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257424.285208:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:3.0:1734257424.285218:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734257424.285223:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098193664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257440 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257424.285890:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257424.285895:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257424.285899:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257424.285902:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098193792, portal 10 00000400:00000010:2.0:1734257424.285906:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734257424.285907:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098193792, offset 0 00000400:00000200:2.0:1734257424.285911:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257424.285916:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257424.285918:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257424.285920:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257424.285922:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257424.285923:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257424.285925:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [246:246:256:4294967295] 192.168.202.108@tcp LPNI seq info [245:245:8:4294967295] 00000400:00000200:2.0:1734257424.285930:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257424.285933:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257424.285941:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257424.285944:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257424.285948:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257424.285950:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257424.286154:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257424.286157:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257424.286160:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257424.286163:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257424.286165:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734257424.286166:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734257424.286170:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098193792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257434 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257424.286657:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257424.286666:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607900 00000400:00000200:0.0:1734257424.286671:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x899 [1] + 224 00000400:00000200:0.0:1734257424.286685:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257424.286688:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257424.286692:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098193664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257440 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257424.286894:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257424.286898:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257424.286899:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257424.286904:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098193664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257440 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257424.286911:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098193664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257440 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257424.286928:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257424.286932:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734257424.286935:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:0.0:1734257424.287468:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257424.287484:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607980 00000400:00000200:0.0:1734257424.287491:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x8a1 [1] + 0 00000400:00000200:0.0:1734257424.287509:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257424.287519:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257424.287528:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098193792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257434 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257424.287731:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257424.287737:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257424.287738:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257424.287743:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098193792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257434 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257424.287750:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098193792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257434 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257424.287773:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257424.287778:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257424.287781:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734257429.294075:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257429.294095:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257429.294155:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257429.294162:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257429.294228:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257429.294235:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257429.294241:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257429.294252:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098194048, portal 10 00000400:00000010:2.0:1734257429.294257:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257429.294259:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098194048, offset 0 02000000:00000010:3.0:1734257429.294263:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000200:2.0:1734257429.294266:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734257429.294268:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257429.294271:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257429.294274:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098193920, portal 25 00000400:00000010:3.0:1734257429.294276:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000400:00000200:2.0:1734257429.294277:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:3.0:1734257429.294277:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098193920, offset 0 00000400:00000200:2.0:1734257429.294281:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257429.294282:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257429.294284:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257429.294287:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257429.294289:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257429.294291:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [247:247:256:4294967295] 192.168.202.108@tcp LPNI seq info [246:246:8:4294967295] 00000400:00000200:2.0:1734257429.294298:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257429.294302:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257429.294306:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257429.294319:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257429.294326:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257429.294330:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257429.294427:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257429.294430:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257429.294433:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257429.294437:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257429.294440:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734257429.294442:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734257429.294447:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098194048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257439 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734257429.294510:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257429.294512:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257429.294514:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257429.294516:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257429.294518:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257429.294520:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [248:248:255:4294967295] 192.168.202.108@tcp LPNI seq info [247:247:7:4294967295] 00000400:00000200:3.0:1734257429.294525:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257429.294528:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257429.294530:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734257429.294533:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257429.294536:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257429.294541:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257429.294602:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257429.294603:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734257429.294605:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257429.294608:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257429.294609:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:0.0:1734257429.294610:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:0.0:1734257429.294613:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098193920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257445 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257429.298792:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257429.298807:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607a00 00000400:00000200:0.0:1734257429.298813:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x8b1 [1] + 224 00000400:00000200:0.0:1734257429.298821:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257429.298825:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257429.298833:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098193920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257445 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257429.298872:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257429.298886:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607a80 00000400:00000200:0.0:1734257429.298890:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x8a9 [1] + 0 00000400:00000200:0.0:1734257429.298904:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257429.298906:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257429.298911:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098194048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257439 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257429.299035:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257429.299040:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257429.299041:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257429.299046:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098193920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257445 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257429.299052:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098193920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257445 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257429.299068:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257429.299073:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734257429.299076:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:2.0:1734257429.299143:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257429.299146:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257429.299147:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257429.299151:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098194048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257439 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257429.299157:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098194048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257439 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257429.299173:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257429.299177:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257429.299179:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257434.299727:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257434.299754:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 02000000:00000010:1.0:1734257434.300385:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257434.300395:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257434.300403:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257434.300411:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098194176, portal 25 00000400:00000010:1.0:1734257434.300416:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734257434.300419:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098194176, offset 0 00000400:00000200:1.0:1734257434.300429:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257434.300445:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257434.300450:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257434.300453:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257434.300456:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257434.300459:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257434.300462:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [249:249:256:4294967295] 192.168.202.108@tcp LPNI seq info [248:248:8:4294967295] 00000400:00000200:1.0:1734257434.300471:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257434.300476:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257434.300496:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734257434.300507:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257434.300516:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257434.300521:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734257434.300726:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257434.300729:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:2.0:1734257434.300732:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257434.300737:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257434.300740:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:2.0:1734257434.300742:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:2.0:1734257434.300750:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098194176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257450 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257434.302065:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257434.302080:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734257434.302169:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257434.302174:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257434.302179:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257434.302184:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098194304, portal 10 00000400:00000010:3.0:1734257434.302192:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734257434.302194:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098194304, offset 0 00000400:00000200:3.0:1734257434.302199:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257434.302207:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257434.302211:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257434.302213:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257434.302216:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257434.302217:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257434.302220:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [250:250:256:4294967295] 192.168.202.108@tcp LPNI seq info [249:249:8:4294967295] 00000400:00000200:3.0:1734257434.302227:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257434.302231:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257434.302235:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734257434.302239:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257434.302243:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257434.302246:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257434.302397:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257434.302400:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734257434.302403:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257434.302407:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257434.302409:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:0.0:1734257434.302410:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:0.0:1734257434.302417:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098194304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257444 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257434.303855:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257434.303872:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607b00 00000400:00000200:0.0:1734257434.303881:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x8b9 [1] + 224 00000400:00000200:0.0:1734257434.303892:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257434.303895:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257434.303903:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098194176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257434.303948:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257434.303953:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607b80 00000400:00000200:0.0:1734257434.303958:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x8c1 [1] + 0 00000400:00000200:0.0:1734257434.303974:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257434.303982:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257434.303987:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098194304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257444 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257434.304057:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257434.304062:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257434.304063:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257434.304068:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098194176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257450 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257434.304068:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257434.304071:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257434.304073:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:1.0:1734257434.304074:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098194176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257450 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257434.304076:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098194304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257444 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257434.304081:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098194304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257444 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257434.304099:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:3.0:1734257434.304102:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:1.0:1734257434.304106:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 02000000:00000010:3.0:1734257434.304106:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734257434.304110:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:3.0:1734257434.304110:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734257439.307677:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257439.307698:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 02000000:00000010:2.0:1734257439.308026:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734257439.308033:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257439.308038:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257439.308045:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098194432, portal 25 00000400:00000010:2.0:1734257439.308049:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734257439.308050:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098194432, offset 0 00000400:00000200:2.0:1734257439.308057:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257439.308069:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257439.308073:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257439.308076:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257439.308090:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257439.308092:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257439.308094:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [251:251:256:4294967295] 192.168.202.108@tcp LPNI seq info [250:250:8:4294967295] 00000400:00000200:2.0:1734257439.308102:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257439.308106:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257439.308109:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257439.308114:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257439.308120:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257439.308123:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257439.308261:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257439.308264:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734257439.308267:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257439.308271:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257439.308275:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:3.0:1734257439.308276:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:3.0:1734257439.308282:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098194432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257455 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257439.308300:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257439.308306:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257439.308365:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257439.308369:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257439.308371:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257439.308373:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098194560, portal 10 00000400:00000010:3.0:1734257439.308377:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734257439.308379:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098194560, offset 0 00000400:00000200:3.0:1734257439.308383:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257439.308387:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257439.308389:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257439.308390:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257439.308392:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257439.308393:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257439.308395:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [252:252:256:4294967295] 192.168.202.108@tcp LPNI seq info [251:251:8:4294967295] 00000400:00000200:3.0:1734257439.308401:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257439.308409:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257439.308411:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734257439.308414:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257439.308417:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257439.308419:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257439.308478:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257439.308480:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734257439.308482:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257439.308485:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257439.308486:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734257439.308487:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:0.0:1734257439.308491:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098194560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257449 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257439.311118:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257439.311196:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607c00 00000400:00000200:0.0:1734257439.311202:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x8c9 [1] + 224 00000400:00000200:0.0:1734257439.311211:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257439.311213:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257439.311220:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098194432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257455 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257439.311246:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257439.311250:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607c80 00000400:00000200:0.0:1734257439.311254:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x8d1 [1] + 0 00000400:00000200:0.0:1734257439.311269:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257439.311271:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257439.311274:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098194560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257449 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257439.311279:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257439.311283:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257439.311285:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257439.311289:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098194432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257455 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257439.311294:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098194432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257455 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257439.311313:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734257439.311317:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734257439.311320:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:3.0:1734257439.311363:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257439.311366:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257439.311367:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257439.311371:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098194560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257449 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257439.311376:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098194560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257449 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257439.311390:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257439.311393:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257439.311395:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734257444.316601:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257444.316624:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257444.317978:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257444.317994:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257444.318061:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257444.318070:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257444.318077:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257444.318085:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098194816, portal 10 00000400:00000010:3.0:1734257444.318091:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734257444.318093:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098194816, offset 0 00000400:00000200:3.0:1734257444.318102:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257444.318113:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257444.318118:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257444.318122:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257444.318124:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257444.318126:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257444.318129:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [253:253:256:4294967295] 192.168.202.108@tcp LPNI seq info [252:252:8:4294967295] 00000400:00000200:3.0:1734257444.318137:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257444.318142:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257444.318157:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257444.318163:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257444.318171:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257444.318175:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734257444.318737:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257444.318743:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257444.318747:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257444.318750:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098194688, portal 25 00000400:00000010:1.0:1734257444.318752:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734257444.318754:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098194688, offset 0 00000400:00000200:1.0:1734257444.318758:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257444.318762:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257444.318765:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257444.318767:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257444.318768:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257444.318770:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257444.318772:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [254:254:255:4294967295] 192.168.202.108@tcp LPNI seq info [253:253:7:4294967295] 00000400:00000200:1.0:1734257444.318777:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257444.318780:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257444.318783:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734257444.318792:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257444.318796:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257444.318798:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734257444.319210:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257444.319213:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:2.0:1734257444.319218:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257444.319222:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257444.319226:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:2.0:1734257444.319227:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:2.0:1734257444.319235:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098194816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257454 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257444.319650:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257444.319653:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:2.0:1734257444.319656:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257444.319659:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257444.319666:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:2.0:1734257444.319667:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:2.0:1734257444.319671:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098194688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257460 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257444.322360:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257444.322375:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607d00 00000400:00000200:0.0:1734257444.322383:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x8e1 [1] + 224 00000400:00000200:0.0:1734257444.322403:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257444.322406:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257444.322415:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098194688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257460 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257444.322914:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257444.322919:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257444.322921:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257444.322927:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098194688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257460 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257444.322934:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098194688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257460 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257444.322960:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257444.322966:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734257444.322970:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734257444.323616:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257444.323626:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607d80 00000400:00000200:0.0:1734257444.323632:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x8d9 [1] + 0 00000400:00000200:0.0:1734257444.323645:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257444.323648:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257444.323655:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098194816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257454 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257444.323729:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257444.323733:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257444.323735:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257444.323739:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098194816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257454 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257444.323745:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098194816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257454 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257444.323763:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257444.323766:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257444.323769:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734257449.324001:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257449.324027:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257449.325289:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257449.325303:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734257449.325333:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257449.325341:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257449.325348:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257449.325356:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098194944, portal 25 00000400:00000010:1.0:1734257449.325361:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734257449.325363:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098194944, offset 0 02000000:00000010:2.0:1734257449.325369:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:1.0:1734257449.325373:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734257449.325374:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257449.325378:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257449.325380:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098195072, portal 10 00000400:00000010:2.0:1734257449.325384:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734257449.325385:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098195072, offset 0 00000400:00000200:1.0:1734257449.325388:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257449.325388:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257449.325394:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257449.325398:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257449.325402:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257449.325404:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257449.325406:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [255:255:256:4294967295] 192.168.202.108@tcp LPNI seq info [254:254:8:4294967295] 00000400:00000200:1.0:1734257449.325414:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257449.325420:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257449.325420:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257449.325422:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734257449.325424:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000400:00000200:2.0:1734257449.325424:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257449.325425:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257449.325426:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257449.325429:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [256:256:255:4294967295] 192.168.202.108@tcp LPNI seq info [255:255:7:4294967295] 00000800:00000200:1.0:1734257449.325430:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257449.325433:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257449.325436:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257449.325438:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257449.325439:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257449.325440:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257449.325442:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257449.325445:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257449.325461:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257449.325649:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257449.325653:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:3.0:1734257449.325658:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257449.325662:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257449.325666:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:3.0:1734257449.325668:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:3.0:1734257449.325676:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098195072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734257449.325747:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257449.325749:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:3.0:1734257449.325751:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257449.325754:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257449.325756:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:3.0:1734257449.325757:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:3.0:1734257449.325761:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098194944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257465 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257449.329781:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257449.329806:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607e00 00000400:00000200:0.0:1734257449.329814:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x8e9 [1] + 224 00000400:00000200:0.0:1734257449.329830:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257449.329833:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257449.329857:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098194944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257465 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257449.329892:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257449.329897:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607e80 00000400:00000200:0.0:1734257449.329901:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x8f1 [1] + 0 00000400:00000200:0.0:1734257449.329912:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257449.329914:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257449.329919:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098195072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257459 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257449.330261:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257449.330271:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257449.330274:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257449.330280:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098194944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257465 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257449.330287:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098194944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257465 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257449.330437:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257449.330443:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734257449.330555:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:2.0:1734257449.330773:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257449.330778:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257449.330779:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257449.330784:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098195072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257449.330799:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098195072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257459 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257449.330829:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257449.330833:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257449.330836:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257454.332722:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257454.332745:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734257454.332852:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257454.332860:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734257454.332946:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257454.332969:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257454.332976:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257454.332983:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098195328, portal 10 00000400:00000010:3.0:1734257454.332995:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734257454.332997:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098195328, offset 0 00000400:00000200:3.0:1734257454.333007:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257454.333020:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257454.333026:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257454.333030:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257454.333032:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257454.333034:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257454.333037:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [257:257:256:4294967295] 192.168.202.108@tcp LPNI seq info [256:256:8:4294967295] 00000400:00000200:3.0:1734257454.333046:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257454.333052:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257454.333056:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734257454.333061:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257454.333070:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257454.333074:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257454.333360:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257454.333363:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734257454.333367:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257454.333372:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257454.333376:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:0.0:1734257454.333378:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:0.0:1734257454.333385:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098195328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257464 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257454.333464:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734257454.333469:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257454.333472:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257454.333475:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098195200, portal 25 00000400:00000010:2.0:1734257454.333478:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734257454.333479:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098195200, offset 0 00000400:00000200:2.0:1734257454.333483:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257454.333487:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257454.333489:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257454.333491:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257454.333492:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257454.333494:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257454.333496:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [258:258:256:4294967295] 192.168.202.108@tcp LPNI seq info [257:257:8:4294967295] 00000400:00000200:2.0:1734257454.333502:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257454.333505:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257454.333508:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257454.333510:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257454.333514:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257454.333515:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257454.333605:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257454.333607:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734257454.333610:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257454.333613:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257454.333615:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:3.0:1734257454.333617:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:3.0:1734257454.333620:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098195200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257470 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257454.337338:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257454.337359:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c607f00 00000400:00000200:0.0:1734257454.337370:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x901 [1] + 224 00000400:00000200:0.0:1734257454.337383:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257454.337387:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257454.337399:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098195200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257470 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257454.337621:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000010:2.0:1734257454.337627:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257454.337631:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257454.337634:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000400:00000200:0.0:1734257454.337638:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c607f80 00000100:00000200:2.0:1734257454.337638:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098195200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257470 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257454.337643:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x8f9 [1] + 0 00000100:00000200:2.0:1734257454.337644:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098195200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257470 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257454.337655:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257454.337657:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257454.337661:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098195328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257464 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257454.337679:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 00000400:00000010:3.0:1734257454.337723:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257454.337727:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257454.337731:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257454.337736:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098195328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257464 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257454.337738:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:2.0:1734257454.337742:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000200:3.0:1734257454.337757:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098195328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257464 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257454.337777:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257454.337780:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734257454.337783:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734257459.339743:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257459.339772:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257459.341217:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257459.341233:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734257459.341261:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257459.341271:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257459.341278:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257459.341285:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098195456, portal 25 00000400:00000010:1.0:1734257459.341290:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734257459.341292:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098195456, offset 0 00000400:00000200:1.0:1734257459.341302:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257459.341318:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257459.341324:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257459.341328:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257459.341331:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257459.341333:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257459.341336:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [259:259:256:4294967295] 192.168.202.108@tcp LPNI seq info [258:258:8:4294967295] 00000400:00000200:1.0:1734257459.341346:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257459.341351:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257459.341355:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734257459.341361:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257459.341369:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257459.341374:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257459.342316:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257459.342325:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257459.342329:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257459.342333:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098195584, portal 10 00000400:00000010:3.0:1734257459.342338:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734257459.342339:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098195584, offset 0 00000400:00000200:3.0:1734257459.342345:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257459.342352:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257459.342355:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257459.342357:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257459.342359:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:0.0:1734257459.342360:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:3.0:1734257459.342360:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257459.342363:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [260:260:255:4294967295] 192.168.202.108@tcp LPNI seq info [259:259:7:4294967295] 00000800:00000010:0.0:1734257459.342364:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734257459.342368:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257459.342369:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257459.342373:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257459.342374:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000800:00000010:3.0:1734257459.342376:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734257459.342378:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:0.0:1734257459.342379:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000800:00000200:3.0:1734257459.342380:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257459.342384:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257459.342386:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:0.0:1734257459.342390:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098195456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257475 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257459.342442:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257459.342445:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734257459.342447:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257459.342450:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257459.342453:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:0.0:1734257459.342454:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734257459.342457:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098195584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257469 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257459.345628:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257459.345657:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608000 00000400:00000200:0.0:1734257459.345670:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x909 [1] + 224 00000400:00000200:0.0:1734257459.345684:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257459.345692:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257459.345705:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098195456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257475 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257459.345935:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257459.345941:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608080 00000400:00000200:0.0:1734257459.345947:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x911 [1] + 0 00000400:00000200:0.0:1734257459.345965:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257459.345968:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257459.345974:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098195584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257469 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257459.346129:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257459.346149:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257459.346152:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257459.346162:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098195584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257469 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257459.346185:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098195584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257469 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257459.346273:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257459.346282:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734257459.346290:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:1.0:1734257459.346363:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257459.346369:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257459.346371:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257459.346378:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098195456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257475 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257459.346385:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098195456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257475 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257459.346413:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257459.346421:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734257459.346425:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734257464.347757:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257464.347790:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257464.347873:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257464.347882:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257464.347934:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257464.347947:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257464.347956:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257464.347967:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098195712, portal 25 00000400:00000010:1.0:1734257464.347971:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734257464.347974:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098195712, offset 0 00000400:00000200:1.0:1734257464.347986:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257464.348002:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257464.348007:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257464.348011:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257464.348015:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257464.348018:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257464.348021:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [261:261:256:4294967295] 192.168.202.108@tcp LPNI seq info [260:260:8:4294967295] 00000400:00000200:1.0:1734257464.348029:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257464.348035:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257464.348042:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734257464.348048:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257464.348060:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257464.348064:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257464.348313:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257464.348318:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257464.348322:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257464.348324:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098195840, portal 10 00000400:00000010:2.0:1734257464.348329:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734257464.348330:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098195840, offset 0 00000400:00000200:2.0:1734257464.348334:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257464.348339:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257464.348341:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257464.348343:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257464.348345:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257464.348346:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257464.348348:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [262:262:255:4294967295] 192.168.202.108@tcp LPNI seq info [261:261:7:4294967295] 00000400:00000200:2.0:1734257464.348355:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257464.348358:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257464.348361:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257464.348364:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257464.348368:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257464.348370:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257464.349711:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257464.349718:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734257464.349725:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257464.349732:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257464.349737:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:0.0:1734257464.349739:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:0.0:1734257464.349748:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098195712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257480 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257464.349821:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257464.349823:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257464.349827:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257464.349831:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257464.349833:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734257464.349834:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734257464.349839:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098195840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257474 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257464.353424:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257464.353458:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608180 00000400:00000200:0.0:1734257464.353469:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x921 [1] + 0 00000400:00000200:0.0:1734257464.353490:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257464.353495:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257464.353507:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098195840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257474 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257464.355154:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257464.355165:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608100 00000400:00000200:0.0:1734257464.355172:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x919 [1] + 224 00000400:00000200:0.0:1734257464.355188:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257464.355191:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257464.355201:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098195712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257480 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257464.355348:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257464.355360:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257464.355363:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257464.355367:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098195712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257480 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257464.355373:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098195712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257480 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257464.355394:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257464.355398:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734257464.355408:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:2.0:1734257464.355760:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257464.355764:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257464.355765:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257464.355770:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098195840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257474 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257464.355777:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098195840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257474 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257464.355805:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257464.355809:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257464.355813:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257469.355794:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257469.355823:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 02000000:00000010:1.0:1734257469.356739:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257469.356750:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257469.356759:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257469.356767:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098195968, portal 25 00000400:00000010:1.0:1734257469.356773:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734257469.356775:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098195968, offset 0 00000400:00000200:1.0:1734257469.356786:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257469.356804:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000010:0.0:1734257469.357157:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257469.357170:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 00000400:00000200:1.0:1734257469.357237:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257469.357244:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257469.357249:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257469.357252:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257469.357255:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [263:263:256:4294967295] 192.168.202.108@tcp LPNI seq info [262:262:8:4294967295] 00000400:00000200:1.0:1734257469.357265:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257469.357274:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257469.357279:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 02000000:00000010:2.0:1734257469.357282:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000800:00000200:1.0:1734257469.357287:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:2.0:1734257469.357288:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257469.357292:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000800:00000200:1.0:1734257469.357296:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:2.0:1734257469.357297:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098196096, portal 10 00000800:00000200:1.0:1734257469.357301:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734257469.357302:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734257469.357303:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098196096, offset 0 00000400:00000200:2.0:1734257469.357308:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257469.357315:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257469.357318:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257469.357320:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257469.357322:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257469.357324:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257469.357326:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [264:264:255:4294967295] 192.168.202.108@tcp LPNI seq info [263:263:7:4294967295] 00000400:00000200:2.0:1734257469.357331:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257469.357335:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257469.357337:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257469.357340:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257469.357343:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257469.357345:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257469.357427:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257469.357432:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734257469.357439:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257469.357444:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257469.357449:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:0.0:1734257469.357451:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:0.0:1734257469.357459:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098195968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257485 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257469.357549:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257469.357551:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257469.357554:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257469.357557:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257469.357559:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734257469.357586:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734257469.357590:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098196096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257479 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257469.363222:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257469.363242:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608200 00000400:00000200:0.0:1734257469.363251:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x929 [1] + 224 00000400:00000200:0.0:1734257469.363280:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257469.363285:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257469.363298:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098195968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257485 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257469.363375:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257469.363382:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257469.363384:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257469.363400:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098195968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257485 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257469.363407:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098195968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257485 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257469.363434:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257469.363439:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734257469.363442:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734257469.364202:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257469.364209:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608280 00000400:00000200:0.0:1734257469.364215:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x931 [1] + 0 00000400:00000200:0.0:1734257469.364225:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257469.364228:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257469.364233:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098196096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257479 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257469.364369:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257469.364374:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257469.364375:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257469.364380:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098196096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257479 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257469.364386:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098196096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257479 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257469.364416:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257469.364420:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257469.364422:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257474.365903:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257474.365928:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257474.365983:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257474.365991:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257474.366024:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257474.366032:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257474.366039:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257474.366046:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098196224, portal 25 00000400:00000010:1.0:1734257474.366052:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734257474.366054:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098196224, offset 0 00000400:00000200:1.0:1734257474.366063:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257474.366076:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257474.366082:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257474.366086:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257474.366090:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257474.366092:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257474.366095:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [265:265:256:4294967295] 192.168.202.108@tcp LPNI seq info [264:264:8:4294967295] 00000400:00000200:1.0:1734257474.366103:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257474.366109:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257474.366113:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734257474.366119:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257474.366126:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257474.366130:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257474.366230:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257474.366236:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257474.366240:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257474.366242:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098196352, portal 10 00000400:00000010:3.0:1734257474.366246:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734257474.366248:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098196352, offset 0 00000400:00000200:3.0:1734257474.366252:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257474.366257:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257474.366259:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257474.366261:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257474.366263:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257474.366265:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257474.366266:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [266:266:255:4294967295] 192.168.202.108@tcp LPNI seq info [265:265:7:4294967295] 00000400:00000200:3.0:1734257474.366272:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257474.366276:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257474.366278:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257474.366281:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257474.366284:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257474.366286:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257474.366362:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257474.366365:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734257474.366370:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257474.366375:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257474.366379:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:0.0:1734257474.366380:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:0.0:1734257474.366387:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098196224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257490 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257474.366467:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257474.366469:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734257474.366471:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257474.366474:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257474.366476:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:0.0:1734257474.366478:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734257474.366481:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098196352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257484 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257474.374121:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257474.374140:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608380 00000400:00000200:0.0:1734257474.374149:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x941 [1] + 0 00000400:00000200:0.0:1734257474.374159:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257474.374163:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257474.374173:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098196352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257484 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257474.375083:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257474.375094:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608300 00000400:00000200:0.0:1734257474.375102:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x939 [1] + 224 00000400:00000200:0.0:1734257474.375121:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257474.375125:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257474.375133:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098196224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257490 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257474.375203:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257474.375208:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257474.375211:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257474.375216:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098196352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257484 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257474.375238:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098196352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257484 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257474.375264:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257474.375268:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257474.375274:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:1.0:1734257474.376588:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257474.376606:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257474.376608:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257474.376629:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098196224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257490 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257474.376652:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098196224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257490 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257474.376671:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257474.376676:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734257474.376681:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257479.371679:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257479.371700:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257479.372814:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257479.372825:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257479.372856:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257479.372862:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257479.372868:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257479.372874:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098196480, portal 25 00000400:00000010:1.0:1734257479.372878:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734257479.372879:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098196480, offset 0 00000400:00000200:1.0:1734257479.372887:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257479.372898:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257479.372902:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257479.372905:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257479.372908:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257479.372909:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257479.372912:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [267:267:256:4294967295] 192.168.202.108@tcp LPNI seq info [266:266:8:4294967295] 00000400:00000200:1.0:1734257479.372919:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257479.372924:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257479.372927:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734257479.372932:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257479.372938:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257479.372941:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257479.373456:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257479.373462:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257479.373465:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257479.373468:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098196608, portal 10 00000400:00000010:3.0:1734257479.373471:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734257479.373473:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098196608, offset 0 00000400:00000200:3.0:1734257479.373477:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257479.373482:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257479.373484:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257479.373487:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257479.373488:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257479.373490:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257479.373491:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [268:268:255:4294967295] 192.168.202.108@tcp LPNI seq info [267:267:7:4294967295] 00000400:00000200:3.0:1734257479.373497:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257479.373500:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257479.373502:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734257479.373506:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257479.373509:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257479.373511:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257479.374591:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257479.374596:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:1.0:1734257479.374601:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257479.374606:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257479.374610:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734257479.374622:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734257479.374629:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098196480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257495 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257479.374693:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257479.374695:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734257479.374698:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257479.374701:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257479.374703:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:1.0:1734257479.374704:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:1.0:1734257479.374707:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098196608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257489 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257479.377872:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257479.377888:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608400 00000400:00000200:0.0:1734257479.377905:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x949 [1] + 224 00000400:00000200:0.0:1734257479.377914:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257479.377917:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257479.377925:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098196480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257495 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257479.377958:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257479.377961:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608480 00000400:00000200:0.0:1734257479.377966:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x951 [1] + 0 00000400:00000200:0.0:1734257479.377974:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257479.377976:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257479.377979:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098196608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257489 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257479.378044:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257479.378049:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257479.378051:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257479.378057:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098196608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257489 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257479.378075:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098196608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257489 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257479.378103:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257479.378107:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257479.378111:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:1.0:1734257479.379061:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257479.379067:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257479.379068:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257479.379075:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098196480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257495 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257479.379082:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098196480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257495 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257479.379094:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257479.379097:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734257479.379098:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734257484.379710:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257484.379737:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734257484.379932:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257484.379939:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257484.380008:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257484.380019:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 02000000:00000010:2.0:1734257484.380024:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257484.380030:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257484.381113:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000400:00000010:1.0:1734257484.381114:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:2.0:1734257484.381125:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098196864, portal 10 00000100:00000200:1.0:1734257484.381129:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098196736, portal 25 00000400:00000010:2.0:1734257484.381133:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734257484.381135:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098196864, offset 0 00000400:00000010:1.0:1734257484.381136:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734257484.381138:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098196736, offset 0 00000400:00000200:2.0:1734257484.381146:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257484.381156:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257484.381162:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257484.381168:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257484.381172:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257484.381175:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257484.381177:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257484.381181:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [269:269:256:4294967295] 192.168.202.108@tcp LPNI seq info [268:268:8:4294967295] 00000400:00000200:2.0:1734257484.381190:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257484.381196:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257484.381200:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734257484.381200:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734257484.381205:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:2.0:1734257484.381206:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734257484.381208:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257484.381211:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734257484.381215:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257484.381219:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734257484.381225:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257484.381228:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [270:270:255:4294967295] 192.168.202.108@tcp LPNI seq info [269:269:7:4294967295] 00000400:00000200:1.0:1734257484.381237:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257484.381242:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257484.381247:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734257484.381252:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257484.381260:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257484.381263:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257484.381346:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257484.381350:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257484.381357:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257484.381361:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257484.381366:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734257484.381367:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734257484.381377:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098196864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257494 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257484.381650:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257484.381653:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734257484.381656:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257484.381659:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257484.381662:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:0.0:1734257484.381663:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734257484.381678:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098196736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257500 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257484.391353:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257484.391377:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608580 00000400:00000200:0.0:1734257484.391388:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x959 [1] + 0 00000400:00000200:0.0:1734257484.391402:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257484.391406:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257484.391419:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098196864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257494 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257484.392742:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257484.392750:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608500 00000400:00000200:0.0:1734257484.392756:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x95d [1] + 224 00000400:00000200:0.0:1734257484.392779:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257484.392782:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257484.392787:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098196736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257500 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257484.392968:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257484.392973:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257484.392975:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257484.392982:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098196864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257494 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257484.392988:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098196864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257494 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257484.393041:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257484.393050:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257484.393056:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:1.0:1734257484.394321:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257484.394329:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257484.394330:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257484.394338:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098196736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257500 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257484.394345:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098196736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257500 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257484.394360:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257484.394363:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734257484.394367:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734257489.387678:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257489.387697:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734257489.387750:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257489.387757:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734257489.387843:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257489.387849:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257489.387854:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257489.387860:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098196992, portal 25 00000400:00000010:1.0:1734257489.387864:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734257489.387866:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098196992, offset 0 00000400:00000200:1.0:1734257489.387873:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257489.387883:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257489.387888:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257489.387891:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257489.387894:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257489.387896:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257489.387898:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [271:271:256:4294967295] 192.168.202.108@tcp LPNI seq info [270:270:8:4294967295] 00000400:00000200:1.0:1734257489.387916:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257489.387920:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257489.387923:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734257489.387929:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257489.387936:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257489.387939:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257489.388108:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 02000000:00000010:2.0:1734257489.388305:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257489.388310:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257489.388313:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257489.388316:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098197120, portal 10 00000400:00000010:2.0:1734257489.388319:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734257489.388320:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098197120, offset 0 00000400:00000200:2.0:1734257489.388325:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257489.388330:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257489.388332:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257489.388334:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257489.388336:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257489.388338:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257489.388340:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [272:272:255:4294967295] 192.168.202.108@tcp LPNI seq info [271:271:7:4294967295] 00000400:00000200:2.0:1734257489.388345:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257489.388349:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257489.388351:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257489.388354:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257489.388357:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257489.388360:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000010:0.0:1734257489.388391:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734257489.388395:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257489.388400:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257489.388403:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734257489.388404:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734257489.388409:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098196992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257505 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257489.388445:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257489.388452:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257489.388454:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257489.388457:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257489.388459:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734257489.388460:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734257489.388463:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098197120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257499 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257489.393868:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257489.393888:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608600 00000400:00000200:0.0:1734257489.393898:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x969 [1] + 224 00000400:00000200:0.0:1734257489.393909:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257489.393912:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257489.393923:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098196992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257505 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257489.394425:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257489.394430:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608680 00000400:00000200:0.0:1734257489.394435:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x971 [1] + 0 00000400:00000200:0.0:1734257489.394453:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257489.394456:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257489.394461:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098197120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257499 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257489.394552:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257489.394557:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257489.394560:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257489.394565:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098196992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257505 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257489.394617:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098196992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257505 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257489.394641:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257489.394647:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734257489.394650:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:2.0:1734257489.396399:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257489.396409:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257489.396410:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257489.396418:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098197120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257499 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257489.396426:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098197120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257499 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257489.396464:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257489.396478:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257489.396482:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734257494.395664:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257494.395682:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257494.395737:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257494.395744:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734257494.395843:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734257494.395850:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257494.395855:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257494.395861:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098197248, portal 25 00000400:00000010:2.0:1734257494.395865:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734257494.395866:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098197248, offset 0 00000400:00000200:2.0:1734257494.395873:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257494.395883:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257494.395887:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257494.395890:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257494.395893:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257494.395894:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257494.395897:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [273:273:256:4294967295] 192.168.202.108@tcp LPNI seq info [272:272:8:4294967295] 00000400:00000200:2.0:1734257494.395905:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257494.395909:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257494.395912:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257494.395917:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257494.395923:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257494.395926:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257494.396041:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257494.396044:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257494.396048:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257494.396052:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257494.396055:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734257494.396065:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734257494.396071:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098197248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257510 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257494.396185:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257494.396190:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257494.396193:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257494.396195:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098197376, portal 10 00000400:00000010:3.0:1734257494.396199:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734257494.396200:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098197376, offset 0 00000400:00000200:3.0:1734257494.396204:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257494.396208:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257494.396210:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257494.396212:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257494.396213:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257494.396215:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257494.396217:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [274:274:256:4294967295] 192.168.202.108@tcp LPNI seq info [273:273:8:4294967295] 00000400:00000200:3.0:1734257494.396222:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257494.396226:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257494.396228:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734257494.396231:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257494.396234:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257494.396236:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257494.396278:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257494.396280:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734257494.396282:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257494.396285:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257494.396287:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:0.0:1734257494.396288:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734257494.396292:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098197376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257504 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257494.398527:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257494.398542:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608700 00000400:00000200:0.0:1734257494.398548:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x979 [1] + 224 00000400:00000200:0.0:1734257494.398565:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257494.398590:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257494.398598:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098197248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257510 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257494.398774:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257494.398779:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257494.398780:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257494.398785:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098197248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257510 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257494.398790:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098197248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257510 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257494.398821:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734257494.398824:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:2.0:1734257494.398827:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734257494.399765:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257494.399773:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608780 00000400:00000200:0.0:1734257494.399779:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x981 [1] + 0 00000400:00000200:0.0:1734257494.399790:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257494.399793:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257494.399798:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098197376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257504 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257494.399855:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257494.399859:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257494.399860:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257494.399865:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098197376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257504 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257494.399879:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098197376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257504 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257494.399895:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257494.399898:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257494.399900:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734257499.405551:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257499.405590:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257499.405658:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257499.405665:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734257499.405799:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257499.405806:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257499.405812:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257499.405819:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098197632, portal 10 00000400:00000010:3.0:1734257499.405824:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734257499.405827:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098197632, offset 0 00000400:00000200:3.0:1734257499.405835:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257499.405847:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257499.405853:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257499.405857:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257499.405861:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257499.405863:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257499.405865:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [275:275:256:4294967295] 192.168.202.108@tcp LPNI seq info [274:274:8:4294967295] 02000000:00000010:1.0:1734257499.405866:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257499.405871:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000200:3.0:1734257499.405873:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734257499.405875:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257499.405877:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098197504, portal 25 00000800:00000200:3.0:1734257499.405879:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734257499.405880:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734257499.405882:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098197504, offset 0 00000800:00000010:3.0:1734257499.405883:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000400:00000200:1.0:1734257499.405886:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734257499.405888:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734257499.405891:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257499.405893:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257499.405895:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734257499.405896:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734257499.405897:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257499.405899:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734257499.405900:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734257499.405901:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [276:276:255:4294967295] 192.168.202.108@tcp LPNI seq info [275:275:7:4294967295] 00000400:00000200:1.0:1734257499.405908:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257499.405917:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257499.405920:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734257499.405923:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257499.405926:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257499.405928:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257499.405988:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257499.405990:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734257499.405995:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257499.405998:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257499.406001:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734257499.406003:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734257499.406010:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098197632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257509 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257499.406342:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257499.406345:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734257499.406347:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257499.406350:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257499.406352:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:0.0:1734257499.406354:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:0.0:1734257499.406358:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098197504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257515 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257499.410494:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257499.410516:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608880 00000400:00000200:0.0:1734257499.410525:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x989 [1] + 0 00000400:00000200:0.0:1734257499.410540:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257499.410545:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257499.410556:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098197632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257509 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257499.410640:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257499.410646:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608800 00000400:00000200:0.0:1734257499.410652:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x991 [1] + 224 00000400:00000200:0.0:1734257499.410675:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257499.410679:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257499.410685:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098197504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257499.410889:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257499.410896:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257499.410898:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257499.410904:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098197632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257509 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257499.410923:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098197632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257509 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257499.410955:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734257499.410960:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734257499.410965:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:1.0:1734257499.412534:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257499.412544:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257499.412546:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257499.412557:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098197504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257515 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257499.412565:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098197504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257515 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257499.412689:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257499.412695:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734257499.412700:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734257504.412169:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257504.412193:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 02000000:00000010:3.0:1734257504.412980:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257504.412989:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257504.412995:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257504.413001:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098197760, portal 25 00000400:00000010:3.0:1734257504.413005:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734257504.413007:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098197760, offset 0 00000400:00000200:3.0:1734257504.413015:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257504.413028:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257504.413033:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257504.413036:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257504.413039:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257504.413041:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257504.413043:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [277:277:256:4294967295] 192.168.202.108@tcp LPNI seq info [276:276:8:4294967295] 00000400:00000200:3.0:1734257504.413053:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257504.413059:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257504.413062:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734257504.413068:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257504.413075:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257504.413078:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257504.413397:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257504.413400:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:1.0:1734257504.413404:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257504.413407:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257504.413412:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:1.0:1734257504.413414:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:1.0:1734257504.413420:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098197760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257520 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257504.413856:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257504.413867:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257504.414013:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734257504.414018:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16cb8. 00000400:00000010:3.0:1734257504.414026:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734257504.414032:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098197888, portal 10 00000400:00000010:3.0:1734257504.414037:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734257504.414053:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098197888, offset 0 00000400:00000200:3.0:1734257504.414057:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257504.414061:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257504.414063:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257504.414065:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257504.414067:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257504.414069:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257504.414071:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [278:278:256:4294967295] 192.168.202.108@tcp LPNI seq info [277:277:8:4294967295] 00000400:00000200:3.0:1734257504.414077:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257504.414080:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257504.414082:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734257504.414085:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257504.414090:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257504.414092:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257504.414185:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257504.414188:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734257504.414190:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257504.414193:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257504.414195:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734257504.414197:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734257504.414200:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098197888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257514 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257504.416494:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257504.416514:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608900 00000400:00000200:0.0:1734257504.416523:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x999 [1] + 224 00000400:00000200:0.0:1734257504.416534:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257504.416537:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257504.416548:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098197760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257520 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257504.417612:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257504.417624:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608980 00000400:00000200:0.0:1734257504.417632:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x9a1 [1] + 0 00000400:00000200:0.0:1734257504.417658:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257504.417661:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257504.417671:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098197888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257514 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257504.417824:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16cb8. 00000400:00000200:2.0:1734257504.417830:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:2.0:1734257504.417832:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:2.0:1734257504.417837:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098197888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257514 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257504.417843:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098197888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257514 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257504.417870:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:2.0:1734257504.417875:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257504.417880:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:3.0:1734257504.417948:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257504.417952:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257504.417953:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257504.417960:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098197760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257520 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257504.417967:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098197760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257520 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257504.417981:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257504.417986:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734257504.417988:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734257509.419744:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257509.419776:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257509.419901:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257509.419910:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257509.420081:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257509.420092:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257509.420103:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257509.420112:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098198016, portal 25 00000400:00000010:1.0:1734257509.420120:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:1.0:1734257509.420124:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098198016, offset 0 00000400:00000200:1.0:1734257509.420136:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257509.420158:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257509.420183:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257509.420191:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257509.420197:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257509.420199:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257509.420202:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [279:279:256:4294967295] 192.168.202.108@tcp LPNI seq info [278:278:8:4294967295] 00000400:00000200:1.0:1734257509.420213:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257509.420220:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257509.420227:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734257509.420236:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257509.420248:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257509.420253:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257509.421773:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257509.421783:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734257509.421791:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257509.421801:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257509.421810:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:0.0:1734257509.421812:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:0.0:1734257509.421823:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098198016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257525 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257509.422691:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257509.422700:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257509.422706:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257509.422712:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098198144, portal 10 00000400:00000010:2.0:1734257509.422717:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734257509.422719:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098198144, offset 0 00000400:00000200:2.0:1734257509.422724:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257509.422736:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257509.422742:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257509.422745:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257509.422749:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257509.422751:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257509.422754:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [280:280:256:4294967295] 192.168.202.108@tcp LPNI seq info [279:279:8:4294967295] 00000400:00000200:2.0:1734257509.422764:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257509.422770:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257509.422775:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257509.422803:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257509.422815:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257509.422819:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257509.423672:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257509.423677:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257509.423683:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257509.423689:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257509.423693:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734257509.423695:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734257509.423704:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098198144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257519 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257509.429393:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257509.429409:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608a00 00000400:00000200:0.0:1734257509.429416:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x9a9 [1] + 224 00000400:00000200:0.0:1734257509.429434:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257509.429437:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257509.429445:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098198016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257525 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257509.429716:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257509.429723:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257509.429725:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257509.429731:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098198016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257525 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257509.429738:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098198016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257525 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257509.429762:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734257509.429769:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734257509.429774:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734257509.435398:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257509.435426:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608a80 00000400:00000200:0.0:1734257509.435442:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x9b1 [1] + 0 00000400:00000200:0.0:1734257509.435478:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257509.435486:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257509.435517:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098198144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257519 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257509.440666:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257509.440679:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257509.440682:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257509.440695:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098198144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257519 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257509.440706:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098198144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257519 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257509.440738:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257509.440748:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257509.440752:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257514.427691:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257514.427710:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257514.427772:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257514.427779:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734257514.427793:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257514.427801:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257514.427808:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257514.427813:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098198272, portal 25 00000400:00000010:1.0:1734257514.427817:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734257514.427819:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098198272, offset 0 00000400:00000200:1.0:1734257514.427827:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257514.427839:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257514.427844:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257514.427858:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257514.427861:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257514.427863:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257514.427866:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [281:281:256:4294967295] 192.168.202.108@tcp LPNI seq info [280:280:8:4294967295] 00000400:00000200:1.0:1734257514.427874:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257514.427880:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257514.427883:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734257514.427889:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257514.427896:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257514.427900:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257514.428007:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257514.428009:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734257514.428014:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257514.428018:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257514.428021:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734257514.428023:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734257514.428029:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098198272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257530 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257514.429250:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257514.429260:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257514.429297:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257514.429303:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098198400, portal 10 00000400:00000010:3.0:1734257514.429309:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734257514.429310:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098198400, offset 0 00000400:00000200:3.0:1734257514.429317:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257514.429341:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257514.429345:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257514.429348:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257514.429350:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257514.429352:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257514.429354:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [282:282:256:4294967295] 192.168.202.108@tcp LPNI seq info [281:281:8:4294967295] 00000400:00000200:3.0:1734257514.429361:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257514.429366:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257514.429369:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734257514.429374:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257514.429380:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257514.429384:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257514.429493:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257514.429496:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734257514.429500:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257514.429504:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257514.429507:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734257514.429508:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734257514.429514:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098198400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257524 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257514.432331:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257514.432347:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608b00 00000400:00000200:0.0:1734257514.432355:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x9b9 [1] + 224 00000400:00000200:0.0:1734257514.432365:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257514.432368:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257514.432762:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098198272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257514.433639:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257514.433665:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608b80 00000400:00000200:0.0:1734257514.433674:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x9c1 [1] + 0 00000400:00000200:0.0:1734257514.433692:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257514.433695:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257514.433702:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098198400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257524 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257514.433808:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257514.433815:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257514.433817:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257514.433823:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098198272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257530 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257514.433831:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098198272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257530 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257514.433856:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734257514.433861:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734257514.433865:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:3.0:1734257514.434278:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257514.434282:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257514.434283:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257514.434288:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098198400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257524 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257514.434294:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098198400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257524 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257514.434313:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257514.434316:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734257514.434321:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:2.0:1734257519.436833:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734257519.436856:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734257519.437406:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734257519.437414:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734257519.438168:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257519.438177:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257519.438184:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257519.438192:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098198528, portal 25 00000400:00000010:1.0:1734257519.438195:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734257519.438197:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098198528, offset 0 00000400:00000200:1.0:1734257519.438206:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257519.438220:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257519.438249:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257519.438253:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257519.438256:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257519.438278:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257519.438282:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [283:283:256:4294967295] 192.168.202.108@tcp LPNI seq info [282:282:8:4294967295] 00000400:00000200:1.0:1734257519.438291:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257519.438296:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257519.438300:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734257519.438306:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257519.438314:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257519.438318:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257519.438386:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257519.438393:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257519.438396:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257519.438399:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098198656, portal 10 00000400:00000010:3.0:1734257519.438404:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734257519.438405:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098198656, offset 0 00000400:00000200:3.0:1734257519.438410:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257519.438415:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257519.438423:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257519.438425:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257519.438427:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257519.438429:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257519.438431:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [284:284:255:4294967295] 192.168.202.108@tcp LPNI seq info [283:283:7:4294967295] 00000400:00000200:3.0:1734257519.438436:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257519.438440:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257519.438444:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734257519.438446:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257519.438450:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257519.438452:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257519.438772:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257519.438775:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:1.0:1734257519.438778:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257519.438783:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257519.438786:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734257519.438788:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734257519.438795:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098198528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257535 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257519.439596:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257519.439600:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734257519.439604:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257519.439608:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257519.439611:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:1.0:1734257519.439613:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:1.0:1734257519.439618:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098198656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257529 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257519.442834:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257519.442854:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608c00 00000400:00000200:0.0:1734257519.442862:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x9c9 [1] + 224 00000400:00000200:0.0:1734257519.442874:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257519.442878:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257519.442887:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098198528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257535 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257519.444205:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257519.444215:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608c80 00000400:00000200:0.0:1734257519.444223:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x9d1 [1] + 0 00000400:00000200:0.0:1734257519.444257:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257519.444260:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257519.444268:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098198656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257529 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257519.444379:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257519.444384:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257519.444386:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257519.444391:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098198656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257529 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257519.444392:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257519.444397:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257519.444399:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:3.0:1734257519.444399:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098198656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257529 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257519.444405:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098198528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257535 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257519.444412:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098198528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257535 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257519.444428:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257519.444433:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734257519.444437:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 00000100:00000010:3.0:1734257519.444438:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 02000000:00000010:1.0:1734257519.444440:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:1.0:1734257519.444443:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:2.0:1734257524.443775:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734257524.443821:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734257524.443907:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734257524.443915:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257524.443980:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257524.443986:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257524.443993:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257524.444009:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098198912, portal 10 00000400:00000010:2.0:1734257524.444015:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734257524.444017:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098198912, offset 0 00000400:00000200:2.0:1734257524.444033:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734257524.444048:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000200:2.0:1734257524.444049:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257524.444054:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257524.444058:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:3.0:1734257524.444059:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257524.444066:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257524.444073:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098198784, portal 25 00000400:00000010:3.0:1734257524.444078:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734257524.444080:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098198784, offset 0 00000400:00000200:2.0:1734257524.444083:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257524.444085:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257524.444088:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257524.444094:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [285:285:256:4294967295] 192.168.202.108@tcp LPNI seq info [284:284:8:4294967295] 00000400:00000200:2.0:1734257524.444107:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257524.444113:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257524.444117:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257524.444129:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257524.444136:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257524.444140:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257524.444656:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257524.444673:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257524.444690:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257524.444705:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257524.444709:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734257524.444722:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734257524.444737:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098198912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257534 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734257524.444838:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257524.444842:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257524.444853:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257524.444856:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257524.444858:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257524.444861:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [286:286:255:4294967295] 192.168.202.108@tcp LPNI seq info [285:285:7:4294967295] 00000400:00000200:3.0:1734257524.444869:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257524.444874:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257524.444877:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734257524.444882:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257524.444889:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257524.444892:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257524.445050:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257524.445052:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734257524.445055:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257524.445058:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257524.445060:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734257524.445061:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734257524.445065:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098198784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257540 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257524.446220:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257524.446232:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608d80 00000400:00000200:0.0:1734257524.446239:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x9d9 [1] + 0 00000400:00000200:0.0:1734257524.446252:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257524.446255:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257524.446260:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098198912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257534 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257524.447087:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257524.447093:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257524.447102:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257524.447109:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098198912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257534 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257524.447115:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098198912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257534 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257524.447155:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257524.447172:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734257524.447175:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000400:00000200:0.0:1734257524.448704:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257524.448717:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608d00 00000400:00000200:0.0:1734257524.448725:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x9e1 [1] + 224 00000400:00000200:0.0:1734257524.448743:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257524.448747:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257524.448756:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098198784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257540 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257524.449391:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257524.449396:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257524.449397:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257524.449402:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098198784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257540 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257524.449408:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098198784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257540 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257524.449426:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257524.449431:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734257524.449436:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734257529.451688:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734257529.451707:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734257529.452196:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734257529.452203:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257529.452236:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257529.452242:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257529.452248:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257529.452254:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098199168, portal 10 00000400:00000010:2.0:1734257529.452258:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734257529.452260:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098199168, offset 0 00000400:00000200:2.0:1734257529.452268:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734257529.453105:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257529.453115:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257529.453121:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257529.453126:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098199040, portal 25 00000400:00000010:3.0:1734257529.453129:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734257529.453131:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098199040, offset 0 00000400:00000200:3.0:1734257529.453137:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257529.453194:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257529.453200:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257529.453204:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257529.453206:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257529.453208:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257529.453211:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [287:287:256:4294967295] 192.168.202.108@tcp LPNI seq info [286:286:8:4294967295] 00000400:00000200:2.0:1734257529.453219:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257529.453225:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257529.453228:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257529.453233:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257529.453239:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257529.453243:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734257529.453341:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257529.453345:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257529.453348:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257529.453351:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257529.453362:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257529.453365:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [288:288:255:4294967295] 192.168.202.108@tcp LPNI seq info [287:287:7:4294967295] 00000400:00000200:3.0:1734257529.453372:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257529.453376:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257529.453379:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734257529.453383:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257529.453389:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257529.453392:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257529.453422:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257529.453426:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257529.453430:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257529.453434:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257529.453438:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734257529.453440:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734257529.453447:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098199168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257539 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257529.453505:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257529.453507:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734257529.453509:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257529.453512:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257529.453514:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734257529.453515:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734257529.453519:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098199040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257545 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257529.460764:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257529.460783:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608e00 00000400:00000200:0.0:1734257529.460792:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x9f1 [1] + 224 00000400:00000200:0.0:1734257529.460804:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257529.460807:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257529.460817:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098199040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257545 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257529.461227:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257529.461233:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608e80 00000400:00000200:0.0:1734257529.461238:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x9e9 [1] + 0 00000400:00000200:0.0:1734257529.461253:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257529.461257:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257529.461261:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098199168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257539 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257529.461361:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257529.461366:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257529.461368:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257529.461373:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098199040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257545 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257529.461380:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098199040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257545 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257529.461404:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257529.461409:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734257529.461414:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000400:00000010:2.0:1734257529.461563:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257529.461595:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257529.461596:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257529.461601:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098199168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257539 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257529.461606:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098199168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257539 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257529.461621:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257529.461625:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734257529.461627:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734257534.459702:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734257534.459727:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734257534.459778:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734257534.459786:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257534.459856:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734257534.459864:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257534.459876:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257534.459885:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098199296, portal 25 00000400:00000010:2.0:1734257534.459904:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734257534.459907:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098199296, offset 0 00000400:00000200:2.0:1734257534.459916:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257534.459936:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257534.459942:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257534.459947:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257534.459950:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257534.459953:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257534.459956:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [289:289:256:4294967295] 192.168.202.108@tcp LPNI seq info [288:288:8:4294967295] 00000400:00000200:2.0:1734257534.459965:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257534.459970:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257534.459974:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257534.459980:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257534.459989:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257534.459993:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257534.460068:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257534.460073:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257534.460076:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257534.460079:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098199424, portal 10 00000400:00000010:3.0:1734257534.460084:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734257534.460085:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098199424, offset 0 00000400:00000200:3.0:1734257534.460089:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257534.460094:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257534.460097:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257534.460099:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257534.460100:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257534.460102:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257534.460135:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [290:290:255:4294967295] 192.168.202.108@tcp LPNI seq info [289:289:7:4294967295] 00000400:00000200:3.0:1734257534.460146:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257534.460150:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257534.460152:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734257534.460155:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257534.460158:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257534.460160:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257534.460225:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257534.460228:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257534.460232:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257534.460236:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257534.460239:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734257534.460241:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734257534.460248:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098199296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257550 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257534.460298:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257534.460300:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734257534.460302:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257534.460305:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257534.460307:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734257534.460308:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734257534.460312:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098199424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257544 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257534.463183:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257534.463208:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c608f00 00000400:00000200:0.0:1734257534.463220:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x9f9 [1] + 224 00000400:00000200:0.0:1734257534.463236:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257534.463241:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257534.463254:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098199296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257550 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257534.463374:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257534.463380:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c608f80 00000400:00000200:0.0:1734257534.463386:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa01 [1] + 0 00000400:00000200:0.0:1734257534.463403:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257534.463406:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257534.463410:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098199424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257544 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257534.463785:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257534.463792:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257534.463794:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257534.463801:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098199424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257544 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257534.464397:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257534.464404:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257534.464407:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257534.464415:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098199296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257550 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257534.464424:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098199296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257550 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257534.464461:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734257534.464470:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734257534.464476:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000200:3.0:1734257534.465335:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098199424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257544 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257534.465364:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257534.465369:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734257534.465374:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000100:00000010:2.0:1734257539.467811:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734257539.467835:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734257539.467892:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734257539.467898:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734257539.468012:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257539.468020:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257539.468026:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257539.468032:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098199552, portal 25 00000400:00000010:1.0:1734257539.468036:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734257539.468037:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098199552, offset 0 00000400:00000200:1.0:1734257539.468045:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257539.468056:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257539.468061:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257539.468091:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257539.468093:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257539.468095:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257539.468097:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [291:291:256:4294967295] 192.168.202.108@tcp LPNI seq info [290:290:8:4294967295] 00000400:00000200:1.0:1734257539.468105:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257539.468109:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257539.468113:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734257539.468118:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257539.468126:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257539.468129:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257539.468235:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257539.468238:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:1.0:1734257539.468240:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257539.468244:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257539.468247:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734257539.468248:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734257539.468254:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098199552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257555 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257539.468312:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257539.468317:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257539.468320:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257539.468323:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098199680, portal 10 00000400:00000010:3.0:1734257539.468327:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734257539.468329:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098199680, offset 0 00000400:00000200:3.0:1734257539.468333:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257539.468337:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257539.468339:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257539.468341:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257539.468343:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257539.468345:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257539.468347:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [292:292:256:4294967295] 192.168.202.108@tcp LPNI seq info [291:291:8:4294967295] 00000400:00000200:3.0:1734257539.468352:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257539.468360:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257539.468362:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734257539.468365:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257539.468369:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257539.468371:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257539.468447:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257539.468453:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734257539.468458:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257539.468464:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257539.468469:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734257539.468471:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734257539.468478:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098199680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257549 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257539.473622:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257539.473639:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609000 00000400:00000200:0.0:1734257539.473646:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xa09 [1] + 224 00000400:00000200:0.0:1734257539.473657:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257539.473659:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257539.473669:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098199552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257555 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257539.473702:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257539.473706:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609080 00000400:00000200:0.0:1734257539.473709:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa11 [1] + 0 00000400:00000200:0.0:1734257539.473721:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257539.473724:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257539.473728:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098199680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257549 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257539.474024:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257539.474029:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257539.474031:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257539.474036:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098199680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257549 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257539.474041:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098199680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257549 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257539.474078:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257539.474082:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734257539.474087:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000400:00000010:1.0:1734257539.476491:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257539.476501:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257539.476503:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257539.476514:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098199552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257555 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257539.476524:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098199552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257555 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257539.476544:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734257539.476548:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:1.0:1734257539.476552:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734257544.476518:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734257544.476550:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734257544.476631:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734257544.476640:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734257544.476695:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 02000000:00000010:2.0:1734257544.476697:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257544.476707:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734257544.476707:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:2.0:1734257544.476716:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000400:00000010:3.0:1734257544.476716:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257544.476725:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098199808, portal 25 00000400:00000010:3.0:1734257544.476732:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:2.0:1734257544.476775:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098199936, portal 10 00000400:00000010:2.0:1734257544.476784:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734257544.476787:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098199936, offset 0 00000400:00000200:2.0:1734257544.476798:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257544.476817:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257544.476823:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257544.476827:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257544.476830:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257544.476832:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257544.476835:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [293:293:256:4294967295] 192.168.202.108@tcp LPNI seq info [292:292:8:4294967295] 00000400:00000200:2.0:1734257544.476843:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:3.0:1734257544.476847:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098199808, offset 0 00000800:00000200:2.0:1734257544.476848:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257544.476851:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734257544.476855:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734257544.476857:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257544.476865:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734257544.476866:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734257544.476869:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257544.476873:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257544.476875:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257544.476877:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257544.476879:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [294:294:255:4294967295] 192.168.202.108@tcp LPNI seq info [293:293:7:4294967295] 00000400:00000200:3.0:1734257544.476887:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257544.476892:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257544.476906:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257544.476912:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257544.476919:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257544.476923:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257544.478408:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257544.478416:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734257544.478424:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257544.478431:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257544.478437:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734257544.478440:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734257544.478452:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098199808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257560 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257544.479931:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257544.480298:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257544.480303:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257544.480308:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257544.480315:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257544.480319:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734257544.480321:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734257544.480336:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098199936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257554 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257544.481355:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257544.481372:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609100 00000400:00000200:0.0:1734257544.481382:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xa19 [1] + 224 00000400:00000200:0.0:1734257544.481400:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257544.481404:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257544.481411:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098199808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257560 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257544.481973:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257544.481979:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257544.481980:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257544.481986:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098199808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257560 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257544.481993:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098199808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257560 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257544.482015:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257544.482032:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734257544.482037:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000400:00000200:0.0:1734257544.486151:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257544.486172:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609180 00000400:00000200:0.0:1734257544.486181:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa1d [1] + 0 00000400:00000200:0.0:1734257544.486203:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257544.486208:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257544.486218:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098199936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257554 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257544.486393:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257544.486399:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257544.486401:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257544.486406:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098199936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257554 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257544.486413:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098199936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257554 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257544.486441:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257544.486453:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734257544.486456:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734257549.483620:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734257549.483644:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734257549.486288:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734257549.486312:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257549.486373:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257549.486380:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257549.486388:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257549.486396:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098200192, portal 10 00000400:00000010:2.0:1734257549.486403:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734257549.486405:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098200192, offset 0 00000400:00000200:2.0:1734257549.486416:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257549.486431:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257549.486437:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257549.486441:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257549.486444:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257549.486446:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257549.486449:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [295:295:256:4294967295] 192.168.202.108@tcp LPNI seq info [294:294:8:4294967295] 00000400:00000200:2.0:1734257549.486458:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257549.486464:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257549.486470:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257549.486476:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257549.486485:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257549.486489:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734257549.486623:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257549.486628:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257549.486632:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257549.486634:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098200064, portal 25 00000400:00000010:3.0:1734257549.486637:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734257549.486638:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098200064, offset 0 00000400:00000200:3.0:1734257549.486642:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257549.486646:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257549.486649:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257549.486651:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257549.486653:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257549.486654:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257549.486656:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [296:296:255:4294967295] 192.168.202.108@tcp LPNI seq info [295:295:7:4294967295] 00000400:00000200:3.0:1734257549.486661:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257549.486665:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257549.486667:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734257549.486683:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257549.486686:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257549.486688:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257549.487241:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257549.487246:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257549.487252:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257549.487257:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257549.487261:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734257549.487263:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734257549.487272:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098200192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257559 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257549.488219:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257549.488223:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734257549.488227:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257549.488231:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257549.488236:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:0.0:1734257549.488237:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:0.0:1734257549.488253:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098200064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257565 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257549.494702:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257549.494726:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609280 00000400:00000200:0.0:1734257549.494736:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa29 [1] + 0 00000400:00000200:0.0:1734257549.494748:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257549.494751:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257549.494761:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098200192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257559 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257549.495339:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257549.495348:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609200 00000400:00000200:0.0:1734257549.495354:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xa31 [1] + 224 00000400:00000200:0.0:1734257549.495374:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257549.495381:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257549.495388:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098200064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257549.495417:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257549.495424:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257549.495426:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257549.495433:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098200192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257559 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257549.495439:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098200192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257559 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257549.495480:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257549.495487:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734257549.495491:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000400:00000010:3.0:1734257549.495518:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257549.495522:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257549.495523:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257549.495528:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098200064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257565 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257549.495534:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098200064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257565 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257549.495545:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257549.495548:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734257549.495550:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734257554.491683:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734257554.491702:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 02000000:00000010:1.0:1734257554.492322:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734257554.492328:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257554.492333:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257554.492339:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098200320, portal 25 00000400:00000010:1.0:1734257554.492342:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734257554.492343:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098200320, offset 0 00000400:00000200:1.0:1734257554.492350:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257554.492360:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257554.492365:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257554.492368:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257554.492371:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257554.492372:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257554.492375:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [297:297:256:4294967295] 192.168.202.108@tcp LPNI seq info [296:296:8:4294967295] 00000400:00000200:1.0:1734257554.492382:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257554.492386:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257554.492389:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734257554.492394:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257554.492400:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257554.492403:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:2.0:1734257554.492674:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734257554.492681:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734257554.492990:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257554.492994:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257554.492997:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257554.492999:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098200448, portal 10 00000400:00000010:3.0:1734257554.493003:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734257554.493004:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098200448, offset 0 00000400:00000200:3.0:1734257554.493008:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257554.493013:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257554.493015:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257554.493017:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257554.493019:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257554.493020:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257554.493022:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [298:298:255:4294967295] 192.168.202.108@tcp LPNI seq info [297:297:7:4294967295] 00000800:00000200:0.0:1734257554.493690:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257554.493693:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734257554.493697:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257554.493700:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257554.493704:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:0.0:1734257554.493705:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734257554.493711:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098200320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257570 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734257554.493756:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257554.493760:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257554.493763:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734257554.493766:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257554.493777:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257554.493779:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257554.493839:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257554.493841:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734257554.493843:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257554.493846:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257554.493848:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734257554.493849:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734257554.493857:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098200448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257564 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257554.497649:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257554.497665:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609380 00000400:00000200:0.0:1734257554.497671:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa41 [1] + 0 00000400:00000200:0.0:1734257554.497681:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257554.497685:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257554.497694:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098200448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257564 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257554.498077:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257554.498082:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609300 00000400:00000200:0.0:1734257554.498086:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xa39 [1] + 224 00000400:00000200:0.0:1734257554.498097:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257554.498100:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257554.498104:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098200320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257554.498164:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257554.498168:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257554.498170:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257554.498174:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098200448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257564 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257554.498179:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098200448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257564 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:3.0:1734257554.498195:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 00000400:00000010:1.0:1734257554.498986:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257554.498991:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257554.498992:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257554.498997:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098200320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257570 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257554.499002:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098200320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257570 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257554.499015:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734257554.499019:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:1.0:1734257554.499023:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 02000000:00000010:3.0:1734257554.502613:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257554.502623:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734257554.502628:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:2.0:1734257559.499709:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734257559.499728:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734257559.499788:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734257559.499796:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734257559.499874:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257559.499882:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257559.499890:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 02000000:00000010:0.0:1734257559.499893:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 00000100:00000200:3.0:1734257559.499897:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098200704, portal 10 00000400:00000010:0.0:1734257559.499898:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50790. 00000400:00000010:0.0:1734257559.499901:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000400:00000010:3.0:1734257559.499903:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734257559.499904:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098200576, portal 25 00000400:00000010:0.0:1734257559.499918:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:3.0:1734257559.499935:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098200704, offset 0 00000100:00000200:0.0:1734257559.499988:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098200576, offset 0 00000400:00000200:0.0:1734257559.499998:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257559.500012:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257559.500017:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257559.500021:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257559.500025:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257559.500027:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257559.500030:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [299:299:256:4294967295] 192.168.202.108@tcp LPNI seq info [298:298:8:4294967295] 00000400:00000200:0.0:1734257559.500052:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257559.500058:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257559.500062:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734257559.500068:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257559.500076:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257559.500079:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257559.500383:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257559.500386:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734257559.500389:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257559.500394:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257559.500398:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:1.0:1734257559.500399:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:1.0:1734257559.500406:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098200576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257575 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734257559.500468:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257559.500474:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257559.500477:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257559.500479:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257559.500480:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257559.500482:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257559.500484:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [300:300:256:4294967295] 192.168.202.108@tcp LPNI seq info [299:299:8:4294967295] 00000400:00000200:3.0:1734257559.500489:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257559.500492:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257559.500495:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257559.500498:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257559.500508:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257559.500511:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257559.500855:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257559.500857:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734257559.500860:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257559.500864:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257559.500866:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734257559.500868:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734257559.500871:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098200704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257569 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257559.507644:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257559.507672:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609400 00000400:00000200:0.0:1734257559.507681:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xa4d [1] + 224 00000400:00000200:0.0:1734257559.507709:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257559.507714:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257559.507725:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098200576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257575 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257559.508071:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50790. 00000400:00000200:2.0:1734257559.508077:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:2.0:1734257559.508080:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:2.0:1734257559.508087:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098200576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257575 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257559.508094:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098200576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257575 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257559.508118:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 02000000:00000010:2.0:1734257559.508123:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734257559.508127:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000400:00000200:0.0:1734257559.508458:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257559.508466:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609480 00000400:00000200:0.0:1734257559.508473:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa49 [1] + 0 00000400:00000200:0.0:1734257559.508484:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257559.508486:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257559.508492:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098200704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257569 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257559.508600:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257559.508605:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257559.508607:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257559.508611:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098200704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257569 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257559.508619:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098200704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257569 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257559.508639:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257559.508642:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734257559.508646:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:2.0:1734257564.507683:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734257564.507706:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734257564.507760:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734257564.507766:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257564.507808:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257564.507814:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257564.507821:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257564.507827:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098200960, portal 10 00000400:00000010:2.0:1734257564.507833:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734257564.507847:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098200960, offset 0 00000400:00000200:2.0:1734257564.507857:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257564.507880:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257564.507885:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257564.507888:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257564.507891:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257564.507893:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257564.507896:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [301:301:256:4294967295] 192.168.202.108@tcp LPNI seq info [300:300:8:4294967295] 00000400:00000200:2.0:1734257564.507903:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257564.507909:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257564.507913:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257564.507918:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257564.507928:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257564.507932:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257564.508075:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257564.508078:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257564.508081:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257564.508085:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257564.508088:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734257564.508090:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734257564.508095:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098200960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257574 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257564.508158:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257564.508161:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257564.508165:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257564.508167:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098200832, portal 25 00000400:00000010:1.0:1734257564.508170:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734257564.508171:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098200832, offset 0 00000400:00000200:1.0:1734257564.508175:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257564.508179:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257564.508181:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257564.508183:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257564.508185:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257564.508187:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257564.508189:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [302:302:256:4294967295] 192.168.202.108@tcp LPNI seq info [301:301:8:4294967295] 00000400:00000200:1.0:1734257564.508195:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257564.508203:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257564.508206:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734257564.508208:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257564.508211:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257564.508214:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257564.508279:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257564.508281:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734257564.508283:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257564.508286:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257564.508288:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:0.0:1734257564.508289:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:0.0:1734257564.508292:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098200832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257580 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257564.513473:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257564.513503:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609500 00000400:00000200:0.0:1734257564.513513:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xa61 [1] + 224 00000400:00000200:0.0:1734257564.513539:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257564.513544:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257564.513556:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098200832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257580 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257564.513668:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257564.513681:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257564.513683:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257564.513695:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098200832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257580 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257564.513703:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098200832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257580 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257564.513726:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257564.513732:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:1.0:1734257564.513737:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000400:00000200:0.0:1734257564.515711:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257564.515729:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609580 00000400:00000200:0.0:1734257564.515739:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa59 [1] + 0 00000400:00000200:0.0:1734257564.515763:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257564.515766:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257564.515779:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098200960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257574 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257564.515937:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257564.515952:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257564.515955:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257564.515971:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098200960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257574 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257564.515979:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098200960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257574 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257564.516019:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257564.516027:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734257564.516032:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734257569.516296:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734257569.516316:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 02000000:00000010:1.0:1734257569.516423:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257569.516436:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257569.516445:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257569.516453:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098201088, portal 25 00000400:00000010:1.0:1734257569.516458:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734257569.516460:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098201088, offset 0 00000400:00000200:1.0:1734257569.516470:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257569.516486:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257569.516493:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257569.516496:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257569.516499:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257569.516502:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257569.516505:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [303:303:256:4294967295] 192.168.202.108@tcp LPNI seq info [302:302:8:4294967295] 00000400:00000200:1.0:1734257569.516513:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257569.516518:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257569.516534:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734257569.516540:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257569.516548:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257569.516553:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257569.516713:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257569.516716:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734257569.516721:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257569.516728:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257569.516732:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734257569.516734:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734257569.516741:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098201088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257585 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734257569.517154:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734257569.517162:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734257569.517218:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734257569.517223:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d507e8. 00000400:00000010:0.0:1734257569.517228:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000100:00000200:0.0:1734257569.517233:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098201216, portal 10 00000400:00000010:0.0:1734257569.517239:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734257569.517241:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098201216, offset 0 00000400:00000200:0.0:1734257569.517246:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257569.517257:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257569.517261:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257569.517264:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257569.517267:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257569.517269:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257569.517272:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [304:304:256:4294967295] 192.168.202.108@tcp LPNI seq info [303:303:8:4294967295] 00000400:00000200:0.0:1734257569.517279:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257569.517283:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257569.517286:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734257569.517290:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257569.517296:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257569.517300:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257569.517960:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257569.517963:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:2.0:1734257569.517974:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257569.517978:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257569.517981:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:2.0:1734257569.517983:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:2.0:1734257569.517988:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098201216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257579 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257569.520076:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257569.520094:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609600 00000400:00000200:0.0:1734257569.520112:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xa69 [1] + 224 00000400:00000200:0.0:1734257569.520130:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257569.520134:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257569.520143:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098201088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257585 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257569.520401:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257569.520406:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257569.520408:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257569.520412:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098201088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257585 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257569.520418:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098201088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257585 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257569.520437:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257569.520441:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:1.0:1734257569.520444:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000400:00000200:0.0:1734257569.520674:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257569.520680:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609680 00000400:00000200:0.0:1734257569.520684:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa71 [1] + 0 00000400:00000200:0.0:1734257569.520694:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257569.520697:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257569.520702:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098201216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257579 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257569.520918:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d507e8. 00000400:00000200:2.0:1734257569.520922:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:2.0:1734257569.520923:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:2.0:1734257569.520927:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098201216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257579 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257569.520933:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098201216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257579 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257569.520949:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257569.520952:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734257569.520955:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:2.0:1734257574.523684:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734257574.523703:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 02000000:00000010:1.0:1734257574.523826:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257574.523833:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257574.523839:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257574.523845:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098201344, portal 25 00000400:00000010:1.0:1734257574.523850:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734257574.523852:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098201344, offset 0 00000400:00000200:1.0:1734257574.523860:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257574.523870:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257574.523874:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257574.523877:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257574.523880:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257574.523881:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257574.523884:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [305:305:256:4294967295] 192.168.202.108@tcp LPNI seq info [304:304:8:4294967295] 00000400:00000200:1.0:1734257574.523892:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257574.523896:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257574.523899:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734257574.523914:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257574.523921:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257574.523924:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:2.0:1734257574.524163:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734257574.524169:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257574.524186:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257574.524189:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257574.524192:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257574.524194:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098201472, portal 10 00000400:00000010:2.0:1734257574.524197:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257574.524198:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098201472, offset 0 00000400:00000200:2.0:1734257574.524202:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257574.524207:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257574.524209:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257574.524211:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257574.524213:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257574.524219:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257574.524221:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [306:306:255:4294967295] 192.168.202.108@tcp LPNI seq info [305:305:7:4294967295] 00000400:00000200:2.0:1734257574.524227:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257574.524236:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257574.524238:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257574.524241:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257574.524244:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257574.524246:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257574.524955:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257574.524959:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:1.0:1734257574.524963:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257574.524968:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257574.524973:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:1.0:1734257574.524974:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734257574.524980:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098201344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257590 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257574.527353:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257574.527360:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734257574.527366:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257574.527373:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257574.527378:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:1.0:1734257574.527380:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:1.0:1734257574.527389:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098201472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257574.530109:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257574.530892:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609700 00000400:00000200:0.0:1734257574.530900:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xa79 [1] + 224 00000400:00000200:0.0:1734257574.530913:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257574.530917:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257574.530927:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098201344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257590 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257574.530964:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257574.530969:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609780 00000400:00000200:0.0:1734257574.530973:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa81 [1] + 0 00000400:00000200:0.0:1734257574.530987:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257574.530990:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257574.530994:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098201472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257584 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257574.531976:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257574.531984:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257574.531986:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257574.531993:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098201344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257590 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257574.532001:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098201344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257590 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257574.532025:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257574.532031:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734257574.532035:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:2.0:1734257574.532132:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257574.532136:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257574.532137:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257574.532143:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098201472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257574.532148:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098201472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257584 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257574.532166:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257574.532170:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734257574.532172:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734257579.531715:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734257579.531737:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734257579.531802:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734257579.531810:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257579.531841:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257579.531848:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 02000000:00000010:3.0:1734257579.531854:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:2.0:1734257579.531855:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257579.531862:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098201728, portal 10 00000400:00000010:3.0:1734257579.531864:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:2.0:1734257579.531867:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734257579.531869:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098201728, offset 0 00000400:00000010:3.0:1734257579.531871:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000200:2.0:1734257579.531878:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734257579.531884:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098201600, portal 25 00000400:00000010:3.0:1734257579.531889:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000400:00000200:2.0:1734257579.531891:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:3.0:1734257579.531891:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098201600, offset 0 00000400:00000200:3.0:1734257579.531898:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257579.531909:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257579.531913:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257579.531915:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257579.531917:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257579.531920:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [307:307:256:4294967295] 192.168.202.108@tcp LPNI seq info [306:306:8:4294967295] 00000400:00000200:2.0:1734257579.531928:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257579.531933:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257579.531936:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734257579.531937:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734257579.531941:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257579.531941:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257579.531944:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257579.531947:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257579.531949:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734257579.531950:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734257579.531951:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [308:308:255:4294967295] 192.168.202.108@tcp LPNI seq info [307:307:7:4294967295] 00000800:00000200:2.0:1734257579.531954:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734257579.531958:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257579.531963:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257579.531966:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734257579.531970:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257579.531976:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257579.531987:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257579.532074:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257579.532080:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257579.532086:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257579.532090:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257579.532093:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734257579.532095:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734257579.532102:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098201728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257589 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257579.532163:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257579.532165:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734257579.532167:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257579.532170:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257579.532172:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734257579.532173:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734257579.532176:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098201600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257595 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257579.536447:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257579.536464:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609880 00000400:00000200:0.0:1734257579.536472:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa89 [1] + 0 00000400:00000200:0.0:1734257579.536494:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257579.536498:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257579.536508:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098201728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257589 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257579.536723:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257579.536728:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257579.536730:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257579.536735:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098201728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257589 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257579.536742:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098201728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257589 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257579.536777:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257579.536784:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734257579.536787:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000400:00000200:0.0:1734257579.537080:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257579.537086:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609800 00000400:00000200:0.0:1734257579.537091:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xa91 [1] + 224 00000400:00000200:0.0:1734257579.537100:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257579.537102:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257579.537107:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098201600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257595 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257579.537182:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257579.537185:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257579.537186:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257579.537190:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098201600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257595 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257579.537196:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098201600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257595 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257579.537208:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257579.537211:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734257579.537213:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734257584.540002:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734257584.540023:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734257584.540556:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734257584.540565:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257584.540615:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257584.540623:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257584.540631:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257584.540638:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098201984, portal 10 00000400:00000010:2.0:1734257584.540643:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734257584.540656:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098201984, offset 0 00000400:00000200:2.0:1734257584.540664:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257584.540676:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257584.540681:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257584.540684:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257584.540687:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257584.540689:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257584.540692:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [309:309:256:4294967295] 192.168.202.108@tcp LPNI seq info [308:308:8:4294967295] 00000400:00000200:2.0:1734257584.540699:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257584.540704:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257584.540708:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257584.540723:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257584.540731:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257584.540734:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734257584.540858:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257584.540862:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257584.540866:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257584.540869:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098201856, portal 25 00000400:00000010:3.0:1734257584.540871:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734257584.540873:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098201856, offset 0 00000400:00000200:3.0:1734257584.540878:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257584.540883:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257584.540885:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257584.540888:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257584.540889:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257584.540891:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257584.540893:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [310:310:255:4294967295] 192.168.202.108@tcp LPNI seq info [309:309:7:4294967295] 00000400:00000200:3.0:1734257584.540898:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257584.540901:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257584.540903:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734257584.540906:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257584.540910:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257584.540912:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257584.541105:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257584.541112:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257584.541116:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257584.541120:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257584.541124:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734257584.541126:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734257584.541136:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098201984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257594 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257584.541613:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257584.541616:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734257584.541619:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257584.541623:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257584.541626:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734257584.541628:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734257584.541632:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098201856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257600 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257584.545223:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257584.545244:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609980 00000400:00000200:0.0:1734257584.545255:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xa99 [1] + 0 00000400:00000200:0.0:1734257584.545267:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257584.545271:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257584.545280:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098201984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257594 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257584.545325:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257584.545329:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609900 00000400:00000200:0.0:1734257584.545334:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xaa1 [1] + 224 00000400:00000200:0.0:1734257584.545353:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257584.545355:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257584.545361:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098201856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257600 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257584.546331:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257584.546337:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257584.546339:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257584.546346:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098201856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257600 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257584.546354:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098201856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257600 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257584.546378:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257584.546384:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734257584.546388:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000400:00000010:2.0:1734257584.546784:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257584.546788:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257584.546789:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257584.546795:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098201984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257594 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257584.546801:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098201984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257594 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257584.546818:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257584.546822:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734257584.546823:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:2.0:1734257589.547719:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734257589.547740:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734257589.547797:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734257589.547803:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257589.547832:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257589.547839:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 02000000:00000010:1.0:1734257589.547845:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257589.547851:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257589.547856:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:2.0:1734257589.547856:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257589.547862:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098202240, portal 10 00000400:00000010:2.0:1734257589.547866:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:1.0:1734257589.547869:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098202112, portal 25 00000100:00000200:2.0:1734257589.547869:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098202240, offset 0 00000400:00000010:1.0:1734257589.547874:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000400:00000200:2.0:1734257589.547877:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:1.0:1734257589.547887:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098202112, offset 0 00000400:00000200:2.0:1734257589.547887:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257589.547891:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257589.547894:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257589.547895:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257589.547897:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257589.547899:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257589.547902:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [311:311:256:4294967295] 192.168.202.108@tcp LPNI seq info [310:310:8:4294967295] 00000400:00000200:2.0:1734257589.547908:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257589.547913:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257589.547916:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734257589.547917:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734257589.547919:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257589.547922:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734257589.547923:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734257589.547924:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257589.547926:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257589.547928:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [312:312:255:4294967295] 192.168.202.108@tcp LPNI seq info [311:311:7:4294967295] 00000800:00000200:2.0:1734257589.547930:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257589.547933:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734257589.547936:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257589.547940:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257589.547944:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734257589.547948:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257589.547955:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257589.547958:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257589.548758:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257589.548768:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257589.548773:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257589.548778:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257589.548782:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734257589.548784:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734257589.548792:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098202240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257599 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257589.548866:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257589.548869:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734257589.548871:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257589.548874:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257589.548876:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734257589.548877:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734257589.548881:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098202112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257605 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257589.551027:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257589.551046:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609a00 00000400:00000200:0.0:1734257589.551054:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xaad [1] + 224 00000400:00000200:0.0:1734257589.551077:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257589.551080:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257589.551089:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098202112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257589.553421:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:0.0:1734257589.553422:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734257589.553430:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257589.553434:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000400:00000200:0.0:1734257589.553442:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609a80 00000100:00000200:1.0:1734257589.553449:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098202112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257605 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257589.553451:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xaa9 [1] + 0 00000100:00000200:1.0:1734257589.553460:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098202112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257605 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257589.553473:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257589.553477:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257589.553485:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098202240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257599 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257589.553490:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257589.553498:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:1.0:1734257589.553504:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000010:2.0:1734257589.553663:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257589.553668:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257589.553669:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257589.553683:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098202240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257599 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257589.553689:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098202240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257599 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257589.553709:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257589.553714:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734257589.553716:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:0.0:1734257594.556261:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257594.556286:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257594.556770:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257594.556776:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734257594.556963:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257594.556969:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257594.556974:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257594.556980:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098202368, portal 25 00000400:00000010:1.0:1734257594.556983:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734257594.556990:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098202368, offset 0 00000400:00000200:1.0:1734257594.556998:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257594.557007:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257594.557011:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257594.557014:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257594.557017:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257594.557019:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257594.557021:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [313:313:256:4294967295] 192.168.202.108@tcp LPNI seq info [312:312:8:4294967295] 00000400:00000200:1.0:1734257594.557028:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257594.557032:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257594.557035:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734257594.557039:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257594.557044:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257594.557047:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257594.557109:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257594.557112:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257594.557115:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257594.557121:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098202496, portal 10 00000400:00000010:2.0:1734257594.557124:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257594.557125:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098202496, offset 0 00000400:00000200:2.0:1734257594.557129:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257594.557132:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257594.557134:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257594.557136:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257594.557138:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257594.557139:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257594.557141:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [314:314:255:4294967295] 192.168.202.108@tcp LPNI seq info [313:313:7:4294967295] 00000400:00000200:2.0:1734257594.557146:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257594.557148:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257594.557150:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257594.557152:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257594.557155:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257594.557156:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257594.557534:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257594.557536:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734257594.557540:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257594.557543:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257594.557547:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:0.0:1734257594.557548:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:0.0:1734257594.557554:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098202368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257610 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257594.557617:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257594.557619:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257594.557621:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257594.557624:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257594.557625:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734257594.557626:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734257594.557629:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098202496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257604 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257594.563645:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257594.563662:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609b00 00000400:00000200:0.0:1734257594.563668:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xab9 [1] + 224 00000400:00000200:0.0:1734257594.563678:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257594.563681:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257594.563690:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098202368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257610 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257594.563722:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257594.563725:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609b80 00000400:00000200:0.0:1734257594.563729:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xac1 [1] + 0 00000400:00000200:0.0:1734257594.563740:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257594.563748:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257594.563751:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098202496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257604 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257594.563934:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257594.563938:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257594.563940:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257594.563945:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098202368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257610 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257594.563951:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098202368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257610 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257594.563968:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257594.563972:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734257594.563975:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:2.0:1734257594.564025:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257594.564028:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257594.564029:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257594.564032:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098202496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257604 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257594.564037:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098202496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257604 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257594.564050:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257594.564053:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257594.564055:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734257599.563899:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257599.563916:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257599.563970:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257599.563976:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257599.564050:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257599.564058:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257599.564065:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257599.564076:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098202624, portal 25 00000400:00000010:1.0:1734257599.564080:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734257599.564082:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098202624, offset 0 00000400:00000200:1.0:1734257599.564089:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734257599.564096:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257599.564100:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:1.0:1734257599.564181:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257599.564185:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257599.564189:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257599.564192:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257599.564194:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257599.564196:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [315:315:256:4294967295] 192.168.202.108@tcp LPNI seq info [314:314:8:4294967295] 00000400:00000200:1.0:1734257599.564203:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:2.0:1734257599.564206:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000800:00000200:1.0:1734257599.564208:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734257599.564209:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098202752, portal 10 00000800:00000010:1.0:1734257599.564212:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734257599.564216:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:2.0:1734257599.564222:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000800:00000200:1.0:1734257599.564223:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:2.0:1734257599.564224:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098202752, offset 0 00000800:00000200:1.0:1734257599.564226:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257599.564229:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257599.564234:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257599.564236:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257599.564335:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257599.564338:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257599.564340:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257599.564342:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [316:316:255:4294967295] 192.168.202.108@tcp LPNI seq info [315:315:7:4294967295] 00000400:00000200:2.0:1734257599.564348:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257599.564351:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257599.564354:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257599.564357:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257599.564360:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257599.564362:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257599.564908:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257599.564912:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734257599.564916:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257599.564920:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257599.564923:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:0.0:1734257599.564924:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734257599.564930:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098202624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257615 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257599.564971:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257599.564973:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257599.564975:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257599.564978:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257599.564979:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734257599.564980:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734257599.564983:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098202752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257609 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257599.567823:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257599.567840:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609c00 00000400:00000200:0.0:1734257599.567846:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xac9 [1] + 224 00000400:00000200:0.0:1734257599.567856:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257599.567859:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257599.567868:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098202624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257615 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257599.567907:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257599.567925:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609c80 00000400:00000200:0.0:1734257599.567929:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xad1 [1] + 0 00000400:00000200:0.0:1734257599.567943:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257599.567945:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:1.0:1734257599.567946:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257599.567952:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257599.567954:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:0.0:1734257599.567960:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098202752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257609 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257599.567960:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098202624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257615 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257599.567967:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098202624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257615 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257599.567987:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257599.567992:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734257599.567996:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:2.0:1734257599.568923:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257599.568930:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257599.568932:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257599.568937:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098202752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257609 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257599.568944:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098202752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257609 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257599.568961:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257599.568965:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257599.568967:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734257604.571673:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257604.571690:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257604.571745:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257604.571751:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257604.571787:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257604.571793:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257604.571799:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257604.571804:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098202880, portal 25 00000400:00000010:1.0:1734257604.571808:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734257604.571810:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098202880, offset 0 00000400:00000200:1.0:1734257604.571817:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257604.571828:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:2.0:1734257604.571830:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:1.0:1734257604.571834:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734257604.571834:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257604.571838:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257604.571840:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098203008, portal 10 00000400:00000010:2.0:1734257604.571844:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000400:00000200:1.0:1734257604.571846:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257604.571849:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257604.571851:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:2.0:1734257604.571851:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098203008, offset 0 00000400:00000200:1.0:1734257604.571853:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [317:317:256:4294967295] 192.168.202.108@tcp LPNI seq info [316:316:8:4294967295] 00000400:00000200:2.0:1734257604.571856:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257604.571860:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257604.571865:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257604.571868:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734257604.571873:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257604.571880:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257604.571883:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257604.571891:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257604.571893:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257604.571895:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257604.571897:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257604.571898:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257604.571900:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [318:318:255:4294967295] 192.168.202.108@tcp LPNI seq info [317:317:7:4294967295] 00000400:00000200:2.0:1734257604.571909:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257604.571913:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257604.571917:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257604.571920:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257604.571923:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257604.571925:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257604.573103:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257604.573107:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734257604.573112:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257604.573117:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257604.573120:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734257604.573122:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734257604.573128:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098202880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257620 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257604.573182:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257604.573184:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257604.573186:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257604.573189:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257604.573191:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:0.0:1734257604.573192:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734257604.573195:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098203008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257614 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257604.574994:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257604.575013:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609d00 00000400:00000200:0.0:1734257604.575020:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xad9 [1] + 224 00000400:00000200:0.0:1734257604.575040:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257604.575052:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257604.575063:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098202880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257604.575173:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257604.575180:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257604.575182:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257604.575190:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098202880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257620 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257604.575198:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098202880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257620 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257604.575216:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257604.575220:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734257604.575223:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734257604.576056:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257604.576061:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609d80 00000400:00000200:0.0:1734257604.576066:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xae1 [1] + 0 00000400:00000200:0.0:1734257604.576074:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257604.576077:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257604.576081:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098203008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257614 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257604.576150:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257604.576157:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257604.576158:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257604.576165:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098203008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257614 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257604.576172:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098203008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257614 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257604.576189:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257604.576194:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257604.576197:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734257609.579896:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257609.579930:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257609.580005:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257609.580016:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257609.580372:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257609.580379:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257609.580386:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257609.580396:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098203136, portal 25 00000400:00000010:1.0:1734257609.580401:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:1.0:1734257609.580403:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098203136, offset 0 00000400:00000200:1.0:1734257609.580413:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257609.580430:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257609.580436:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257609.580439:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257609.580443:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257609.580458:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257609.580462:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [319:319:256:4294967295] 192.168.202.108@tcp LPNI seq info [318:318:8:4294967295] 00000400:00000200:1.0:1734257609.580471:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257609.580479:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257609.580483:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734257609.580489:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257609.580498:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257609.580501:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257609.580679:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257609.580685:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257609.580689:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257609.580691:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098203264, portal 10 00000400:00000010:2.0:1734257609.580696:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734257609.580698:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098203264, offset 0 00000400:00000200:2.0:1734257609.580708:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257609.580712:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257609.580714:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257609.580716:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257609.580718:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257609.580719:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257609.580721:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [320:320:255:4294967295] 192.168.202.108@tcp LPNI seq info [319:319:7:4294967295] 00000400:00000200:2.0:1734257609.580726:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257609.580729:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257609.580732:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257609.580734:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257609.580737:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257609.580739:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257609.580811:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257609.580813:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734257609.580818:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257609.580822:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257609.580825:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:0.0:1734257609.580826:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:0.0:1734257609.580833:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098203136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257625 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257609.580899:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257609.580901:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257609.580903:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257609.580906:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257609.580908:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734257609.580908:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734257609.580912:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098203264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257619 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257609.586539:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257609.586603:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609e00 00000400:00000200:0.0:1734257609.586613:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xae9 [1] + 224 00000400:00000200:0.0:1734257609.586628:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257609.586632:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257609.588175:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098203136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257625 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257609.588351:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257609.588367:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609e80 00000400:00000200:0.0:1734257609.588378:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xaf1 [1] + 0 00000400:00000200:0.0:1734257609.588402:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257609.588406:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257609.588411:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098203264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257619 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257609.588524:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257609.588529:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257609.588531:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257609.588536:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098203136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257625 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257609.588543:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098203136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257625 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257609.588645:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257609.588651:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734257609.588655:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:2.0:1734257609.590244:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257609.590257:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257609.590259:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257609.590277:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098203264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257619 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257609.590284:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098203264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257619 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257609.590318:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257609.590324:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257609.590327:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257614.587685:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257614.587709:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 02000000:00000010:1.0:1734257614.587860:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257614.587868:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257614.587875:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257614.587882:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098203392, portal 25 00000400:00000010:1.0:1734257614.587886:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734257614.587888:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098203392, offset 0 00000400:00000200:1.0:1734257614.587896:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257614.587907:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257614.587912:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257614.587916:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257614.587919:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257614.587921:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257614.587923:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [321:321:256:4294967295] 192.168.202.108@tcp LPNI seq info [320:320:8:4294967295] 00000400:00000200:1.0:1734257614.587941:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257614.587946:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257614.587950:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734257614.587962:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257614.587969:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257614.587973:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257614.588077:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257614.588083:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734257614.588115:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734257614.588118:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50840. 00000400:00000010:0.0:1734257614.588120:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734257614.588123:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098203520, portal 10 00000400:00000010:0.0:1734257614.588127:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000100:00000200:0.0:1734257614.588128:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098203520, offset 0 00000400:00000200:0.0:1734257614.588131:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257614.588135:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257614.588138:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257614.588139:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257614.588141:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257614.588142:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257614.588149:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [322:322:255:4294967295] 192.168.202.108@tcp LPNI seq info [321:321:7:4294967295] 00000400:00000200:0.0:1734257614.588154:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257614.588157:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257614.588159:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734257614.588161:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257614.588165:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257614.588166:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257614.590537:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257614.590544:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:2.0:1734257614.590551:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257614.590558:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257614.590563:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:2.0:1734257614.590565:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:2.0:1734257614.590614:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098203392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257630 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257614.590696:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257614.590697:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:2.0:1734257614.590700:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257614.590703:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257614.590705:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:2.0:1734257614.590707:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:2.0:1734257614.590710:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098203520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257624 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257614.593719:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257614.593746:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c609f80 00000400:00000200:0.0:1734257614.593757:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb01 [1] + 0 00000400:00000200:0.0:1734257614.593785:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257614.593790:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257614.593802:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098203520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257624 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257614.594056:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50840. 00000400:00000200:2.0:1734257614.594062:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:2.0:1734257614.594065:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:2.0:1734257614.594072:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098203520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257624 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257614.594079:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098203520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257624 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257614.594118:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257614.594125:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257614.594130:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734257614.594764:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257614.594772:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c609f00 00000400:00000200:0.0:1734257614.594778:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xaf9 [1] + 224 00000400:00000200:0.0:1734257614.594791:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257614.594794:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257614.594800:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098203392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257614.595026:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257614.595032:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257614.595033:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257614.595039:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098203392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257630 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257614.595045:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098203392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257630 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257614.595057:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257614.595060:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734257614.595062:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734257619.595683:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257619.595702:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257619.595758:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257619.595764:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257619.595787:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257619.595794:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257619.595800:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257619.595805:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098203648, portal 25 00000400:00000010:3.0:1734257619.595809:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734257619.595811:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098203648, offset 0 00000400:00000200:3.0:1734257619.595819:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257619.595829:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257619.595834:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257619.595837:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257619.595840:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257619.595842:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257619.595844:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [323:323:256:4294967295] 192.168.202.108@tcp LPNI seq info [322:322:8:4294967295] 00000400:00000200:3.0:1734257619.595852:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257619.595856:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257619.595860:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734257619.595864:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257619.595871:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257619.595874:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257619.596092:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257619.596096:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734257619.596102:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257619.596123:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257619.596128:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734257619.596130:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734257619.596138:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098203648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257635 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257619.597152:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257619.597162:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257619.597169:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257619.597176:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098203776, portal 10 00000400:00000010:2.0:1734257619.597184:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000100:00000200:2.0:1734257619.597187:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098203776, offset 0 00000400:00000200:2.0:1734257619.597195:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257619.597204:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257619.597208:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257619.597211:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257619.597213:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257619.597215:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257619.597218:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [324:324:256:4294967295] 192.168.202.108@tcp LPNI seq info [323:323:8:4294967295] 00000400:00000200:2.0:1734257619.597237:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257619.597244:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257619.597248:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257619.597253:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257619.597261:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257619.597264:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257619.597414:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257619.597418:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257619.597421:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257619.597426:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257619.597430:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734257619.597432:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734257619.597679:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098203776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257629 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257619.598087:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257619.598101:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a000 00000400:00000200:0.0:1734257619.598110:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb09 [1] + 224 00000400:00000200:0.0:1734257619.598131:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257619.598136:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257619.598145:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098203648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257635 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257619.598263:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257619.598288:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257619.598290:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257619.598297:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098203648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257635 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257619.598304:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098203648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257635 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257619.598331:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257619.598338:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734257619.598342:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734257619.600922:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257619.600941:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a080 00000400:00000200:0.0:1734257619.600951:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb11 [1] + 0 00000400:00000200:0.0:1734257619.600976:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257619.600981:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257619.600990:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098203776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257629 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257619.601316:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257619.601321:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257619.601324:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257619.601330:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098203776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257629 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257619.601337:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098203776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257629 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257619.601364:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257619.601370:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257619.601374:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257624.603685:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257624.603703:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257624.603775:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257624.603781:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734257624.603876:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734257624.603876:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:2.0:1734257624.603882:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734257624.603882:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257624.603887:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000010:2.0:1734257624.603888:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257624.603893:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098204032, portal 10 00000100:00000200:3.0:1734257624.603899:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098203904, portal 25 00000400:00000010:2.0:1734257624.603903:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000400:00000010:3.0:1734257624.603903:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:2.0:1734257624.603905:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098204032, offset 0 00000100:00000200:3.0:1734257624.603905:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098203904, offset 0 00000400:00000200:2.0:1734257624.603911:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257624.603918:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257624.603925:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257624.603930:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257624.603936:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257624.603939:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257624.603941:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257624.603944:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [325:325:256:4294967295] 192.168.202.108@tcp LPNI seq info [324:324:8:4294967295] 00000400:00000200:2.0:1734257624.603951:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257624.603961:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257624.603961:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734257624.603964:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734257624.603964:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257624.603966:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257624.603968:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734257624.603969:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257624.603970:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257624.603972:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [326:326:255:4294967295] 192.168.202.108@tcp LPNI seq info [325:325:7:4294967295] 00000800:00000200:2.0:1734257624.603977:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734257624.603979:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257624.603981:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734257624.603986:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257624.603988:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734257624.603991:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257624.603994:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257624.603996:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257624.604067:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257624.604070:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257624.604074:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257624.604077:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257624.604080:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734257624.604082:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734257624.604088:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098204032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257624.604293:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257624.604295:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734257624.604298:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257624.604301:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257624.604303:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734257624.604304:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734257624.604308:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098203904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257640 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257624.606494:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257624.606509:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a100 00000400:00000200:0.0:1734257624.606516:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb1d [1] + 224 00000400:00000200:0.0:1734257624.606526:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257624.606529:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257624.606537:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098203904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257640 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257624.606594:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257624.606598:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a180 00000400:00000200:0.0:1734257624.606603:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb19 [1] + 0 00000400:00000200:0.0:1734257624.606615:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257624.606617:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257624.606627:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098204032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257634 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257624.606786:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257624.606790:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257624.606792:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257624.606801:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098203904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257640 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257624.606807:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098203904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257640 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257624.606826:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257624.606830:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734257624.606834:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:2.0:1734257624.607191:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257624.607194:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257624.607196:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257624.607200:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098204032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257624.607206:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098204032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257634 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257624.607222:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257624.607226:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257624.607228:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734257629.611812:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257629.611829:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257629.611878:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257629.611884:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734257629.611907:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257629.611914:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257629.611920:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257629.611925:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098204160, portal 25 00000400:00000010:1.0:1734257629.611941:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734257629.611943:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098204160, offset 0 00000400:00000200:1.0:1734257629.611951:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257629.611962:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257629.611970:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257629.611974:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257629.611976:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257629.611978:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257629.611981:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [327:327:256:4294967295] 192.168.202.108@tcp LPNI seq info [326:326:8:4294967295] 00000400:00000200:1.0:1734257629.611988:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257629.612003:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257629.612006:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734257629.612011:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257629.612018:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257629.612021:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257629.612110:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257629.612114:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257629.612117:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257629.612120:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098204288, portal 10 00000400:00000010:2.0:1734257629.612125:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734257629.612126:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098204288, offset 0 00000400:00000200:2.0:1734257629.612130:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257629.612134:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257629.612137:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257629.612139:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257629.612140:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257629.612142:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257629.612144:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [328:328:255:4294967295] 192.168.202.108@tcp LPNI seq info [327:327:7:4294967295] 00000400:00000200:2.0:1734257629.612150:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257629.612153:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257629.612160:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257629.612163:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257629.612167:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257629.612168:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257629.612238:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257629.612240:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734257629.612244:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257629.612248:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257629.612251:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734257629.612253:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734257629.612259:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098204160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257645 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257629.612310:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257629.612311:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257629.612314:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257629.612316:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257629.612318:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734257629.612319:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734257629.612322:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098204288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257629.614104:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257629.614118:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a200 00000400:00000200:0.0:1734257629.614124:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb29 [1] + 224 00000400:00000200:0.0:1734257629.614141:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257629.614145:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257629.614152:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098204160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257645 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257629.614267:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257629.614271:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257629.614273:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257629.614278:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098204160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257645 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257629.614285:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098204160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257645 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257629.614302:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257629.614306:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734257629.614309:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734257629.614438:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257629.614450:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a280 00000400:00000200:0.0:1734257629.614454:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb31 [1] + 0 00000400:00000200:0.0:1734257629.614465:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257629.614467:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257629.614472:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098204288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257639 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257629.614630:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257629.614634:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257629.614635:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257629.614639:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098204288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257629.614644:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098204288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257639 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257629.614660:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257629.614664:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257629.614666:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257634.619679:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257634.619702:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257634.619761:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257634.619767:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257634.619812:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734257634.619820:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257634.619826:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257634.619832:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098204416, portal 25 00000400:00000010:1.0:1734257634.619836:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734257634.619838:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098204416, offset 0 00000400:00000200:1.0:1734257634.619847:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257634.619861:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257634.619866:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257634.619871:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257634.619874:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257634.619876:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257634.619878:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [329:329:256:4294967295] 192.168.202.108@tcp LPNI seq info [328:328:8:4294967295] 00000400:00000200:1.0:1734257634.619886:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257634.619890:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257634.619904:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734257634.619908:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257634.619915:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257634.619918:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257634.620066:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257634.620069:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734257634.620071:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257634.620075:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257634.620079:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:0.0:1734257634.620080:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734257634.620086:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098204416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257650 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257634.620213:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257634.620218:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257634.620221:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257634.620224:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098204544, portal 10 00000400:00000010:2.0:1734257634.620228:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000100:00000200:2.0:1734257634.620229:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098204544, offset 0 00000400:00000200:2.0:1734257634.620233:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257634.620238:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257634.620240:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257634.620242:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257634.620243:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257634.620245:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257634.620246:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [330:330:256:4294967295] 192.168.202.108@tcp LPNI seq info [329:329:8:4294967295] 00000400:00000200:2.0:1734257634.620251:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257634.620254:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257634.620257:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257634.620266:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257634.620270:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257634.620272:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257634.620358:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257634.620360:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257634.620362:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257634.620366:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257634.620368:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734257634.620369:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734257634.620373:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098204544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257644 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257634.623379:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257634.623398:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a300 00000400:00000200:0.0:1734257634.623405:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb39 [1] + 224 00000400:00000200:0.0:1734257634.623425:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257634.623435:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257634.623444:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098204416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257650 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257634.624694:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257634.624703:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a380 00000400:00000200:0.0:1734257634.624711:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb41 [1] + 0 00000400:00000200:0.0:1734257634.624724:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257634.624727:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257634.624735:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098204544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257644 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257634.625190:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257634.625195:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257634.625197:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257634.625201:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098204544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257644 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257634.625209:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098204544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257644 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257634.625236:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257634.625241:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000400:00000010:1.0:1734257634.625278:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257634.625282:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257634.625284:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257634.625289:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098204416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257650 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257634.625297:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098204416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257650 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257634.625309:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734257634.625312:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734257634.625316:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:2.0:1734257634.625393:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257639.627704:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257639.627727:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257639.627781:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257639.627787:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257639.627841:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257639.627850:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257639.627856:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257639.627864:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098204672, portal 25 00000400:00000010:3.0:1734257639.627869:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734257639.627871:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098204672, offset 0 00000400:00000200:3.0:1734257639.627880:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257639.627894:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257639.627900:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257639.627903:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257639.627907:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257639.627909:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257639.627911:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [331:331:256:4294967295] 192.168.202.108@tcp LPNI seq info [330:330:8:4294967295] 00000400:00000200:3.0:1734257639.627920:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257639.627926:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257639.627930:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734257639.627935:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257639.627943:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257639.627948:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257639.628131:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257639.628135:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734257639.628139:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257639.628143:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257639.628147:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:0.0:1734257639.628148:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734257639.628155:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098204672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257655 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257639.628158:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257639.628162:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257639.628165:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257639.628168:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098204800, portal 10 00000400:00000010:2.0:1734257639.628172:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734257639.628174:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098204800, offset 0 00000400:00000200:2.0:1734257639.628178:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257639.628183:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257639.628185:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257639.628187:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257639.628189:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257639.628190:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257639.628192:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [332:332:256:4294967295] 192.168.202.108@tcp LPNI seq info [331:331:8:4294967295] 00000400:00000200:2.0:1734257639.628198:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257639.628201:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257639.628203:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257639.628205:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257639.628221:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257639.628223:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257639.628369:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257639.628371:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257639.628374:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257639.628377:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257639.628379:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734257639.628380:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734257639.628384:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098204800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257649 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257639.633478:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257639.633509:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a480 00000400:00000200:0.0:1734257639.633518:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb51 [1] + 0 00000400:00000200:0.0:1734257639.633530:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257639.633534:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257639.633544:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098204800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257649 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257639.633610:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257639.633615:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a400 00000400:00000200:0.0:1734257639.633620:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb49 [1] + 224 00000400:00000200:0.0:1734257639.633634:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257639.633637:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257639.633641:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098204672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257655 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257639.634018:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257639.634024:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257639.634026:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257639.634031:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098204672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257655 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257639.634049:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098204672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257655 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257639.634078:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257639.634084:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734257639.634088:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:2.0:1734257639.634182:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257639.634187:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257639.634188:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257639.634194:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098204800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257649 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257639.634201:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098204800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257649 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257639.634220:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257639.634224:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257639.634226:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257644.635681:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257644.635703:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 02000000:00000010:3.0:1734257644.636071:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000100:00000010:0.0:1734257644.636077:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 00000400:00000010:3.0:1734257644.636080:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 02000000:00000010:0.0:1734257644.636083:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 00000400:00000010:3.0:1734257644.636087:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257644.636094:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098204928, portal 25 00000400:00000010:3.0:1734257644.636100:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 02000000:00000010:2.0:1734257644.636145:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257644.636149:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257644.636152:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257644.636398:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098205056, portal 10 00000400:00000010:2.0:1734257644.636402:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734257644.636404:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098205056, offset 0 00000400:00000200:2.0:1734257644.636412:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257644.636422:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257644.636427:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257644.636431:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257644.636434:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257644.636436:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257644.636438:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [333:333:256:4294967295] 192.168.202.108@tcp LPNI seq info [332:332:8:4294967295] 00000400:00000200:2.0:1734257644.636446:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257644.636451:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257644.636455:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257644.636460:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257644.636467:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:3.0:1734257644.636473:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098204928, offset 0 00000400:00000200:3.0:1734257644.636477:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734257644.636481:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734257644.636481:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257644.636483:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257644.636485:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257644.636486:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257644.636488:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257644.636489:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [334:334:255:4294967295] 192.168.202.108@tcp LPNI seq info [333:333:7:4294967295] 00000400:00000200:3.0:1734257644.636495:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257644.636498:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257644.636500:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734257644.636503:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257644.636506:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257644.636507:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257644.636590:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257644.636592:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257644.636597:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257644.636601:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257644.636605:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:0.0:1734257644.636607:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734257644.636612:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098205056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257654 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257644.636671:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257644.636673:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734257644.636675:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257644.636678:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257644.636680:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:0.0:1734257644.636686:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734257644.636691:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098204928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257660 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257644.639542:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257644.639559:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a500 00000400:00000200:0.0:1734257644.639590:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb59 [1] + 224 00000400:00000200:0.0:1734257644.639603:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257644.639607:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257644.639616:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098204928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257660 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257644.639652:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257644.639656:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a580 00000400:00000200:0.0:1734257644.639660:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb5d [1] + 0 00000400:00000200:0.0:1734257644.639674:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257644.639677:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257644.639681:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098205056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257654 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257644.639882:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257644.639887:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257644.639889:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257644.639893:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098205056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257654 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257644.639900:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098205056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257654 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257644.639927:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257644.639932:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257644.639936:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:3.0:1734257644.640150:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257644.640154:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257644.640155:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257644.640159:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098204928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257660 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257644.640177:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098204928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257660 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257644.640188:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257644.640191:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734257644.640193:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257649.643710:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257649.643734:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257649.643799:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257649.643807:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257649.643881:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257649.643890:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257649.643897:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257649.643906:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098205312, portal 10 00000400:00000010:2.0:1734257649.643913:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 02000000:00000010:3.0:1734257649.643913:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000100:00000200:2.0:1734257649.643915:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098205312, offset 0 00000400:00000010:3.0:1734257649.643918:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:2.0:1734257649.643925:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734257649.643930:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257649.643933:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098205184, portal 25 00000400:00000010:3.0:1734257649.643936:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734257649.643938:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098205184, offset 0 00000400:00000200:2.0:1734257649.643939:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257649.643942:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257649.643944:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257649.643948:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257649.643952:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257649.643954:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257649.643957:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [335:335:256:4294967295] 192.168.202.108@tcp LPNI seq info [334:334:8:4294967295] 00000400:00000200:2.0:1734257649.643969:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257649.643974:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257649.643978:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257649.643984:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257649.643992:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257649.643995:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734257649.644021:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257649.644024:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257649.644026:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257649.644028:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257649.644029:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257649.644031:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [336:336:255:4294967295] 192.168.202.108@tcp LPNI seq info [335:335:7:4294967295] 00000400:00000200:3.0:1734257649.644037:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257649.644041:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257649.644045:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734257649.644048:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257649.644051:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257649.644053:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257649.644117:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257649.644119:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257649.644123:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257649.644127:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257649.644131:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734257649.644132:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734257649.644139:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098205312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257659 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257649.644230:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257649.644232:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734257649.644234:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257649.644237:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257649.644239:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734257649.644240:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734257649.644243:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098205184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257665 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257649.650605:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257649.650627:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a600 00000400:00000200:0.0:1734257649.650637:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb71 [1] + 224 00000400:00000200:0.0:1734257649.650652:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257649.650655:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257649.650667:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098205184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257665 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257649.650709:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257649.650714:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a680 00000400:00000200:0.0:1734257649.650720:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb69 [1] + 0 00000400:00000200:0.0:1734257649.650739:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257649.650742:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257649.650747:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098205312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257659 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257649.650835:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257649.650840:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257649.650843:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000400:00000010:3.0:1734257649.650848:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000100:00000200:2.0:1734257649.650849:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098205312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257659 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734257649.650852:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257649.650854:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:2.0:1734257649.650857:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098205312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257659 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257649.650859:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098205184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257665 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257649.650881:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098205184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257665 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257649.650892:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734257649.650893:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:2.0:1734257649.650900:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 02000000:00000010:3.0:1734257649.650900:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734257649.650904:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:3.0:1734257649.650904:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257654.651894:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257654.651912:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257654.651965:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257654.651971:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257654.652004:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257654.652011:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257654.652017:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257654.652023:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098205440, portal 25 00000400:00000010:3.0:1734257654.652026:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734257654.652028:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098205440, offset 0 00000400:00000200:3.0:1734257654.652035:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257654.652047:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257654.652052:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257654.652056:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257654.652058:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257654.652060:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257654.652063:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [337:337:256:4294967295] 192.168.202.108@tcp LPNI seq info [336:336:8:4294967295] 00000400:00000200:3.0:1734257654.652070:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257654.652076:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257654.652079:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734257654.652084:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257654.652090:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257654.652094:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257654.652222:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257654.652225:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:3.0:1734257654.652228:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257654.652231:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257654.652234:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 02000000:00000010:2.0:1734257654.652235:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257654.652239:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734257654.652245:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000400:00000010:2.0:1734257654.652249:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:3.0:1734257654.652251:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098205440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257670 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257654.652252:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098205568, portal 10 00000400:00000010:2.0:1734257654.652255:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257654.652257:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098205568, offset 0 00000400:00000200:2.0:1734257654.652261:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257654.652265:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257654.652268:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257654.652270:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257654.652272:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257654.652273:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257654.652275:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [338:338:256:4294967295] 192.168.202.108@tcp LPNI seq info [337:337:8:4294967295] 00000400:00000200:2.0:1734257654.652282:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257654.652285:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257654.652289:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257654.652292:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257654.652295:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257654.652297:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257654.652446:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257654.652449:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257654.652455:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257654.652458:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257654.652460:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734257654.652461:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734257654.652465:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098205568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257664 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257654.657101:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257654.657120:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a780 00000400:00000200:0.0:1734257654.657131:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb81 [1] + 0 00000400:00000200:0.0:1734257654.657143:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257654.657147:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257654.657157:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098205568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257664 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257654.657337:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257654.657342:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a700 00000400:00000200:0.0:1734257654.657348:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb79 [1] + 224 00000400:00000200:0.0:1734257654.657362:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257654.657365:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257654.657369:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098205440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257670 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257654.657910:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257654.657922:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257654.657924:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257654.657928:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098205568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257664 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257654.657935:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098205568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257664 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257654.657958:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257654.657962:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257654.657966:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:3.0:1734257654.658037:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257654.658040:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257654.658041:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257654.658045:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098205440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257670 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257654.658051:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098205440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257670 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257654.658063:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257654.658066:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734257654.658067:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734257659.659691:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257659.659714:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257659.659777:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257659.659784:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257659.659800:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257659.659807:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257659.659813:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257659.659819:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098205696, portal 25 00000400:00000010:3.0:1734257659.659824:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734257659.659826:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098205696, offset 0 00000400:00000200:3.0:1734257659.659834:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257659.659851:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257659.659857:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257659.659861:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257659.659864:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257659.659866:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257659.659870:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [339:339:256:4294967295] 192.168.202.108@tcp LPNI seq info [338:338:8:4294967295] 00000400:00000200:3.0:1734257659.659878:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257659.659883:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257659.659887:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734257659.659895:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257659.659903:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257659.659919:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257659.660058:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257659.660062:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734257659.660065:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257659.660069:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257659.660073:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734257659.660081:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734257659.660088:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098205696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257675 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257659.660158:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257659.660163:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257659.660167:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257659.660170:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098205824, portal 10 00000400:00000010:2.0:1734257659.660174:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734257659.660175:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098205824, offset 0 00000400:00000200:2.0:1734257659.660179:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257659.660184:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257659.660186:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257659.660188:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257659.660190:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257659.660192:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257659.660194:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [340:340:256:4294967295] 192.168.202.108@tcp LPNI seq info [339:339:8:4294967295] 00000400:00000200:2.0:1734257659.660200:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257659.660203:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257659.660205:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257659.660208:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257659.660211:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257659.660213:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257659.660277:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257659.660279:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257659.660282:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257659.660285:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257659.660286:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734257659.660287:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734257659.660291:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098205824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257669 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257659.664435:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257659.664457:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a880 00000400:00000200:0.0:1734257659.664468:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xb91 [1] + 0 00000400:00000200:0.0:1734257659.664493:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257659.664497:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257659.664509:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098205824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257669 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257659.665437:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257659.665442:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257659.665454:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257659.665460:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098205824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257669 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257659.665467:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098205824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257669 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257659.665493:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257659.665498:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257659.665503:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734257659.667948:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257659.667983:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a800 00000400:00000200:0.0:1734257659.667991:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb89 [1] + 224 00000400:00000200:0.0:1734257659.668015:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257659.668019:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257659.668029:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098205696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257675 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257659.672990:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257659.673003:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257659.673006:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257659.673021:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098205696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257675 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257659.673032:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098205696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257675 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257659.673066:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257659.673072:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:3.0:1734257659.673077:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734257664.667687:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257664.667706:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734257664.667981:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257664.667988:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257664.668618:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0200. 00000400:00000010:1.0:1734257664.668625:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257664.668631:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257664.668637:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098205952, portal 25 00000400:00000010:1.0:1734257664.668640:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734257664.668642:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098205952, offset 0 00000400:00000200:1.0:1734257664.668650:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257664.668660:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257664.668665:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257664.668668:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257664.668671:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257664.668673:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257664.668675:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [341:341:256:4294967295] 192.168.202.108@tcp LPNI seq info [340:340:8:4294967295] 00000400:00000200:1.0:1734257664.668683:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257664.668688:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257664.668692:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734257664.668701:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257664.668708:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257664.668711:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257664.668814:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257664.668817:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:1.0:1734257664.668819:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257664.668824:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257664.668827:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734257664.668829:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734257664.668835:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098205952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257680 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257664.669175:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257664.669180:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257664.669183:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257664.669185:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098206080, portal 10 00000400:00000010:2.0:1734257664.669189:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734257664.669190:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098206080, offset 0 00000400:00000200:2.0:1734257664.669194:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257664.669199:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257664.669201:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257664.669203:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257664.669205:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257664.669206:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257664.669208:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [342:342:256:4294967295] 192.168.202.108@tcp LPNI seq info [341:341:8:4294967295] 00000400:00000200:2.0:1734257664.669214:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257664.669217:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257664.669220:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257664.669222:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257664.669226:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257664.669228:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257664.669439:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257664.669441:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257664.669444:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257664.669447:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257664.669449:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734257664.669450:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734257664.669453:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098206080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257674 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257664.674388:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257664.674406:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60a900 00000400:00000200:0.0:1734257664.674415:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xb99 [1] + 224 00000400:00000200:0.0:1734257664.674439:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257664.674443:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257664.674454:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098205952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257680 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257664.674801:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257664.674807:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60a980 00000400:00000200:0.0:1734257664.674812:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xba1 [1] + 0 00000400:00000200:0.0:1734257664.674820:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257664.674823:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257664.674827:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098206080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257674 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257664.674965:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257664.674970:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257664.674972:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257664.674976:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098205952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257680 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257664.674982:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098205952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257680 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257664.675001:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0200. 02000000:00000010:1.0:1734257664.675005:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734257664.675007:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:2.0:1734257664.675059:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257664.675063:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257664.675064:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257664.675067:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098206080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257674 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257664.675079:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098206080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257674 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257664.675103:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257664.675107:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257664.675108:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257669.675702:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257669.675727:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257669.675782:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257669.675789:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257669.675831:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257669.675841:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257669.675848:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257669.675853:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098206208, portal 25 00000400:00000010:1.0:1734257669.675857:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734257669.675859:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098206208, offset 0 00000400:00000200:1.0:1734257669.675866:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257669.675876:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:2.0:1734257669.675880:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:1.0:1734257669.675881:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257669.675884:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257669.675887:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:2.0:1734257669.675887:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257669.675892:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000400:00000200:1.0:1734257669.675897:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:2.0:1734257669.675897:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098206336, portal 10 00000400:00000200:1.0:1734257669.675900:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [343:343:256:4294967295] 192.168.202.108@tcp LPNI seq info [342:342:8:4294967295] 00000400:00000010:2.0:1734257669.675903:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734257669.675904:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098206336, offset 0 00000400:00000200:1.0:1734257669.675907:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:2.0:1734257669.675911:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734257669.675912:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257669.675915:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000400:00000200:2.0:1734257669.675920:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734257669.675921:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257669.675924:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257669.675927:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734257669.675928:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257669.675929:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734257669.675931:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257669.675931:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257669.675934:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [344:344:255:4294967295] 192.168.202.108@tcp LPNI seq info [343:343:7:4294967295] 00000400:00000200:2.0:1734257669.675941:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257669.675946:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257669.675949:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257669.675953:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257669.675959:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257669.675962:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257669.676119:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257669.676122:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734257669.676126:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257669.676135:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257669.676139:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:0.0:1734257669.676145:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:0.0:1734257669.676152:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098206208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257685 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257669.676205:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257669.676207:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257669.676210:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257669.676213:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257669.676214:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734257669.676216:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734257669.676219:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098206336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257679 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257669.683044:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257669.683071:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60aa80 00000400:00000200:0.0:1734257669.683078:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xbb1 [1] + 0 00000400:00000200:0.0:1734257669.683098:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257669.683101:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257669.683110:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098206336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257679 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257669.683219:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257669.683223:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257669.683225:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257669.683229:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098206336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257679 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257669.683248:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098206336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257679 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257669.683273:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257669.683277:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257669.683281:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000200:0.0:1734257669.686281:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257669.686299:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60aa00 00000400:00000200:0.0:1734257669.686306:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xba9 [1] + 224 00000400:00000200:0.0:1734257669.686326:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257669.686330:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257669.686338:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098206208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257685 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257669.686737:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257669.686743:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257669.686745:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257669.686750:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098206208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257685 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257669.686757:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098206208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257685 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257669.686779:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257669.686783:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734257669.686786:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734257674.683711:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257674.683732:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257674.683803:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257674.683810:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734257674.683823:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257674.683830:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257674.683836:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257674.683842:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098206464, portal 25 00000400:00000010:1.0:1734257674.683845:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734257674.683847:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098206464, offset 0 00000400:00000200:1.0:1734257674.683855:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257674.683866:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:2.0:1734257674.683869:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:1.0:1734257674.683870:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734257674.683873:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:1.0:1734257674.683874:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257674.683876:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:2.0:1734257674.683876:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000400:00000200:1.0:1734257674.683878:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:2.0:1734257674.683878:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098206592, portal 10 00000400:00000200:1.0:1734257674.683881:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [345:345:256:4294967295] 192.168.202.108@tcp LPNI seq info [344:344:8:4294967295] 00000400:00000010:2.0:1734257674.683882:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257674.683883:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098206592, offset 0 00000400:00000200:2.0:1734257674.683887:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257674.683892:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257674.683898:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257674.683901:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734257674.683906:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257674.683912:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257674.683915:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257674.684162:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257674.684164:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734257674.684167:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257674.684171:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257674.684175:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:0.0:1734257674.684176:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:0.0:1734257674.684182:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098206464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257690 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734257674.684239:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257674.684241:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257674.684243:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257674.684245:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257674.684246:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257674.684248:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [346:346:255:4294967295] 192.168.202.108@tcp LPNI seq info [345:345:7:4294967295] 00000400:00000200:2.0:1734257674.684254:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257674.684258:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257674.684260:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257674.684263:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257674.684266:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257674.684268:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257674.684457:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257674.684459:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257674.684461:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257674.684464:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257674.684466:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:0.0:1734257674.684467:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:0.0:1734257674.684470:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098206592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257684 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257674.691000:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257674.691024:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ab00 00000400:00000200:0.0:1734257674.691031:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xbb9 [1] + 224 00000400:00000200:0.0:1734257674.691040:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257674.691043:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257674.691052:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098206464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257690 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257674.691084:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257674.691087:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ab80 00000400:00000200:0.0:1734257674.691091:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xbc1 [1] + 0 00000400:00000200:0.0:1734257674.691102:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257674.691105:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257674.691114:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098206592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257684 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257674.691179:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257674.691184:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257674.691186:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257674.691191:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098206592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257684 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257674.691207:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098206592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257684 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257674.691231:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257674.691236:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257674.691240:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:1.0:1734257674.691907:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257674.691912:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257674.691914:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257674.691919:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098206464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257690 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257674.691925:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098206464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257690 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257674.691937:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257674.691939:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734257674.691941:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257679.692351:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257679.692369:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257679.692421:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257679.692427:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257679.692447:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257679.692454:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257679.692460:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257679.692465:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098206720, portal 25 00000400:00000010:3.0:1734257679.692468:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734257679.692470:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098206720, offset 0 00000400:00000200:3.0:1734257679.692478:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257679.692488:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257679.692493:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257679.692496:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257679.692499:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257679.692501:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257679.692504:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [347:347:256:4294967295] 192.168.202.108@tcp LPNI seq info [346:346:8:4294967295] 00000400:00000200:3.0:1734257679.692511:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:2.0:1734257679.692512:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000800:00000200:3.0:1734257679.692515:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734257679.692516:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000800:00000010:3.0:1734257679.692517:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000400:00000010:2.0:1734257679.692519:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257679.692522:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098206848, portal 10 00000800:00000200:3.0:1734257679.692522:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:2.0:1734257679.692526:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734257679.692527:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098206848, offset 0 00000800:00000200:3.0:1734257679.692528:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257679.692531:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734257679.692531:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257679.692536:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257679.692538:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257679.692540:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257679.692542:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257679.692544:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257679.692545:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [348:348:255:4294967295] 192.168.202.108@tcp LPNI seq info [347:347:7:4294967295] 00000400:00000200:2.0:1734257679.692551:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257679.692555:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257679.692557:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257679.692560:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257679.692564:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257679.692566:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257679.692787:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257679.692789:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734257679.692793:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257679.692797:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257679.692800:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734257679.692802:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734257679.692807:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098206720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257695 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257679.693129:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257679.693131:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257679.693134:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257679.693137:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257679.693139:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734257679.693140:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734257679.693144:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098206848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257689 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257679.696492:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257679.696506:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ac00 00000400:00000200:0.0:1734257679.696512:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xbc9 [1] + 224 00000400:00000200:0.0:1734257679.696529:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257679.696532:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257679.696540:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098206720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257695 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257679.697025:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257679.697029:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257679.697031:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257679.697037:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098206720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257695 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257679.697044:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098206720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257695 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257679.697067:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257679.697072:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734257679.697075:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:0.0:1734257679.697127:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257679.697141:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ac80 00000400:00000200:0.0:1734257679.697146:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xbd1 [1] + 0 00000400:00000200:0.0:1734257679.697156:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257679.697159:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257679.697163:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098206848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257679.697605:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257679.697609:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257679.697610:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257679.697615:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098206848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257689 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257679.697631:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098206848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257689 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257679.697647:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257679.697651:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257679.697654:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734257684.699666:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257684.699683:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257684.699734:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257684.699739:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734257684.699806:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 02000000:00000010:2.0:1734257684.699810:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:1.0:1734257684.699813:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:2.0:1734257684.699814:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:1.0:1734257684.699819:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:2.0:1734257684.699819:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257684.699823:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098207104, portal 10 00000400:00000010:2.0:1734257684.699833:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:1.0:1734257684.699864:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098206976, portal 25 00000400:00000010:1.0:1734257684.699868:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734257684.699870:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098206976, offset 0 00000400:00000200:1.0:1734257684.699879:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257684.699891:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:2.0:1734257684.699892:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098207104, offset 0 00000400:00000200:2.0:1734257684.699896:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257684.699897:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257684.699900:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257684.699902:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257684.699904:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257684.699906:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [349:349:256:4294967295] 192.168.202.108@tcp LPNI seq info [348:348:8:4294967295] 00000400:00000200:1.0:1734257684.699913:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257684.699927:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257684.699928:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734257684.699939:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734257684.699944:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257684.699951:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257684.699953:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257684.699954:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257684.699956:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257684.699958:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257684.699959:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257684.699961:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [350:350:255:4294967295] 192.168.202.108@tcp LPNI seq info [349:349:7:4294967295] 00000400:00000200:2.0:1734257684.699967:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257684.699971:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257684.699973:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257684.699976:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257684.699980:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257684.699982:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257684.700041:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257684.700044:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734257684.700048:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257684.700052:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257684.700054:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:0.0:1734257684.700056:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:0.0:1734257684.700064:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098206976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257700 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257684.700121:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257684.700123:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257684.700126:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257684.700129:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257684.700130:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734257684.700131:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734257684.700134:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098207104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257694 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257684.702028:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257684.702041:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ad80 00000400:00000200:0.0:1734257684.702047:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xbd9 [1] + 0 00000400:00000200:0.0:1734257684.702057:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257684.702068:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257684.702077:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098207104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257694 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257684.702111:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257684.702115:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ad00 00000400:00000200:0.0:1734257684.702120:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xbdd [1] + 224 00000400:00000200:0.0:1734257684.702132:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257684.702135:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257684.702139:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098206976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257700 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257684.702228:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257684.702232:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257684.702234:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257684.702238:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098207104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257694 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257684.702252:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098207104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257694 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257684.702277:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257684.702281:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257684.702286:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:1.0:1734257684.702355:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257684.702359:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257684.702360:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257684.702364:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098206976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257700 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257684.702368:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098206976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257700 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257684.702378:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257684.702381:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734257684.702383:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257689.707776:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257689.707829:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 02000000:00000010:1.0:1734257689.708405:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257689.708413:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257689.708421:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257689.708433:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098207232, portal 25 00000400:00000010:1.0:1734257689.708438:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734257689.708439:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098207232, offset 0 00000400:00000200:1.0:1734257689.708450:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257689.708467:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257689.708472:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257689.708476:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257689.708479:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257689.708481:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257689.708484:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [351:351:256:4294967295] 192.168.202.108@tcp LPNI seq info [350:350:8:4294967295] 00000400:00000200:1.0:1734257689.708495:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257689.708500:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257689.708520:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734257689.708525:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257689.708537:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257689.708541:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257689.709316:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257689.709327:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257689.709438:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257689.709443:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257689.709448:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257689.709451:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098207360, portal 10 00000400:00000010:2.0:1734257689.709456:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734257689.709458:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098207360, offset 0 00000400:00000200:2.0:1734257689.709463:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257689.709469:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257689.709471:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257689.709473:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257689.709475:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257689.709477:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257689.709478:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [352:352:255:4294967295] 192.168.202.108@tcp LPNI seq info [351:351:7:4294967295] 00000400:00000200:2.0:1734257689.709484:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257689.709489:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257689.709493:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257689.709496:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257689.709500:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257689.709502:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257689.709753:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257689.709756:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:1.0:1734257689.709760:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257689.709765:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257689.709769:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:1.0:1734257689.709770:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734257689.709778:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098207232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257705 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257689.710133:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257689.710136:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734257689.710140:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257689.710143:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257689.710145:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:1.0:1734257689.710146:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:1.0:1734257689.710149:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098207360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257699 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257689.715780:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257689.715801:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ae00 00000400:00000200:0.0:1734257689.715810:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xbe9 [1] + 224 00000400:00000200:0.0:1734257689.715823:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257689.715826:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257689.715838:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098207232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257705 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257689.715873:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257689.715876:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ae80 00000400:00000200:0.0:1734257689.715881:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xbf1 [1] + 0 00000400:00000200:0.0:1734257689.715907:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257689.715910:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257689.715914:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098207360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257699 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257689.716318:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257689.716323:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257689.716325:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257689.716331:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098207360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257699 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257689.716346:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098207360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257699 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257689.716395:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257689.716402:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257689.716408:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:1.0:1734257689.716416:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257689.716419:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257689.716420:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257689.716425:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098207232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257705 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257689.716431:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098207232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257705 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257689.716442:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257689.716445:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734257689.716447:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257694.715700:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257694.715724:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257694.715784:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257694.715790:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257694.715807:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257694.715827:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257694.715833:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257694.715841:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098207488, portal 25 00000400:00000010:1.0:1734257694.715845:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734257694.715847:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098207488, offset 0 00000400:00000200:1.0:1734257694.715884:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257694.715897:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257694.715902:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257694.715905:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257694.715909:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257694.715911:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257694.715914:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [353:353:256:4294967295] 192.168.202.108@tcp LPNI seq info [352:352:8:4294967295] 00000400:00000200:1.0:1734257694.715922:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257694.715927:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257694.715930:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734257694.715936:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257694.715944:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257694.715948:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257694.716075:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257694.716080:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257694.716083:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257694.716086:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098207616, portal 10 00000400:00000010:2.0:1734257694.716091:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734257694.716092:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098207616, offset 0 00000400:00000200:2.0:1734257694.716096:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257694.716099:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257694.716101:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257694.716103:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257694.716105:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257694.716107:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257694.716109:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [354:354:255:4294967295] 192.168.202.108@tcp LPNI seq info [353:353:7:4294967295] 00000400:00000200:2.0:1734257694.716114:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257694.716117:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257694.716120:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257694.716122:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257694.716126:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257694.716127:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257694.716203:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257694.716206:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734257694.716211:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257694.716215:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257694.716219:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:0.0:1734257694.716221:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:0.0:1734257694.716229:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098207488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257710 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257694.716305:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257694.716306:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257694.716309:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257694.716312:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257694.716314:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734257694.716315:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734257694.716318:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098207616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257704 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257694.719237:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257694.719253:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60af80 00000400:00000200:0.0:1734257694.719259:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc01 [1] + 0 00000400:00000200:0.0:1734257694.719269:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257694.719272:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257694.719281:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098207616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257704 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257694.719608:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257694.719613:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60af00 00000400:00000200:0.0:1734257694.719627:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xbf9 [1] + 224 00000400:00000200:0.0:1734257694.719638:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257694.719641:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257694.719645:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098207488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257694.719862:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257694.719867:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257694.719869:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257694.719873:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098207616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257704 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257694.719890:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098207616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257704 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257694.719918:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257694.719923:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257694.719926:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:1.0:1734257694.720036:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257694.720040:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257694.720041:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257694.720045:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098207488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257710 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257694.720051:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098207488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257710 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257694.720061:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257694.720063:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734257694.720065:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257699.723678:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257699.723696:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734257699.723747:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257699.723753:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257699.723794:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257699.723801:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257699.723808:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257699.723834:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098207744, portal 25 00000400:00000010:1.0:1734257699.723838:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734257699.723840:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098207744, offset 0 00000400:00000200:1.0:1734257699.723847:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257699.723858:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257699.723862:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257699.723866:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257699.723869:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257699.723871:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257699.723874:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [355:355:256:4294967295] 192.168.202.108@tcp LPNI seq info [354:354:8:4294967295] 00000400:00000200:1.0:1734257699.723881:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257699.723886:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257699.723890:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734257699.723894:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257699.723901:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257699.723905:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257699.724866:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257699.724870:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:1.0:1734257699.724875:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257699.724880:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257699.724885:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:1.0:1734257699.724886:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734257699.724893:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098207744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257715 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257699.724961:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257699.724966:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257699.724970:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257699.724974:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098207872, portal 10 00000400:00000010:2.0:1734257699.724978:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734257699.724980:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098207872, offset 0 00000400:00000200:2.0:1734257699.724985:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257699.724991:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257699.724993:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257699.724996:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257699.724998:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257699.725000:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257699.725002:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [356:356:256:4294967295] 192.168.202.108@tcp LPNI seq info [355:355:8:4294967295] 00000400:00000200:2.0:1734257699.725007:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257699.725011:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257699.725014:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257699.725018:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257699.725022:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257699.725024:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257699.725154:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257699.725157:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257699.725159:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257699.725162:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257699.725164:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734257699.725165:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734257699.725169:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098207872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257709 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257699.727235:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257699.727251:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b000 00000400:00000200:0.0:1734257699.727259:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc09 [1] + 224 00000400:00000200:0.0:1734257699.727269:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257699.727273:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257699.727281:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098207744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257715 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257699.727317:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257699.727322:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b080 00000400:00000200:0.0:1734257699.727325:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc11 [1] + 0 00000400:00000200:0.0:1734257699.727338:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257699.727341:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257699.727351:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098207872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257709 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257699.727636:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257699.727641:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257699.727643:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257699.727648:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098207872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257709 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257699.727664:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098207872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257709 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257699.727687:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257699.727693:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257699.727697:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:1.0:1734257699.727714:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257699.727718:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257699.727719:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257699.727724:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098207744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257715 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257699.727731:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098207744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257715 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257699.727752:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257699.727755:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734257699.727758:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734257704.732004:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257704.732023:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 02000000:00000010:1.0:1734257704.735047:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257704.735057:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257704.735065:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257704.735071:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098208000, portal 25 00000400:00000010:1.0:1734257704.735075:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734257704.735076:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098208000, offset 0 00000400:00000200:1.0:1734257704.735084:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257704.735097:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257704.735101:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257704.735105:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257704.735107:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257704.735109:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257704.735112:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [357:357:256:4294967295] 192.168.202.108@tcp LPNI seq info [356:356:8:4294967295] 00000400:00000200:1.0:1734257704.735119:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257704.735124:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257704.735127:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734257704.735132:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257704.735138:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257704.735142:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257704.735713:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257704.735730:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734257704.735801:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257704.735805:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257704.735809:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257704.735811:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098208128, portal 10 00000400:00000010:3.0:1734257704.735815:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734257704.735817:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098208128, offset 0 00000400:00000200:3.0:1734257704.735821:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257704.735826:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257704.735828:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257704.735829:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257704.735831:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257704.735832:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257704.735834:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [358:358:255:4294967295] 192.168.202.108@tcp LPNI seq info [357:357:7:4294967295] 00000400:00000200:3.0:1734257704.735839:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257704.735842:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257704.735845:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734257704.735847:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257704.735852:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257704.735854:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000200:3.0:1734257704.735854:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 00000800:00000010:2.0:1734257704.735856:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:2.0:1734257704.735860:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257704.735864:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257704.735867:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:2.0:1734257704.735868:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:2.0:1734257704.735874:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098208000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257720 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257704.737024:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257704.737027:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:2.0:1734257704.737031:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257704.737034:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257704.737037:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:2.0:1734257704.737039:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:2.0:1734257704.737043:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098208128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257714 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257704.738455:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257704.738469:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b100 00000400:00000200:0.0:1734257704.738476:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc19 [1] + 224 00000400:00000200:0.0:1734257704.738485:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257704.738487:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257704.738495:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098208000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257720 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257704.738527:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257704.738531:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b180 00000400:00000200:0.0:1734257704.738536:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc21 [1] + 0 00000400:00000200:0.0:1734257704.738548:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257704.738551:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257704.738554:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098208128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257714 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257704.738614:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257704.738625:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257704.738626:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257704.738630:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098208128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257714 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257704.738637:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098208128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257714 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:3.0:1734257704.738654:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 00000400:00000010:1.0:1734257704.739435:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257704.739441:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257704.739443:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257704.739448:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098208000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257720 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257704.739455:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098208000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257720 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257704.739469:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257704.739479:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734257704.739482:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 02000000:00000010:3.0:1734257704.746033:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257704.746045:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257704.746049:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734257709.740859:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257709.740882:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257709.740942:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257709.740948:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734257709.740966:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257709.740974:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257709.740980:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257709.740987:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098208256, portal 25 00000400:00000010:1.0:1734257709.740991:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734257709.740993:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098208256, offset 0 00000400:00000200:1.0:1734257709.741006:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257709.741018:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257709.741027:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257709.741031:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257709.741035:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257709.741037:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257709.741040:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [359:359:256:4294967295] 192.168.202.108@tcp LPNI seq info [358:358:8:4294967295] 00000400:00000200:1.0:1734257709.741048:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257709.741052:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257709.741056:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734257709.741061:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257709.741068:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257709.741072:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257709.741147:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257709.741152:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257709.741155:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257709.741158:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098208384, portal 10 00000400:00000010:2.0:1734257709.741162:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734257709.741164:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098208384, offset 0 00000400:00000200:2.0:1734257709.741168:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257709.741172:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257709.741174:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1734257709.741179:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257709.741182:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:2.0:1734257709.741187:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257709.741189:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257709.741189:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257709.741190:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257709.741192:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [360:360:255:4294967295] 192.168.202.108@tcp LPNI seq info [359:359:7:4294967295] 00000400:00000200:0.0:1734257709.741194:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257709.741197:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000200:2.0:1734257709.741197:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257709.741200:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:0.0:1734257709.741203:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000800:00000010:2.0:1734257709.741203:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257709.741206:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257709.741209:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:0.0:1734257709.741210:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098208256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257725 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257709.741211:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257709.741240:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257709.741242:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257709.741245:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257709.741247:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257709.741249:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734257709.741250:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734257709.741253:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098208384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257719 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257709.743676:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257709.743698:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b200 00000400:00000200:0.0:1734257709.743707:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc29 [1] + 224 00000400:00000200:0.0:1734257709.743726:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257709.743730:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257709.743750:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098208256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257725 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257709.746772:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257709.746789:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b280 00000400:00000010:1.0:1734257709.746899:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257709.746904:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257709.746906:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257709.746917:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098208256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257725 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257709.746926:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098208256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257725 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257709.746955:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257709.746959:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734257709.746963:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734257709.747031:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc31 [1] + 0 00000400:00000200:0.0:1734257709.747052:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257709.747056:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257709.747063:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098208384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257719 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257709.748401:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257709.748410:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257709.748412:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257709.748421:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098208384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257719 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257709.748429:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098208384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257719 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257709.748453:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257709.748459:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257709.748464:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257714.747691:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257714.747737:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257714.747792:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257714.747800:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257714.747860:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257714.747878:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257714.747886:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257714.747897:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098208512, portal 25 00000400:00000010:1.0:1734257714.747904:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734257714.747906:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098208512, offset 0 00000400:00000200:1.0:1734257714.747916:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257714.747932:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257714.747942:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257714.747945:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257714.747949:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257714.747951:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257714.747953:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [361:361:256:4294967295] 192.168.202.108@tcp LPNI seq info [360:360:8:4294967295] 00000400:00000200:1.0:1734257714.747961:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257714.747966:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257714.747970:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734257714.747976:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257714.747985:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257714.747989:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257714.748088:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257714.748093:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257714.748097:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257714.748102:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098208640, portal 10 00000400:00000010:2.0:1734257714.748107:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734257714.748110:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098208640, offset 0 00000400:00000200:2.0:1734257714.748115:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257714.748119:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257714.748122:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257714.748124:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257714.748134:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257714.748136:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257714.748138:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [362:362:255:4294967295] 192.168.202.108@tcp LPNI seq info [361:361:7:4294967295] 00000400:00000200:2.0:1734257714.748143:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257714.748146:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257714.748150:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257714.748153:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257714.748156:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257714.748158:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257714.749377:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257714.749383:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734257714.749392:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257714.749401:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257714.749406:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734257714.749408:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734257714.749419:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098208512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257730 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257714.749492:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257714.749494:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257714.749497:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257714.749500:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257714.749502:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734257714.749503:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734257714.749507:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098208640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257724 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257714.751285:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257714.751305:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b380 00000400:00000200:0.0:1734257714.751313:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc41 [1] + 0 00000400:00000200:0.0:1734257714.751337:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257714.751341:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257714.751352:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098208640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257724 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257714.751620:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257714.751627:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257714.751629:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257714.751634:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098208640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257724 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257714.751641:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098208640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257724 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257714.751675:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257714.751683:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257714.751690:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734257714.752633:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257714.752646:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b300 00000400:00000200:0.0:1734257714.752652:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc39 [1] + 224 00000400:00000200:0.0:1734257714.752669:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257714.752673:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257714.752681:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098208512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257730 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257714.753062:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257714.753067:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257714.753069:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257714.753074:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098208512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257730 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257714.753080:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098208512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257730 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257714.753100:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257714.753104:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734257714.753107:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734257719.755735:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257719.755762:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257719.755843:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257719.755852:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257719.755975:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257719.755984:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257719.755992:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257719.756000:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098208768, portal 25 00000400:00000010:3.0:1734257719.756005:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734257719.756007:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098208768, offset 0 00000400:00000200:3.0:1734257719.756016:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257719.756031:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257719.756037:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257719.756040:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257719.756043:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257719.756046:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257719.756049:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [363:363:256:4294967295] 192.168.202.108@tcp LPNI seq info [362:362:8:4294967295] 00000400:00000200:3.0:1734257719.756058:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257719.756065:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257719.756069:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734257719.756076:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257719.756084:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257719.756089:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257719.756159:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257719.756165:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257719.756168:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257719.756171:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098208896, portal 10 00000400:00000010:2.0:1734257719.756177:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734257719.756178:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098208896, offset 0 00000400:00000200:2.0:1734257719.756183:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257719.756188:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257719.756191:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257719.756193:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257719.756195:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257719.756218:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257719.756221:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [364:364:255:4294967295] 192.168.202.108@tcp LPNI seq info [363:363:7:4294967295] 00000400:00000200:2.0:1734257719.756228:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257719.756232:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257719.756235:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257719.756237:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257719.756244:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257719.756246:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257719.756253:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257719.756257:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734257719.756260:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257719.756264:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257719.756268:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734257719.756270:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734257719.756276:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098208768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257735 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257719.756305:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257719.756307:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257719.756309:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257719.756312:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257719.756314:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734257719.756315:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734257719.756318:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098208896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257729 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257719.758496:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257719.758515:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b480 00000400:00000200:0.0:1734257719.758524:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc51 [1] + 0 00000400:00000200:0.0:1734257719.758535:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257719.758538:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257719.758549:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098208896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257729 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257719.758610:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257719.758614:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b400 00000400:00000200:0.0:1734257719.758633:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc49 [1] + 224 00000400:00000200:0.0:1734257719.758646:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257719.758649:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257719.758654:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098208768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257735 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257719.758841:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257719.758853:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257719.758856:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257719.758861:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098208768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257735 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257719.758868:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098208768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257735 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257719.758899:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257719.758906:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734257719.758910:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:2.0:1734257719.759320:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257719.759326:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257719.759327:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257719.759332:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098208896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257729 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257719.759339:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098208896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257729 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257719.759358:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257719.759362:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257719.759366:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734257724.763752:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257724.763776:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257724.763839:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257724.763846:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734257724.763869:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257724.763877:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257724.763884:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257724.763891:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098209024, portal 25 00000400:00000010:3.0:1734257724.763895:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734257724.763898:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098209024, offset 0 00000400:00000200:3.0:1734257724.763906:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257724.763920:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257724.763925:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257724.763928:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257724.763931:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257724.763933:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257724.763936:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [365:365:256:4294967295] 192.168.202.108@tcp LPNI seq info [364:364:8:4294967295] 02000000:00000010:2.0:1734257724.763938:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257724.763944:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:3.0:1734257724.763945:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:2.0:1734257724.763948:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000800:00000200:3.0:1734257724.763950:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734257724.763951:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098209152, portal 10 00000800:00000010:3.0:1734257724.763954:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000400:00000010:2.0:1734257724.763956:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734257724.763957:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098209152, offset 0 00000800:00000200:3.0:1734257724.763959:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257724.763962:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257724.763968:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734257724.763968:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257724.763970:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257724.763972:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734257724.763972:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257724.763974:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257724.763976:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257724.763992:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [366:366:255:4294967295] 192.168.202.108@tcp LPNI seq info [365:365:7:4294967295] 00000400:00000200:2.0:1734257724.764004:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257724.764007:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257724.764011:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257724.764014:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257724.764018:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257724.764020:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257724.766594:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257724.766601:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734257724.766608:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257724.766615:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257724.766630:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734257724.766632:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734257724.766642:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098209024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257740 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257724.766720:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257724.766722:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257724.766724:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257724.766727:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257724.766729:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734257724.766731:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734257724.766735:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098209152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257734 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257724.769764:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257724.769787:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b580 00000400:00000200:0.0:1734257724.769796:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc61 [1] + 0 00000400:00000200:0.0:1734257724.769820:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257724.769824:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257724.769843:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098209152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257734 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257724.769979:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257724.769984:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257724.769987:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257724.770855:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098209152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257734 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257724.770867:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098209152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257734 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257724.770904:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257724.770911:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257724.770916:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734257724.772094:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257724.772111:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b500 00000400:00000200:0.0:1734257724.772119:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc59 [1] + 224 00000400:00000200:0.0:1734257724.772138:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257724.772141:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257724.772150:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098209024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257740 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257724.772316:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257724.772321:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257724.772323:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257724.772335:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098209024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257740 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257724.772341:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098209024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257740 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257724.772360:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257724.772364:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734257724.772368:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257729.771734:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257729.771761:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257729.771821:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257729.771828:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734257729.771926:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257729.771948:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257729.771955:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257729.771962:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098209280, portal 25 00000400:00000010:1.0:1734257729.771967:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734257729.771969:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098209280, offset 0 00000400:00000200:1.0:1734257729.771979:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257729.771992:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257729.771999:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257729.772002:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257729.772006:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257729.772008:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257729.772011:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [367:367:256:4294967295] 192.168.202.108@tcp LPNI seq info [366:366:8:4294967295] 00000400:00000200:1.0:1734257729.772019:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257729.772024:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257729.772029:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734257729.772035:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257729.772044:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257729.772048:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257729.772123:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257729.772128:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257729.772131:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257729.772134:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098209408, portal 10 00000400:00000010:2.0:1734257729.772139:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734257729.772140:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098209408, offset 0 00000400:00000200:2.0:1734257729.772144:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257729.772149:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257729.772151:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257729.772154:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257729.772156:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257729.772157:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257729.772159:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [368:368:255:4294967295] 192.168.202.108@tcp LPNI seq info [367:367:7:4294967295] 00000400:00000200:2.0:1734257729.772172:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257729.772175:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257729.772178:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257729.772180:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257729.772184:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257729.772185:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257729.774216:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257729.774223:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734257729.774230:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257729.774239:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257729.774245:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734257729.774247:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734257729.774256:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098209280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257745 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257729.774332:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257729.774333:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257729.774336:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257729.774339:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257729.774341:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734257729.774343:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734257729.774347:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098209408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257739 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257729.778087:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257729.778124:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b680 00000400:00000200:0.0:1734257729.778134:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc71 [1] + 0 00000400:00000200:0.0:1734257729.778155:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257729.778160:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257729.778172:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098209408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257739 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257729.778293:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257729.778299:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257729.778301:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257729.778307:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098209408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257739 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257729.778313:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098209408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257739 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257729.778346:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257729.778353:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257729.778358:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734257729.780156:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257729.780174:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b600 00000400:00000200:0.0:1734257729.780183:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc69 [1] + 224 00000400:00000200:0.0:1734257729.780206:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257729.780210:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257729.780219:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098209280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257745 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257729.780405:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257729.780410:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257729.780412:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257729.780417:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098209280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257745 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257729.780423:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098209280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257745 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257729.780441:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257729.780447:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734257729.780450:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257734.779706:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257734.779734:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257734.779797:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257734.779805:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734257734.779899:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734257734.779903:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:2.0:1734257734.779907:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734257734.779908:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:2.0:1734257734.779914:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000400:00000010:3.0:1734257734.779914:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257734.779921:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098209536, portal 25 00000400:00000010:3.0:1734257734.779926:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:2.0:1734257734.780057:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098209664, portal 10 00000100:00000200:3.0:1734257734.780057:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098209536, offset 0 00000400:00000010:2.0:1734257734.780063:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000400:00000200:3.0:1734257734.780067:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734257734.780071:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098209664, offset 0 00000400:00000200:2.0:1734257734.780075:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257734.780081:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257734.780087:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257734.780091:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257734.780094:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257734.780096:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257734.780099:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [369:369:256:4294967295] 192.168.202.108@tcp LPNI seq info [368:368:8:4294967295] 00000400:00000200:3.0:1734257734.780107:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257734.780113:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257734.780117:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257734.780124:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257734.780125:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257734.780127:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257734.780129:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257734.780130:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257734.780132:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734257734.780132:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257734.780133:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [370:370:255:4294967295] 192.168.202.108@tcp LPNI seq info [369:369:7:4294967295] 00000800:00000200:3.0:1734257734.780136:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257734.780161:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257734.780179:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257734.780220:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257734.780255:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257734.780258:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257734.780260:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257734.780594:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257734.780597:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734257734.780603:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257734.780607:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257734.780611:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:0.0:1734257734.780612:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:0.0:1734257734.780620:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098209536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257750 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257734.780833:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257734.780835:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257734.780838:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257734.780841:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257734.780843:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734257734.780849:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734257734.780853:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098209664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257744 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257734.783598:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257734.783614:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b780 00000400:00000200:0.0:1734257734.783621:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc7d [1] + 0 00000400:00000200:0.0:1734257734.783638:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257734.783642:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257734.783652:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098209664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257744 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257734.783836:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257734.783840:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257734.783843:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257734.783847:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098209664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257744 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257734.783855:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098209664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257744 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257734.783884:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257734.783889:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257734.783893:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:0.0:1734257734.785680:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257734.785696:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b700 00000400:00000200:0.0:1734257734.785703:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc79 [1] + 224 00000400:00000200:0.0:1734257734.785719:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257734.785723:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257734.785731:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098209536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257750 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257734.785833:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257734.785838:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257734.785840:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257734.785845:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098209536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257750 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257734.785871:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098209536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257750 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257734.785892:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257734.785897:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734257734.785900:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734257739.788223:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257739.788248:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257739.788317:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257739.788326:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257739.788360:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257739.788369:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257739.788377:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257739.788403:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098209792, portal 25 00000400:00000010:1.0:1734257739.788410:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734257739.788413:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098209792, offset 0 00000400:00000200:1.0:1734257739.788425:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257739.788442:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257739.788450:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257739.788454:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257739.788458:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257739.788461:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257739.788464:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [371:371:256:4294967295] 192.168.202.108@tcp LPNI seq info [370:370:8:4294967295] 00000400:00000200:1.0:1734257739.788474:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257739.788479:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257739.788484:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734257739.788491:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257739.788540:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257739.788545:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257739.788634:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257739.788641:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257739.788645:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257739.788648:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098209920, portal 10 00000400:00000010:2.0:1734257739.788653:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734257739.788654:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098209920, offset 0 00000400:00000200:2.0:1734257739.788660:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257739.788665:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257739.788667:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257739.788669:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257739.788671:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257739.788673:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257739.788675:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [372:372:255:4294967295] 192.168.202.108@tcp LPNI seq info [371:371:7:4294967295] 00000400:00000200:2.0:1734257739.788680:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257739.788683:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257739.788693:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257739.788696:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257739.788700:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257739.788702:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257739.788931:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257739.788934:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734257739.788938:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257739.788943:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257739.788946:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:0.0:1734257739.788948:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:0.0:1734257739.788955:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098209792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257755 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257739.789041:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257739.789043:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257739.789045:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257739.789048:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257739.789049:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734257739.789050:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734257739.789053:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098209920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257749 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257739.794763:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257739.794786:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b880 00000400:00000200:0.0:1734257739.794797:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xc91 [1] + 0 00000400:00000200:0.0:1734257739.794824:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257739.794829:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257739.794841:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098209920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257749 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257739.795087:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257739.795094:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257739.795096:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257739.795102:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098209920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257749 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257739.795109:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098209920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257749 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257739.795143:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257739.795151:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257739.795156:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734257739.799033:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257739.799055:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b800 00000400:00000200:0.0:1734257739.799065:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc89 [1] + 224 00000400:00000200:0.0:1734257739.799098:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257739.799102:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257739.799113:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098209792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257755 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257739.807428:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257739.807445:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257739.807447:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257739.807460:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098209792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257755 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257739.807470:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098209792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257755 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257739.807498:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257739.807515:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734257739.807520:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257744.795691:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257744.795711:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257744.795767:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257744.795773:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257744.795801:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257744.795808:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257744.795813:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257744.795819:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098210048, portal 25 00000400:00000010:1.0:1734257744.795823:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734257744.795833:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098210048, offset 0 00000400:00000200:1.0:1734257744.795840:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257744.795851:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257744.795855:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257744.795859:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257744.795862:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257744.795864:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257744.795867:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [373:373:256:4294967295] 192.168.202.108@tcp LPNI seq info [372:372:8:4294967295] 00000400:00000200:1.0:1734257744.795874:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257744.795878:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257744.795882:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734257744.795887:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257744.795893:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257744.795896:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257744.796019:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257744.796022:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734257744.796028:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257744.796032:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257744.796035:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:0.0:1734257744.796036:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:0.0:1734257744.796042:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098210048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257760 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257744.796100:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257744.796103:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257744.796106:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257744.796108:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098210176, portal 10 00000400:00000010:2.0:1734257744.796111:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734257744.796113:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098210176, offset 0 00000400:00000200:2.0:1734257744.796116:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257744.796120:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257744.796122:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257744.796124:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257744.796126:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257744.796127:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257744.796129:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [374:374:256:4294967295] 192.168.202.108@tcp LPNI seq info [373:373:8:4294967295] 00000400:00000200:2.0:1734257744.796134:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257744.796137:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257744.796140:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257744.796147:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257744.796150:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257744.796152:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257744.796562:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257744.796564:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257744.796568:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257744.796588:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257744.796590:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:0.0:1734257744.796591:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734257744.796595:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098210176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257754 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257744.801493:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257744.801510:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60b900 00000400:00000200:0.0:1734257744.801517:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xc99 [1] + 224 00000400:00000200:0.0:1734257744.801536:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257744.801539:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257744.801634:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098210048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257760 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257744.801670:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257744.801674:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60b980 00000400:00000200:0.0:1734257744.801679:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xca1 [1] + 0 00000400:00000200:0.0:1734257744.801687:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257744.801690:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257744.801695:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098210176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257754 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257744.801703:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257744.801708:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257744.801710:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257744.801716:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098210048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257760 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257744.801726:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098210048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257760 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257744.801747:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257744.801752:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734257744.801756:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:2.0:1734257744.803780:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257744.803790:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257744.803791:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257744.803800:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098210176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257754 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257744.803808:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098210176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257754 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257744.803827:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257744.803831:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257744.803834:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734257749.803684:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257749.803722:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734257749.803784:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257749.803791:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734257749.803894:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257749.803901:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257749.803906:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257749.803913:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098210304, portal 25 00000400:00000010:1.0:1734257749.803917:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734257749.803919:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098210304, offset 0 00000400:00000200:1.0:1734257749.803927:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257749.803945:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257749.803950:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257749.803955:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257749.803958:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257749.803959:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257749.803962:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [375:375:256:4294967295] 192.168.202.108@tcp LPNI seq info [374:374:8:4294967295] 00000400:00000200:1.0:1734257749.803970:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257749.803975:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257749.803978:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734257749.803983:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257749.803991:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257749.803994:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257749.804120:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257749.804123:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734257749.804126:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257749.804129:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257749.804132:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:0.0:1734257749.804133:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:0.0:1734257749.804140:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098210304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257765 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257749.804276:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257749.804280:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257749.804283:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257749.804285:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098210432, portal 10 00000400:00000010:2.0:1734257749.804288:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734257749.804289:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098210432, offset 0 00000400:00000200:2.0:1734257749.804293:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257749.804297:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257749.804299:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257749.804301:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257749.804303:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257749.804305:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257749.804307:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [376:376:256:4294967295] 192.168.202.108@tcp LPNI seq info [375:375:8:4294967295] 00000400:00000200:2.0:1734257749.804312:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257749.804315:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257749.804317:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257749.804319:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257749.804326:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257749.804328:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257749.804387:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257749.804389:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257749.804391:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257749.804394:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257749.804395:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:0.0:1734257749.804396:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:0.0:1734257749.804399:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098210432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257759 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257749.810107:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257749.810126:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ba80 00000400:00000200:0.0:1734257749.810134:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xcb1 [1] + 0 00000400:00000200:0.0:1734257749.810154:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257749.810157:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257749.810168:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098210432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257759 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257749.810441:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734257749.810446:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:2.0:1734257749.810449:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257749.810454:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098210432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257759 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257749.810461:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098210432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257759 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257749.810486:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257749.810491:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257749.810497:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734257749.811317:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257749.811326:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ba00 00000400:00000200:0.0:1734257749.811331:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xca9 [1] + 224 00000400:00000200:0.0:1734257749.811348:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257749.811357:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257749.811369:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098210304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257765 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257749.811514:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257749.811518:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257749.811519:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257749.811524:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098210304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257765 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257749.811534:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098210304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257765 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257749.811545:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257749.811548:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734257749.811549:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257754.812013:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257754.812033:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 02000000:00000010:1.0:1734257754.812154:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257754.812161:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257754.812167:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257754.812173:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098210560, portal 25 00000400:00000010:1.0:1734257754.812177:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734257754.812178:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098210560, offset 0 00000400:00000200:1.0:1734257754.812186:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257754.812196:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257754.812201:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257754.812214:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257754.812216:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257754.812218:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257754.812221:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [377:377:256:4294967295] 192.168.202.108@tcp LPNI seq info [376:376:8:4294967295] 00000400:00000200:1.0:1734257754.812228:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257754.812232:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257754.812235:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734257754.812240:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257754.812246:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257754.812249:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257754.812488:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257754.812494:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 00000800:00000200:1.0:1734257754.812610:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257754.812613:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:1.0:1734257754.812616:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257754.812620:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257754.812624:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:1.0:1734257754.812625:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734257754.812630:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098210560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257770 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257754.812695:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257754.812700:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734257754.812703:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257754.812705:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098210688, portal 10 00000400:00000010:2.0:1734257754.812710:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734257754.812711:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098210688, offset 0 00000400:00000200:2.0:1734257754.812715:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257754.812720:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257754.812722:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257754.812724:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257754.812726:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257754.812727:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257754.812729:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [378:378:255:4294967295] 192.168.202.108@tcp LPNI seq info [377:377:7:4294967295] 00000400:00000200:2.0:1734257754.812735:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257754.812738:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257754.812741:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257754.812743:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257754.812747:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257754.812754:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257754.813052:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257754.813054:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734257754.813057:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257754.813060:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257754.813063:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:1.0:1734257754.813064:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:1.0:1734257754.813067:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098210688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257764 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734257754.816607:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:2.0:1734257754.816624:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60bb00 00000400:00000200:2.0:1734257754.816631:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xcb9 [1] + 224 00000400:00000200:2.0:1734257754.816641:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257754.816645:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:2.0:1734257754.816654:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098210560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257770 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734257754.816701:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:2.0:1734257754.816705:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60bb80 00000400:00000200:2.0:1734257754.816710:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xcc1 [1] + 0 00000400:00000200:2.0:1734257754.816722:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257754.816725:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:2.0:1734257754.816729:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098210688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257764 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257754.816854:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257754.816859:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257754.816860:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257754.816865:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098210560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257770 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257754.816881:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098210560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257770 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257754.816901:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257754.816904:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734257754.816908:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:3.0:1734257754.816995:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:3.0:1734257754.816999:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:3.0:1734257754.817000:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:3.0:1734257754.817004:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098210688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257764 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257754.817009:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098210688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257764 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257754.817024:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734257754.817028:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257754.817031:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734257759.819708:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257759.819727:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257759.819862:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257759.819869:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257759.819874:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257759.819880:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257759.819886:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257759.819893:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098210816, portal 25 00000400:00000010:1.0:1734257759.819896:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734257759.819898:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098210816, offset 0 00000400:00000200:1.0:1734257759.819905:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257759.819915:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257759.819919:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257759.819922:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257759.819924:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257759.819926:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257759.819928:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [379:379:256:4294967295] 192.168.202.108@tcp LPNI seq info [378:378:8:4294967295] 00000400:00000200:1.0:1734257759.819935:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:2.0:1734257759.819939:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000800:00000200:1.0:1734257759.819940:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257759.819943:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000400:00000010:2.0:1734257759.819943:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257759.819946:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000800:00000200:1.0:1734257759.819947:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:2.0:1734257759.819948:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098210944, portal 10 00000400:00000010:2.0:1734257759.819951:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734257759.819953:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098210944, offset 0 00000800:00000200:1.0:1734257759.819954:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257759.819956:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257759.819960:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734257759.819962:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257759.819962:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257759.819963:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257759.819965:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257759.819966:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257759.819968:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [380:380:255:4294967295] 192.168.202.108@tcp LPNI seq info [379:379:7:4294967295] 00000400:00000200:2.0:1734257759.819973:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257759.819986:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257759.819988:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257759.819990:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257759.819994:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257759.819995:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257759.820133:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257759.820135:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734257759.820138:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257759.820142:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257759.820145:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:0.0:1734257759.820147:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734257759.820153:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098210816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257775 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257759.820558:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257759.820561:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257759.820563:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257759.820566:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257759.820583:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734257759.820584:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734257759.820588:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098210944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257769 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257759.822339:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257759.822366:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60bc00 00000400:00000200:0.0:1734257759.822373:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xcc9 [1] + 224 00000400:00000200:0.0:1734257759.822382:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257759.822394:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257759.822400:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098210816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257775 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257759.823103:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257759.823109:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60bc80 00000400:00000200:0.0:1734257759.823114:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xcd1 [1] + 0 00000400:00000200:0.0:1734257759.823125:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257759.823128:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257759.823133:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098210944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257769 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257759.823283:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257759.823287:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257759.823289:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257759.823294:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098210944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257769 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257759.823299:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098210944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257769 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257759.823321:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257759.823327:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257759.823331:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:1.0:1734257759.823386:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257759.823390:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257759.823391:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257759.823395:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098210816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257775 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257759.823407:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098210816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257775 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257759.823415:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257759.823417:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734257759.823418:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734257764.828379:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257764.828397:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257764.828622:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257764.828630:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257764.828738:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257764.828746:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257764.828753:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257764.828760:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098211072, portal 25 00000400:00000010:1.0:1734257764.828764:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734257764.828765:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098211072, offset 0 00000400:00000200:1.0:1734257764.828775:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257764.828789:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257764.828794:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257764.828797:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257764.828801:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257764.828803:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257764.828806:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [381:381:256:4294967295] 192.168.202.108@tcp LPNI seq info [380:380:8:4294967295] 00000400:00000200:1.0:1734257764.828813:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257764.828818:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257764.828822:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734257764.828827:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257764.828835:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257764.828839:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257764.828966:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257764.828970:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:1.0:1734257764.828973:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257764.828977:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257764.828980:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:1.0:1734257764.828995:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734257764.829002:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098211072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257780 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257764.829464:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257764.829473:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257764.829476:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257764.829479:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098211200, portal 10 00000400:00000010:2.0:1734257764.829484:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734257764.829486:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098211200, offset 0 00000400:00000200:2.0:1734257764.829490:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257764.829494:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257764.829497:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257764.829499:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257764.829500:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257764.829502:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257764.829504:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [382:382:256:4294967295] 192.168.202.108@tcp LPNI seq info [381:381:8:4294967295] 00000400:00000200:2.0:1734257764.829509:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257764.829513:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257764.829522:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257764.829525:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257764.829529:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257764.829530:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257764.829911:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257764.829914:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257764.829918:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257764.829921:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257764.829924:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734257764.829926:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734257764.829931:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098211200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257774 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257764.833384:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257764.833405:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60bd80 00000400:00000200:0.0:1734257764.833414:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xce1 [1] + 0 00000400:00000200:0.0:1734257764.833425:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257764.833429:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257764.833438:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098211200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257774 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257764.833483:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257764.833487:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60bd00 00000400:00000200:0.0:1734257764.833492:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xcd9 [1] + 224 00000400:00000200:0.0:1734257764.833511:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257764.833514:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257764.833518:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098211072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257780 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257764.833814:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257764.833818:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257764.833820:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257764.833825:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098211200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257774 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257764.833830:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098211200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257774 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257764.833858:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257764.833863:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257764.833867:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:1.0:1734257764.834166:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257764.834171:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257764.834172:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257764.834177:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098211072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257780 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257764.834182:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098211072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257780 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257764.834193:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257764.834195:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734257764.834198:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257769.835718:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257769.835742:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257769.835808:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257769.835816:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257769.835852:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257769.835862:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257769.835869:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257769.835875:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098211328, portal 25 00000400:00000010:1.0:1734257769.835879:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734257769.835881:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098211328, offset 0 00000400:00000200:1.0:1734257769.835893:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257769.835905:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257769.835910:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257769.835913:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257769.835916:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257769.835918:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:2.0:1734257769.835920:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:1.0:1734257769.835921:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [383:383:256:4294967295] 192.168.202.108@tcp LPNI seq info [382:382:8:4294967295] 00000400:00000010:2.0:1734257769.835927:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000200:1.0:1734257769.835928:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257769.835932:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734257769.835932:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000800:00000010:1.0:1734257769.835936:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000100:00000200:2.0:1734257769.835938:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098211456, portal 10 00000800:00000200:1.0:1734257769.835940:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:2.0:1734257769.835943:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734257769.835944:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098211456, offset 0 00000800:00000200:1.0:1734257769.835948:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257769.835951:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257769.835960:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734257769.835961:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257769.835964:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257769.835967:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257769.835970:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257769.835972:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257769.835974:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [384:384:255:4294967295] 192.168.202.108@tcp LPNI seq info [383:383:7:4294967295] 00000400:00000200:2.0:1734257769.835981:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257769.835985:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257769.835988:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257769.836001:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257769.836007:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257769.836010:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257769.836093:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257769.836100:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734257769.836104:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257769.836108:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257769.836112:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:0.0:1734257769.836113:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:0.0:1734257769.836121:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098211328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257785 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257769.836330:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257769.836335:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257769.836338:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257769.836341:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257769.836344:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734257769.836345:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734257769.836348:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098211456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257769.838406:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257769.838424:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60be00 00000400:00000200:0.0:1734257769.838446:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xce9 [1] + 224 00000400:00000200:0.0:1734257769.838458:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257769.838468:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257769.838479:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098211328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257785 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257769.838516:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257769.838520:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60be80 00000400:00000200:0.0:1734257769.838525:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xcf1 [1] + 0 00000400:00000200:0.0:1734257769.838539:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257769.838543:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257769.838548:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098211456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257779 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257769.838550:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257769.838554:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257769.838556:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257769.838560:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098211328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257785 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257769.838564:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098211328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257785 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257769.838610:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257769.838615:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 02000000:00000010:1.0:1734257769.838617:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 00000400:00000010:2.0:1734257769.838617:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 02000000:00000010:1.0:1734257769.838621:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000200:2.0:1734257769.838622:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098211456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:1.0:1734257769.838625:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000200:2.0:1734257769.838629:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098211456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257779 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257769.838650:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257769.838654:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257769.838657:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734257774.843717:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257774.843736:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257774.843795:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257774.843801:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257774.843836:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734257774.843845:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257774.843851:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257774.843856:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098211584, portal 25 00000400:00000010:1.0:1734257774.843860:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734257774.843862:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098211584, offset 0 00000400:00000200:1.0:1734257774.843870:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734257774.843880:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:1.0:1734257774.843884:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734257774.843885:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000200:1.0:1734257774.843889:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257774.843892:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:2.0:1734257774.843892:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000400:00000200:1.0:1734257774.843895:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:2.0:1734257774.843895:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098211712, portal 10 00000400:00000200:1.0:1734257774.843896:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257774.843899:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [385:385:256:4294967295] 192.168.202.108@tcp LPNI seq info [384:384:8:4294967295] 00000400:00000010:2.0:1734257774.843901:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734257774.843902:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098211712, offset 0 00000400:00000200:2.0:1734257774.843906:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257774.843907:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257774.843912:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257774.843912:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257774.843914:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734257774.843915:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000400:00000200:2.0:1734257774.843916:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257774.843918:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257774.843919:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734257774.843920:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257774.843921:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [386:386:255:4294967295] 192.168.202.108@tcp LPNI seq info [385:385:7:4294967295] 00000800:00000200:1.0:1734257774.843926:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257774.843927:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257774.843929:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734257774.843931:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257774.843933:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257774.843936:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257774.843945:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257774.843947:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257774.843995:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257774.843997:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734257774.844001:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257774.844004:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257774.844006:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734257774.844007:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734257774.844013:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098211584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257790 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257774.844061:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257774.844063:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257774.844065:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257774.844067:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257774.844069:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734257774.844070:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734257774.844079:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098211712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257784 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257774.846160:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257774.846175:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60bf00 00000400:00000200:0.0:1734257774.846181:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xcf9 [1] + 224 00000400:00000200:0.0:1734257774.846191:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257774.846194:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257774.846203:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098211584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257790 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257774.846246:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257774.846250:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60bf80 00000400:00000200:0.0:1734257774.846254:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd01 [1] + 0 00000400:00000200:0.0:1734257774.846267:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257774.846270:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257774.846274:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098211712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257784 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257774.846385:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257774.846390:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257774.846391:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257774.846396:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098211712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257784 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257774.846403:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098211712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257784 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257774.846425:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 00000400:00000010:1.0:1734257774.846428:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 02000000:00000010:2.0:1734257774.846429:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000400:00000200:1.0:1734257774.846432:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257774.846433:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000010:2.0:1734257774.846433:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000200:1.0:1734257774.846438:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098211584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257790 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257774.846444:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098211584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257790 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257774.846455:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734257774.846457:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734257774.846459:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257779.851742:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257779.851762:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257779.851826:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257779.851832:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734257779.852302:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734257779.852310:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257779.852316:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257779.852321:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098211840, portal 25 00000400:00000010:3.0:1734257779.852325:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734257779.852327:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098211840, offset 0 00000400:00000200:3.0:1734257779.852334:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257779.852347:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257779.852351:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257779.852355:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257779.852358:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257779.852359:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257779.852362:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [387:387:256:4294967295] 192.168.202.108@tcp LPNI seq info [386:386:8:4294967295] 00000400:00000200:3.0:1734257779.852369:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257779.852387:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257779.852390:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734257779.852395:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257779.852402:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257779.852406:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257779.852521:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257779.852524:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:3.0:1734257779.852526:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257779.852530:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257779.852534:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:3.0:1734257779.852536:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734257779.852541:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098211840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257795 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257779.852981:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257779.852987:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257779.852991:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257779.852993:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098211968, portal 10 00000400:00000010:2.0:1734257779.852997:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734257779.852998:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098211968, offset 0 00000400:00000200:2.0:1734257779.853003:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257779.853008:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257779.853011:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257779.853013:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257779.853015:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257779.853017:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257779.853019:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [388:388:256:4294967295] 192.168.202.108@tcp LPNI seq info [387:387:8:4294967295] 00000400:00000200:2.0:1734257779.853025:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257779.853028:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257779.853031:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257779.853034:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257779.853039:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257779.853046:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257779.853470:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257779.853472:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257779.853475:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257779.853478:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257779.853481:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734257779.853482:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734257779.853486:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098211968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257789 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257779.859946:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257779.859971:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c000 00000400:00000200:0.0:1734257779.859978:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd09 [1] + 224 00000400:00000200:0.0:1734257779.859989:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257779.859991:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257779.860001:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098211840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257795 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257779.860037:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257779.860041:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c080 00000400:00000200:0.0:1734257779.860046:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd11 [1] + 0 00000400:00000200:0.0:1734257779.860059:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257779.860062:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257779.860066:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098211968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257789 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257779.860304:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257779.860309:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257779.860311:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257779.860315:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098211968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257789 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257779.860322:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098211968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257789 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257779.860347:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257779.860352:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257779.860356:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:3.0:1734257779.860450:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257779.860454:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257779.860456:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257779.860460:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098211840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257795 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257779.860466:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098211840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257795 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257779.860478:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734257779.860481:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734257779.860483:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257784.861319:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257784.861345:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734257784.861419:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257784.861427:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257784.861538:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734257784.861546:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257784.861552:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257784.861560:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098212096, portal 25 00000400:00000010:1.0:1734257784.861565:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 00000100:00000200:1.0:1734257784.861598:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098212096, offset 0 00000400:00000200:1.0:1734257784.861607:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257784.861622:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257784.861627:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257784.861631:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257784.861635:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257784.861636:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257784.861640:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [389:389:256:4294967295] 192.168.202.108@tcp LPNI seq info [388:388:8:4294967295] 00000400:00000200:1.0:1734257784.861649:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257784.861654:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257784.861658:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734257784.861663:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257784.861672:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257784.861675:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257784.861706:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257784.861711:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257784.861714:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257784.861717:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098212224, portal 10 00000400:00000010:2.0:1734257784.861722:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734257784.861723:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098212224, offset 0 00000400:00000200:2.0:1734257784.861728:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257784.861733:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257784.861735:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257784.861737:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257784.861739:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257784.861740:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257784.861742:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [390:390:255:4294967295] 192.168.202.108@tcp LPNI seq info [389:389:7:4294967295] 00000400:00000200:2.0:1734257784.861749:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257784.861752:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257784.861754:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257784.861757:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257784.861761:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257784.861763:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734257784.861859:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257784.861861:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:3.0:1734257784.861867:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257784.861872:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257784.861875:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:3.0:1734257784.861877:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:3.0:1734257784.861885:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098212096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257800 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734257784.861977:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257784.861979:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734257784.861982:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257784.861986:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257784.861988:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:3.0:1734257784.861989:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:3.0:1734257784.861993:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098212224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257794 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257784.865101:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257784.865120:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c180 00000400:00000200:0.0:1734257784.865129:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd21 [1] + 0 00000400:00000200:0.0:1734257784.865141:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257784.865145:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257784.865169:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098212224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257794 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257784.865206:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257784.865211:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c100 00000400:00000200:0.0:1734257784.865215:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd19 [1] + 224 00000400:00000200:0.0:1734257784.865245:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257784.865248:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257784.865252:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098212096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257800 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257784.865358:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257784.865364:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257784.865366:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257784.865371:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098212224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257794 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257784.865378:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098212224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257794 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257784.865406:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257784.865411:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257784.865415:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:1.0:1734257784.865468:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257784.865477:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257784.865479:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257784.865484:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098212096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257800 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257784.865491:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098212096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257800 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257784.865502:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734257784.865505:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734257784.865507:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734257789.868640:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257789.868660:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734257789.868714:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257789.868720:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257789.868760:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734257789.868774:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257789.868779:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257789.868786:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098212352, portal 25 00000400:00000010:1.0:1734257789.868791:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734257789.868793:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098212352, offset 0 00000400:00000200:1.0:1734257789.868804:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257789.868817:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257789.868821:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257789.868824:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257789.868827:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257789.868828:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257789.868831:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [391:391:256:4294967295] 192.168.202.108@tcp LPNI seq info [390:390:8:4294967295] 00000400:00000200:1.0:1734257789.868837:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257789.868842:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257789.868846:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734257789.868851:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257789.868861:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257789.868865:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257789.868911:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257789.868916:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257789.868921:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257789.868926:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098212480, portal 10 00000400:00000010:2.0:1734257789.868930:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734257789.868932:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098212480, offset 0 00000400:00000200:2.0:1734257789.868939:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257789.868948:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257789.868952:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257789.868955:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257789.868958:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257789.868960:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257789.868962:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [392:392:255:4294967295] 192.168.202.108@tcp LPNI seq info [391:391:7:4294967295] 00000400:00000200:2.0:1734257789.868968:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257789.868973:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257789.868976:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257789.868980:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257789.868986:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257789.868989:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257789.869052:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257789.869054:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734257789.869058:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257789.869061:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257789.869064:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:0.0:1734257789.869065:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:0.0:1734257789.869072:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098212352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257789.869138:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257789.869140:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257789.869143:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257789.869145:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257789.869147:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734257789.869148:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734257789.869151:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098212480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257799 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257789.871325:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257789.871340:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c280 00000400:00000200:0.0:1734257789.871346:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd31 [1] + 0 00000400:00000200:0.0:1734257789.871355:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257789.871358:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257789.871366:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098212480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257799 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257789.871411:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257789.871415:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c200 00000400:00000200:0.0:1734257789.871419:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd29 [1] + 224 00000400:00000200:0.0:1734257789.871430:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257789.871433:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257789.871437:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098212352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257805 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257789.871709:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257789.871713:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257789.871715:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257789.871724:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098212352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257789.871730:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098212352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257805 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257789.871748:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734257789.871751:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734257789.871754:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:2.0:1734257789.871839:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257789.871846:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257789.871847:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257789.871851:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098212480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257799 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257789.871856:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098212480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257799 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257789.871871:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257789.871874:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257789.871876:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257794.875678:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257794.875695:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257794.876117:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257794.876124:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257794.876132:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734257794.876138:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 02000000:00000010:2.0:1734257794.876178:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257794.876183:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257794.876186:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257794.876193:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098212736, portal 10 00000400:00000010:2.0:1734257794.876197:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734257794.876199:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098212736, offset 0 00000400:00000200:2.0:1734257794.876206:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257794.876217:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257794.876221:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257794.876225:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257794.876227:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257794.876229:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257794.876232:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [393:393:256:4294967295] 192.168.202.108@tcp LPNI seq info [392:392:8:4294967295] 00000400:00000200:2.0:1734257794.876244:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:3.0:1734257794.876247:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000800:00000200:2.0:1734257794.876248:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734257794.876250:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098212608, portal 25 00000800:00000010:2.0:1734257794.876252:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000400:00000010:3.0:1734257794.876252:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734257794.876253:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098212608, offset 0 00000800:00000200:2.0:1734257794.876256:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257794.876257:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734257794.876262:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734257794.876262:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257794.876263:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257794.876265:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734257794.876266:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734257794.876267:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257794.876268:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257794.876270:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [394:394:255:4294967295] 192.168.202.108@tcp LPNI seq info [393:393:7:4294967295] 00000400:00000200:3.0:1734257794.876274:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257794.876278:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257794.876280:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734257794.876282:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257794.876286:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257794.876288:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257794.876360:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257794.876362:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257794.876366:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257794.876370:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257794.876373:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734257794.876374:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734257794.876380:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098212736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257804 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257794.876612:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257794.876615:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734257794.876617:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257794.876620:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257794.876622:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734257794.876623:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734257794.876627:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098212608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257810 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257794.878147:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257794.878160:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c380 00000400:00000200:0.0:1734257794.878176:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd39 [1] + 0 00000400:00000200:0.0:1734257794.878187:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257794.878190:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257794.878198:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098212736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257804 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257794.878233:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257794.878238:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c300 00000400:00000200:0.0:1734257794.878241:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd41 [1] + 224 00000400:00000200:0.0:1734257794.878252:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257794.878255:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257794.878260:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098212608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257810 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257794.878448:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257794.878453:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257794.878459:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257794.878463:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098212736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257804 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257794.878469:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098212736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257804 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257794.878493:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257794.878498:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257794.878502:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:3.0:1734257794.878546:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257794.878550:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257794.878551:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257794.878561:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098212608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257810 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257794.878621:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098212608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257810 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257794.878635:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257794.878640:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734257794.878641:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257799.883719:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257799.883743:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257799.883810:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257799.883817:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257799.883839:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734257799.883847:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257799.883854:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257799.883861:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098212864, portal 25 00000400:00000010:2.0:1734257799.883866:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734257799.883868:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098212864, offset 0 00000400:00000200:2.0:1734257799.883878:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257799.883892:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257799.883898:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257799.883901:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257799.883905:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257799.883907:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257799.883910:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [395:395:256:4294967295] 192.168.202.108@tcp LPNI seq info [394:394:8:4294967295] 00000400:00000200:2.0:1734257799.883919:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257799.883924:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257799.883928:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257799.883934:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257799.883942:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257799.883947:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257799.884464:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257799.884468:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257799.884473:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257799.884478:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257799.884481:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:0.0:1734257799.884483:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:0.0:1734257799.884490:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098212864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257815 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257799.884509:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257799.884514:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257799.884518:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257799.884520:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098212992, portal 10 00000400:00000010:3.0:1734257799.884525:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734257799.884526:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098212992, offset 0 00000400:00000200:3.0:1734257799.884531:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257799.884536:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257799.884538:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257799.884540:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257799.884542:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257799.884544:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257799.884546:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [396:396:256:4294967295] 192.168.202.108@tcp LPNI seq info [395:395:8:4294967295] 00000400:00000200:3.0:1734257799.884552:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257799.884555:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257799.884557:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257799.884560:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257799.884564:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257799.884566:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257799.884727:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257799.884730:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734257799.884732:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257799.884736:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257799.884738:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734257799.884739:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734257799.884757:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098212992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257809 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257799.885870:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257799.885882:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c400 00000400:00000200:0.0:1734257799.885891:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd49 [1] + 224 00000400:00000200:0.0:1734257799.885901:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257799.885904:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257799.885911:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098212864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257815 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257799.885946:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257799.885950:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c480 00000400:00000200:0.0:1734257799.885954:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd51 [1] + 0 00000400:00000200:0.0:1734257799.885969:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257799.885971:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257799.885975:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098212992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257809 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257799.886115:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257799.886120:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257799.886121:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257799.886131:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098212864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257815 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257799.886145:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098212864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257815 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257799.886157:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257799.886161:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257799.886163:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257799.886167:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098212992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257809 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257799.886169:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734257799.886173:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734257799.886177:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000200:3.0:1734257799.886183:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098212992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257809 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257799.886202:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257799.886205:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734257799.886208:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734257804.891714:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257804.891740:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 02000000:00000010:3.0:1734257804.892344:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734257804.892355:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257804.892363:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000010:0.0:1734257804.892370:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 00000100:00000200:3.0:1734257804.892379:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098213120, portal 25 00000400:00000010:3.0:1734257804.892384:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734257804.892387:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098213120, offset 0 02000000:00000010:0.0:1734257804.892394:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 00000400:00000200:3.0:1734257804.892397:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257804.892414:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257804.892421:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257804.892425:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257804.892429:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257804.892431:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257804.892433:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [397:397:256:4294967295] 192.168.202.108@tcp LPNI seq info [396:396:8:4294967295] 00000400:00000200:3.0:1734257804.892443:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257804.892454:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257804.892458:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734257804.892465:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257804.892475:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257804.892480:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257804.892653:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257804.892656:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734257804.892659:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257804.892665:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257804.892670:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:1.0:1734257804.892672:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:1.0:1734257804.892678:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098213120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257804.892759:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257804.892765:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257804.892770:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257804.892775:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098213248, portal 10 00000400:00000010:2.0:1734257804.892780:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734257804.892782:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098213248, offset 0 00000400:00000200:2.0:1734257804.892788:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257804.892799:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257804.892804:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257804.892806:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257804.892809:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257804.892811:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257804.892814:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [398:398:256:4294967295] 192.168.202.108@tcp LPNI seq info [397:397:8:4294967295] 00000400:00000200:2.0:1734257804.892821:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257804.892825:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257804.892829:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257804.892833:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257804.892839:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257804.892842:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257804.892941:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257804.892943:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257804.892946:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257804.892949:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257804.892951:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:0.0:1734257804.892953:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734257804.892956:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098213248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257804.895426:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257804.895458:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c500 00000400:00000200:0.0:1734257804.895467:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd59 [1] + 224 00000400:00000200:0.0:1734257804.895484:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257804.895487:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257804.895497:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098213120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257820 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257804.895611:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257804.895617:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257804.895620:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257804.895625:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098213120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257804.895651:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098213120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257820 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257804.896203:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257804.896210:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c580 00000400:00000200:0.0:1734257804.896215:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd61 [1] + 0 00000400:00000200:0.0:1734257804.896224:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257804.896227:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257804.896231:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098213248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257814 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257804.896313:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734257804.896321:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:3.0:1734257804.896325:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:2.0:1734257804.896383:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257804.896387:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257804.896388:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257804.896393:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098213248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257804.896407:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098213248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257814 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257804.896425:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257804.896429:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257804.896432:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734257809.899687:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257809.899707:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257809.899769:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257809.899775:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734257809.899854:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734257809.899861:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 02000000:00000010:2.0:1734257809.899866:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:1.0:1734257809.899867:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:2.0:1734257809.899870:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000100:00000200:1.0:1734257809.899872:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098213376, portal 25 00000400:00000010:2.0:1734257809.899874:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000400:00000010:1.0:1734257809.899875:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:2.0:1734257809.899876:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098213504, portal 10 00000100:00000200:1.0:1734257809.899877:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098213376, offset 0 00000400:00000010:2.0:1734257809.899881:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000400:00000200:1.0:1734257809.899884:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734257809.899894:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098213504, offset 0 00000400:00000200:1.0:1734257809.899896:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257809.899898:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257809.899899:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257809.899903:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257809.899905:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257809.899907:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257809.899909:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [399:399:256:4294967295] 192.168.202.108@tcp LPNI seq info [398:398:8:4294967295] 00000400:00000200:1.0:1734257809.899916:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257809.899920:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257809.899921:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734257809.899923:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000400:00000200:2.0:1734257809.899924:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257809.899926:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257809.899928:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257809.899930:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257809.899932:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [400:400:255:4294967295] 192.168.202.108@tcp LPNI seq info [399:399:7:4294967295] 00000800:00000200:1.0:1734257809.899938:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257809.899938:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257809.899942:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734257809.899945:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:2.0:1734257809.899945:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:1.0:1734257809.899948:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734257809.899948:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257809.899952:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257809.899953:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257809.900062:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257809.900065:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734257809.900068:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257809.900072:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257809.900075:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:0.0:1734257809.900076:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:0.0:1734257809.900082:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098213376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257825 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257809.900719:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257809.900722:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257809.900725:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257809.900728:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257809.900731:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734257809.900737:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734257809.900741:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098213504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257809.902977:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257809.902993:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c600 00000400:00000200:0.0:1734257809.903000:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd69 [1] + 224 00000400:00000200:0.0:1734257809.903009:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257809.903012:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257809.903020:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098213376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257825 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257809.903233:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257809.903238:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c680 00000400:00000200:0.0:1734257809.903243:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd6d [1] + 0 00000400:00000200:0.0:1734257809.903262:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257809.903265:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257809.903269:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098213504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257819 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257809.903345:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257809.903349:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257809.903351:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257809.903355:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098213376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257825 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257809.903361:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098213376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257825 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257809.903380:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734257809.903384:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734257809.903387:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:2.0:1734257809.903487:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257809.903491:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257809.903492:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257809.903496:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098213504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257809.903512:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098213504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257819 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257809.903526:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257809.903530:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257809.903532:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257814.907679:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257814.907697:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257814.907755:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257814.907761:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257814.907855:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734257814.907862:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257814.907867:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257814.907873:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098213632, portal 25 00000400:00000010:1.0:1734257814.907876:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734257814.907878:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098213632, offset 0 00000400:00000200:1.0:1734257814.908011:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257814.908023:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257814.908027:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257814.908031:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257814.908034:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257814.908036:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257814.908038:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [401:401:256:4294967295] 192.168.202.108@tcp LPNI seq info [400:400:8:4294967295] 00000400:00000200:1.0:1734257814.908044:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257814.908049:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257814.908052:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734257814.908057:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257814.908063:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257814.908075:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257814.908105:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257814.908117:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257814.908123:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257814.908128:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098213760, portal 10 00000400:00000010:3.0:1734257814.908134:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734257814.908136:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098213760, offset 0 00000400:00000200:3.0:1734257814.908143:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257814.908153:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257814.908157:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257814.908159:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257814.908162:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257814.908164:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257814.908166:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [402:402:255:4294967295] 192.168.202.108@tcp LPNI seq info [401:401:7:4294967295] 00000400:00000200:3.0:1734257814.908173:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257814.908178:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257814.908182:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734257814.908186:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257814.908193:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257814.908196:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257814.908244:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257814.908247:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734257814.908250:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257814.908255:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257814.908258:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:0.0:1734257814.908260:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:0.0:1734257814.908266:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098213632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257814.908328:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257814.908330:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734257814.908332:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257814.908335:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257814.908337:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734257814.908338:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734257814.908342:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098213760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257814.911218:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257814.911234:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c780 00000400:00000200:0.0:1734257814.911241:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd81 [1] + 0 00000400:00000200:0.0:1734257814.911249:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257814.911252:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257814.911260:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098213760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257824 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257814.911293:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257814.911296:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c700 00000400:00000200:0.0:1734257814.911300:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd79 [1] + 224 00000400:00000200:0.0:1734257814.911312:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257814.911314:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257814.911318:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098213632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257830 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257814.911511:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257814.911515:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257814.911517:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257814.911522:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098213632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257814.911528:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098213632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257830 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257814.911549:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734257814.911554:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734257814.911557:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:3.0:1734257814.911739:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257814.911743:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257814.911745:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257814.911749:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098213760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257814.911766:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098213760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257824 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257814.911785:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257814.911788:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257814.911790:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734257819.915789:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257819.915806:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257819.915861:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257819.915867:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257819.915932:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257819.915939:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257819.915944:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257819.915950:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098214016, portal 10 00000400:00000010:3.0:1734257819.915955:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734257819.915957:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098214016, offset 0 00000400:00000200:3.0:1734257819.915964:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257819.915975:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257819.915980:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257819.915983:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257819.915987:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257819.915988:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257819.915991:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [403:403:256:4294967295] 192.168.202.108@tcp LPNI seq info [402:402:8:4294967295] 00000400:00000200:3.0:1734257819.915998:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257819.916003:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257819.916006:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734257819.916011:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257819.916018:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257819.916021:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257819.916162:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257819.916165:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734257819.916177:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257819.916181:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257819.916184:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734257819.916186:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734257819.916192:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098214016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257829 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257819.916261:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734257819.916266:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257819.916269:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257819.916271:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098213888, portal 25 00000400:00000010:2.0:1734257819.916274:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734257819.916275:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098213888, offset 0 00000400:00000200:2.0:1734257819.916279:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257819.916283:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257819.916285:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257819.916287:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257819.916289:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257819.916290:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257819.916292:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [404:404:256:4294967295] 192.168.202.108@tcp LPNI seq info [403:403:8:4294967295] 00000400:00000200:2.0:1734257819.916299:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257819.916302:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257819.916304:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257819.916306:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257819.916309:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257819.916311:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257819.916474:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257819.916476:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257819.916479:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257819.916482:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257819.916484:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734257819.916485:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734257819.916489:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098213888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257835 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257819.918010:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257819.918023:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c880 00000400:00000200:0.0:1734257819.918029:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xd89 [1] + 0 00000400:00000200:0.0:1734257819.918045:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257819.918048:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257819.918056:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098214016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257829 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257819.918119:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257819.918124:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257819.918125:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257819.918130:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098214016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257829 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257819.918148:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098214016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257829 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257819.918169:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257819.918174:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257819.918177:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734257819.918320:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257819.918327:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c800 00000400:00000200:0.0:1734257819.918332:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd91 [1] + 224 00000400:00000200:0.0:1734257819.918342:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257819.918345:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257819.918350:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098213888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257835 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257819.918620:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257819.918624:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257819.918625:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257819.918629:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098213888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257835 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257819.918645:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098213888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257835 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257819.918657:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734257819.918660:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734257819.918662:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257824.923697:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257824.923726:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257824.923788:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257824.923795:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257824.923930:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257824.923937:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257824.923943:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257824.923949:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098214144, portal 25 00000400:00000010:1.0:1734257824.923952:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734257824.923954:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098214144, offset 0 00000400:00000200:1.0:1734257824.923962:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257824.923974:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257824.923979:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:2.0:1734257824.923982:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:1.0:1734257824.923983:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257824.923986:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257824.923988:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:2.0:1734257824.923989:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000200:1.0:1734257824.923990:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [405:405:256:4294967295] 192.168.202.108@tcp LPNI seq info [404:404:8:4294967295] 00000400:00000010:2.0:1734257824.923994:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257824.923997:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098214272, portal 10 00000400:00000200:1.0:1734257824.923998:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257824.924003:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734257824.924003:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734257824.924005:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098214272, offset 0 00000800:00000010:1.0:1734257824.924006:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734257824.924011:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257824.924011:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734257824.924017:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257824.924019:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734257824.924021:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257824.924022:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257824.924025:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257824.924027:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257824.924029:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257824.924031:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [406:406:255:4294967295] 192.168.202.108@tcp LPNI seq info [405:405:7:4294967295] 00000400:00000200:2.0:1734257824.924038:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257824.924043:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257824.924047:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257824.924052:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257824.924057:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257824.924060:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257824.924133:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257824.924136:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734257824.924140:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257824.924144:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257824.924147:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:0.0:1734257824.924149:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:0.0:1734257824.924156:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098214144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257840 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257824.924361:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257824.924363:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257824.924367:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257824.924370:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257824.924373:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734257824.924374:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734257824.924377:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098214272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257834 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257824.926438:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257824.926455:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60c900 00000400:00000200:0.0:1734257824.926462:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xd99 [1] + 224 00000400:00000200:0.0:1734257824.926472:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257824.926475:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257824.926483:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098214144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257840 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257824.926520:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257824.926525:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60c980 00000400:00000200:0.0:1734257824.926529:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xda1 [1] + 0 00000400:00000200:0.0:1734257824.926545:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257824.926554:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257824.926558:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098214272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257834 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257824.926881:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257824.926886:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257824.926888:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257824.926893:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098214144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257840 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257824.926899:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098214144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257840 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257824.926919:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734257824.926924:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734257824.926927:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:2.0:1734257824.927047:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257824.927052:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257824.927053:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257824.927058:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098214272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257834 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257824.927073:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098214272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257834 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257824.927090:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257824.927094:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257824.927097:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734257829.932480:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257829.932507:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 02000000:00000010:1.0:1734257829.932654:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257829.932663:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257829.932671:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257829.932679:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098214400, portal 25 00000400:00000010:1.0:1734257829.932684:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734257829.932686:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098214400, offset 0 00000400:00000200:1.0:1734257829.932700:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257829.932716:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257829.932722:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257829.932726:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257829.932729:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257829.932731:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257829.932734:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [407:407:256:4294967295] 192.168.202.108@tcp LPNI seq info [406:406:8:4294967295] 00000400:00000200:1.0:1734257829.932743:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257829.932748:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257829.932752:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734257829.932758:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257829.932767:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257829.932771:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257829.932959:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257829.932977:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:1.0:1734257829.932980:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257829.932985:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257829.932989:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:1.0:1734257829.932990:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734257829.932997:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098214400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257845 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257829.933083:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257829.933091:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257829.933283:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257829.933288:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257829.933292:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257829.933294:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098214528, portal 10 00000400:00000010:2.0:1734257829.933304:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734257829.933305:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098214528, offset 0 00000400:00000200:2.0:1734257829.933309:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257829.933314:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257829.933316:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257829.933318:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257829.933320:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257829.933322:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257829.933324:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [408:408:256:4294967295] 192.168.202.108@tcp LPNI seq info [407:407:8:4294967295] 00000400:00000200:2.0:1734257829.933329:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257829.933333:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257829.933336:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257829.933339:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257829.933342:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257829.933344:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257829.935136:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257829.935144:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257829.935154:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257829.935162:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257829.935167:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734257829.935168:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734257829.935177:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098214528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257839 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257829.937888:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257829.937907:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ca00 00000400:00000200:0.0:1734257829.937916:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xda9 [1] + 224 00000400:00000200:0.0:1734257829.937928:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257829.937932:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257829.937942:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098214400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257845 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257829.937982:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257829.937986:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ca80 00000400:00000200:0.0:1734257829.937991:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xdb1 [1] + 0 00000400:00000200:0.0:1734257829.938010:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257829.938012:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257829.938017:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098214528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257839 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257829.938135:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257829.938140:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257829.938143:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257829.938148:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098214528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257839 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257829.938164:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098214528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257839 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257829.938198:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257829.938205:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257829.938209:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:1.0:1734257829.938276:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257829.938281:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257829.938282:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257829.938287:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098214400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257845 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257829.938293:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098214400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257845 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257829.938305:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734257829.938308:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734257829.938309:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257834.939701:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257834.939721:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257834.939782:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257834.939788:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734257834.940475:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734257834.940484:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257834.940491:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257834.940499:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098214656, portal 25 00000400:00000010:2.0:1734257834.940504:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734257834.940506:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098214656, offset 0 00000400:00000200:2.0:1734257834.940516:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257834.940530:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257834.940537:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257834.940541:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257834.940544:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257834.940546:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257834.940549:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [409:409:256:4294967295] 192.168.202.108@tcp LPNI seq info [408:408:8:4294967295] 00000400:00000200:2.0:1734257834.940557:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257834.940563:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257834.940589:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257834.940595:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257834.940603:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257834.940607:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257834.940855:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257834.940860:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257834.940863:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257834.940866:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098214784, portal 10 00000400:00000010:3.0:1734257834.940871:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734257834.940872:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098214784, offset 0 00000400:00000200:3.0:1734257834.940877:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257834.940881:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257834.940884:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257834.940886:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257834.940888:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257834.940889:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257834.940891:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [410:410:255:4294967295] 192.168.202.108@tcp LPNI seq info [409:409:7:4294967295] 00000400:00000200:3.0:1734257834.940897:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257834.940901:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257834.940903:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734257834.940906:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257834.940910:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257834.940911:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257834.941398:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257834.941402:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257834.941406:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257834.941410:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257834.941414:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734257834.941416:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734257834.941423:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098214656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257850 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257834.942142:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257834.942145:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734257834.942148:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257834.942151:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257834.942154:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734257834.942155:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734257834.942159:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098214784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257844 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257834.943225:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257834.943239:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60cb00 00000400:00000200:0.0:1734257834.943245:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xdb9 [1] + 224 00000400:00000200:0.0:1734257834.943266:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257834.943269:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257834.943277:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098214656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257850 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257834.944174:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257834.944183:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257834.944185:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257834.944193:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098214656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257850 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257834.944228:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098214656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257850 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257834.944256:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734257834.944262:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734257834.944266:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000200:0.0:1734257834.945440:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257834.945452:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60cb80 00000400:00000200:0.0:1734257834.945464:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xdc1 [1] + 0 00000400:00000200:0.0:1734257834.945478:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257834.945482:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257834.945489:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098214784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257844 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257834.946553:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257834.946560:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257834.946562:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257834.946613:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098214784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257844 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257834.946633:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098214784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257844 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257834.946661:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257834.946665:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257834.946670:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734257839.947796:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257839.947821:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 02000000:00000010:2.0:1734257839.948136:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734257839.948146:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257839.948152:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257839.948159:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098214912, portal 25 00000400:00000010:2.0:1734257839.948164:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734257839.948165:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098214912, offset 0 00000400:00000200:2.0:1734257839.948174:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257839.948186:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257839.948190:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257839.948194:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257839.948197:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257839.948199:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257839.948201:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [411:411:256:4294967295] 192.168.202.108@tcp LPNI seq info [410:410:8:4294967295] 00000400:00000200:2.0:1734257839.948208:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257839.948213:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257839.948217:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257839.948222:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257839.948228:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257839.948231:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734257839.948346:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257839.948349:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:2.0:1734257839.948351:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257839.948355:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257839.948358:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:2.0:1734257839.948370:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734257839.948376:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098214912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257855 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257839.948605:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257839.948612:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734257839.948854:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257839.948860:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257839.948863:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257839.948866:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098215040, portal 10 00000400:00000010:3.0:1734257839.948870:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734257839.948872:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098215040, offset 0 00000400:00000200:3.0:1734257839.948964:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257839.948969:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257839.948972:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257839.948974:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257839.948976:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257839.948978:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257839.948980:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [412:412:256:4294967295] 192.168.202.108@tcp LPNI seq info [411:411:8:4294967295] 00000400:00000200:3.0:1734257839.948986:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257839.948990:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257839.948993:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734257839.948996:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257839.949001:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257839.949003:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257839.949373:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257839.949376:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734257839.949378:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257839.949382:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257839.949385:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734257839.949386:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734257839.949391:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098215040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257849 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257839.949962:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257839.949974:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60cc00 00000400:00000200:0.0:1734257839.949980:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xdc9 [1] + 224 00000400:00000200:0.0:1734257839.949996:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257839.949999:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257839.950005:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098214912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257855 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257839.950172:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257839.950177:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257839.950178:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257839.950182:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098214912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257855 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257839.950189:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098214912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257855 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257839.950207:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734257839.950210:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734257839.950213:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734257839.951193:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257839.951210:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60cc80 00000400:00000200:0.0:1734257839.951218:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xdd1 [1] + 0 00000400:00000200:0.0:1734257839.951238:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257839.951242:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257839.951259:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098215040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257849 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257839.951649:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257839.951655:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257839.951657:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257839.951662:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098215040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257849 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257839.951677:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098215040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257849 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257839.951705:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257839.951709:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734257839.951714:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257844.955721:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257844.955741:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257844.955798:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257844.955805:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257844.955843:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257844.955851:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257844.955857:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257844.955862:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098215168, portal 25 00000400:00000010:3.0:1734257844.955866:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734257844.955868:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098215168, offset 0 00000400:00000200:3.0:1734257844.955875:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257844.955886:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257844.955890:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257844.955893:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257844.955896:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257844.955897:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257844.955900:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [413:413:256:4294967295] 192.168.202.108@tcp LPNI seq info [412:412:8:4294967295] 00000400:00000200:3.0:1734257844.955907:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257844.955912:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257844.955916:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734257844.955921:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257844.955928:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257844.955931:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257844.956008:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257844.956012:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257844.956015:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257844.956017:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098215296, portal 10 00000400:00000010:2.0:1734257844.956021:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734257844.956023:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098215296, offset 0 00000400:00000200:2.0:1734257844.956026:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257844.956031:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257844.956033:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257844.956035:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257844.956036:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257844.956037:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257844.956039:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [414:414:255:4294967295] 192.168.202.108@tcp LPNI seq info [413:413:7:4294967295] 00000400:00000200:2.0:1734257844.956044:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257844.956047:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257844.956049:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257844.956052:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257844.956055:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257844.956064:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257844.956391:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257844.956394:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734257844.956397:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257844.956401:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257844.956404:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734257844.956406:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734257844.956412:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098215168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257860 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257844.956465:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257844.956466:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257844.956469:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257844.956471:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257844.956473:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734257844.956474:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734257844.956476:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098215296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257854 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257844.961291:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257844.961306:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60cd00 00000400:00000200:0.0:1734257844.961311:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xdd9 [1] + 224 00000400:00000200:0.0:1734257844.961327:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257844.961330:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257844.961338:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098215168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257860 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257844.961791:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257844.961796:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257844.961798:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000400:00000200:0.0:1734257844.961799:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000100:00000200:3.0:1734257844.961803:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098215168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257860 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257844.961812:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60cd80 00000400:00000200:0.0:1734257844.961816:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xde1 [1] + 0 00000100:00000200:3.0:1734257844.961819:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098215168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257860 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257844.961826:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257844.961829:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257844.961833:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098215296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257854 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257844.961841:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257844.961845:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734257844.961848:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:2.0:1734257844.962117:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257844.962121:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257844.962122:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257844.962126:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098215296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257854 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257844.962131:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098215296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257854 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257844.962148:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257844.962152:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257844.962155:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734257849.963758:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257849.963783:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257849.963851:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257849.963858:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257849.963898:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257849.963908:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257849.963915:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257849.963922:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098215424, portal 25 00000400:00000010:3.0:1734257849.963927:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734257849.963929:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098215424, offset 0 00000400:00000200:3.0:1734257849.963941:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257849.963958:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257849.963964:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257849.963969:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257849.963972:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257849.963975:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257849.963978:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [415:415:256:4294967295] 192.168.202.108@tcp LPNI seq info [414:414:8:4294967295] 00000400:00000200:3.0:1734257849.963986:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257849.963992:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257849.963996:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734257849.964002:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257849.964011:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257849.964014:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257849.964151:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734257849.964154:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:3.0:1734257849.964157:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734257849.964161:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734257849.964165:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:3.0:1734257849.964179:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734257849.964187:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098215424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257865 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257849.964850:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734257849.964856:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257849.964860:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257849.964863:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098215552, portal 10 00000400:00000010:2.0:1734257849.964867:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734257849.964869:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098215552, offset 0 00000400:00000200:2.0:1734257849.964873:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257849.964879:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257849.964882:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257849.964884:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257849.964886:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257849.964887:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257849.964890:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [416:416:256:4294967295] 192.168.202.108@tcp LPNI seq info [415:415:8:4294967295] 00000400:00000200:2.0:1734257849.964895:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257849.964898:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257849.964901:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257849.964904:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257849.964908:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257849.964911:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257849.964997:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257849.965000:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257849.965003:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257849.965007:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257849.965010:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734257849.965011:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734257849.965015:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098215552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257859 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257849.967373:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257849.967403:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ce00 00000400:00000200:0.0:1734257849.967417:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xde9 [1] + 224 00000400:00000200:0.0:1734257849.967446:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257849.967452:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257849.967468:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098215424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257865 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257849.968614:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257849.968622:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257849.968624:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257849.968630:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098215424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257865 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257849.968637:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098215424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257865 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257849.968674:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257849.968680:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734257849.968686:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734257849.969024:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257849.969035:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ce80 00000400:00000200:0.0:1734257849.969042:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xdf1 [1] + 0 00000400:00000200:0.0:1734257849.969059:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257849.969068:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257849.969074:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098215552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257859 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257849.970551:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257849.970560:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257849.970561:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257849.970584:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098215552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257859 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257849.970592:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098215552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257859 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257849.970619:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734257849.970625:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257849.970629:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734257854.971705:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257854.971724:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734257854.971787:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257854.971793:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734257854.971838:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257854.971845:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257854.971852:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257854.971859:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098215680, portal 25 00000400:00000010:1.0:1734257854.971863:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734257854.971865:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098215680, offset 0 00000400:00000200:1.0:1734257854.971873:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257854.971885:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257854.971890:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257854.971893:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 02000000:00000010:3.0:1734257854.971895:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000200:1.0:1734257854.971896:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257854.971898:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:3.0:1734257854.971900:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:1.0:1734257854.971901:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [417:417:256:4294967295] 192.168.202.108@tcp LPNI seq info [416:416:8:4294967295] 00000400:00000010:3.0:1734257854.971903:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257854.971906:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098215808, portal 10 00000400:00000200:1.0:1734257854.971908:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:3.0:1734257854.971910:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734257854.971911:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098215808, offset 0 00000400:00000200:3.0:1734257854.971915:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734257854.971925:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257854.971926:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734257854.971929:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000400:00000200:3.0:1734257854.971929:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257854.971931:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257854.971933:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734257854.971934:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257854.971934:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257854.971936:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [418:418:255:4294967295] 192.168.202.108@tcp LPNI seq info [417:417:7:4294967295] 00000800:00000200:1.0:1734257854.971940:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734257854.971942:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257854.971943:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734257854.971945:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257854.971948:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734257854.971951:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257854.971955:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257854.971962:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257854.972043:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257854.972046:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734257854.972050:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257854.972054:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257854.972058:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:0.0:1734257854.972059:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:0.0:1734257854.972066:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098215680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257870 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257854.972130:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257854.972132:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734257854.972134:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257854.972137:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257854.972138:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734257854.972140:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734257854.972143:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098215808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257864 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257854.975476:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257854.975494:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60cf00 00000400:00000200:0.0:1734257854.975502:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xdf9 [1] + 224 00000400:00000200:0.0:1734257854.975512:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257854.975515:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257854.975524:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098215680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257870 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257854.975554:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257854.975567:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60cf80 00000400:00000200:0.0:1734257854.975594:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe01 [1] + 0 00000400:00000200:0.0:1734257854.975619:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257854.975622:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:1.0:1734257854.975623:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257854.975628:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257854.975630:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:0.0:1734257854.975635:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098215808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257864 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257854.975635:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098215680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257870 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257854.975642:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098215680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257870 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257854.975662:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734257854.975667:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734257854.975670:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:3.0:1734257854.975699:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257854.975703:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257854.975705:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257854.975709:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098215808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257864 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257854.975716:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098215808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257864 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:3.0:1734257854.975726:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:3.0:1734257854.979495:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257854.979508:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257854.979513:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734257859.979688:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257859.979709:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734257859.979764:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257859.979770:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734257859.979836:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257859.979843:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257859.979849:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257859.979855:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098216064, portal 10 00000400:00000010:3.0:1734257859.979860:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734257859.979862:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098216064, offset 0 00000400:00000200:3.0:1734257859.979869:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:1.0:1734257859.979874:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257859.979879:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000200:3.0:1734257859.979880:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734257859.979883:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000200:3.0:1734257859.979884:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:1.0:1734257859.979885:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098215936, portal 25 00000400:00000010:1.0:1734257859.979888:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000400:00000200:3.0:1734257859.979888:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:1.0:1734257859.979889:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098215936, offset 0 00000400:00000200:3.0:1734257859.979890:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257859.979892:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257859.979893:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257859.979895:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [419:419:256:4294967295] 192.168.202.108@tcp LPNI seq info [418:418:8:4294967295] 00000400:00000200:3.0:1734257859.979902:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257859.979907:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257859.979911:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734257859.979916:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257859.979922:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257859.979936:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257859.980691:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257859.980695:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734257859.980700:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257859.980705:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257859.980708:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734257859.980710:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734257859.980716:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098216064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257869 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734257859.980737:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257859.980740:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257859.980743:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257859.980745:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257859.980747:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257859.980749:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [420:420:255:4294967295] 192.168.202.108@tcp LPNI seq info [419:419:7:4294967295] 00000400:00000200:1.0:1734257859.980756:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257859.980760:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257859.980770:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734257859.980774:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257859.980779:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257859.980781:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257859.980821:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257859.980824:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734257859.980826:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257859.980839:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257859.980841:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:0.0:1734257859.980843:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:0.0:1734257859.980846:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098215936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257875 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257859.985093:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257859.985110:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d080 00000400:00000200:0.0:1734257859.985118:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe09 [1] + 0 00000400:00000200:0.0:1734257859.985128:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257859.985143:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257859.985152:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098216064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257869 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257859.985807:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257859.985813:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d000 00000400:00000200:0.0:1734257859.985818:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xe11 [1] + 224 00000400:00000200:0.0:1734257859.985832:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257859.985835:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257859.985840:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098215936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257875 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257859.986438:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257859.986444:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257859.986447:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257859.986453:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098216064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257869 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257859.986459:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098216064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257869 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257859.986486:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257859.986490:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734257859.986494:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:1.0:1734257859.986649:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257859.986653:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257859.986654:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257859.986658:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098215936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257875 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257859.986664:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098215936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257875 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257859.986675:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734257859.986677:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734257859.986679:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734257864.988001:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257864.988019:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257864.988065:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257864.988070:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734257864.988132:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257864.988139:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257864.988145:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257864.988151:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098216320, portal 10 00000400:00000010:2.0:1734257864.988156:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734257864.988158:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098216320, offset 0 00000400:00000200:2.0:1734257864.988166:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257864.988176:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257864.988181:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257864.988184:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257864.988187:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257864.988189:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257864.988191:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [421:421:256:4294967295] 192.168.202.108@tcp LPNI seq info [420:420:8:4294967295] 00000400:00000200:2.0:1734257864.988199:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257864.988203:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257864.988207:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257864.988212:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257864.988219:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257864.988222:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257864.988660:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257864.988663:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257864.988667:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257864.988672:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257864.988675:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734257864.988677:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734257864.988684:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098216320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257874 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257864.988757:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257864.988762:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257864.988766:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257864.988768:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098216192, portal 25 00000400:00000010:3.0:1734257864.988771:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734257864.988773:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098216192, offset 0 00000400:00000200:3.0:1734257864.988777:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257864.988783:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257864.988785:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257864.988788:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257864.988790:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257864.988792:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257864.988794:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [422:422:256:4294967295] 192.168.202.108@tcp LPNI seq info [421:421:8:4294967295] 00000400:00000200:3.0:1734257864.988800:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257864.988804:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257864.988807:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734257864.988810:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257864.988814:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257864.988816:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257864.989143:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257864.989146:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734257864.989148:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257864.989152:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257864.989155:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734257864.989156:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734257864.989160:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098216192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257880 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257864.990440:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257864.990460:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d100 00000400:00000200:0.0:1734257864.990467:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xe21 [1] + 224 00000400:00000200:0.0:1734257864.990477:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257864.990480:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257864.990487:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098216192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257880 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257864.990590:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000010:3.0:1734257864.990591:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257864.990594:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000200:0.0:1734257864.990595:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d180 00000400:00000010:3.0:1734257864.990595:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257864.990599:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098216192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257880 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257864.990600:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe19 [1] + 0 00000100:00000200:3.0:1734257864.990605:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098216192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257880 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257864.990613:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257864.990615:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257864.990619:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098216320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257874 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257864.990621:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257864.990626:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734257864.990629:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:2.0:1734257864.990701:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257864.990708:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257864.990709:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257864.990712:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098216320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257874 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257864.990718:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098216320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257874 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257864.990733:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257864.990737:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257864.990738:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734257869.995680:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257869.995699:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257869.995753:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257869.995759:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257869.995852:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257869.995858:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257869.995864:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257869.995870:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098216448, portal 25 00000400:00000010:3.0:1734257869.995873:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734257869.995875:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098216448, offset 0 00000400:00000200:3.0:1734257869.995883:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257869.995894:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257869.995898:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257869.995902:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257869.995904:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257869.995906:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257869.995909:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [423:423:256:4294967295] 192.168.202.108@tcp LPNI seq info [422:422:8:4294967295] 00000400:00000200:3.0:1734257869.995916:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257869.995921:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257869.995925:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734257869.995929:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257869.995936:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257869.995939:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257869.996000:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257869.996004:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257869.996008:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257869.996010:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098216576, portal 10 00000400:00000010:2.0:1734257869.996014:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734257869.996015:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098216576, offset 0 00000400:00000200:2.0:1734257869.996019:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257869.996023:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257869.996025:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257869.996026:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257869.996028:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257869.996029:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257869.996031:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [424:424:255:4294967295] 192.168.202.108@tcp LPNI seq info [423:423:7:4294967295] 00000400:00000200:2.0:1734257869.996035:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257869.996038:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257869.996040:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257869.996042:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257869.996046:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257869.996047:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257869.996167:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257869.996170:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734257869.996174:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257869.996178:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257869.996182:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:0.0:1734257869.996183:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734257869.996189:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098216448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257885 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257869.996249:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257869.996251:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257869.996253:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257869.996256:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257869.996258:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734257869.996266:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734257869.996270:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098216576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257879 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257869.999470:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257869.999487:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d200 00000400:00000200:0.0:1734257869.999521:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xe29 [1] + 224 00000400:00000200:0.0:1734257869.999539:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257869.999543:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257869.999551:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098216448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257885 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257870.000787:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257870.000801:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257870.000803:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257870.000810:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098216448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257885 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257870.000817:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098216448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257885 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257870.000837:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257870.000841:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734257870.000844:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734257870.002422:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257870.002435:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d280 00000400:00000200:0.0:1734257870.002441:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe31 [1] + 0 00000400:00000200:0.0:1734257870.002458:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257870.002461:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257870.002470:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098216576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257879 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257870.002556:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257870.002560:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257870.002589:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257870.002594:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098216576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257879 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257870.002600:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098216576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257879 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257870.002618:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257870.002622:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257870.002624:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257875.006322:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257875.006340:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257875.006396:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257875.006403:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257875.006516:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257875.006522:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257875.006529:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257875.006538:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098216704, portal 25 00000400:00000010:1.0:1734257875.006549:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000100:00000200:1.0:1734257875.006552:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098216704, offset 0 00000400:00000200:1.0:1734257875.006564:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257875.006661:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257875.006667:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257875.006671:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257875.006674:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257875.006675:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257875.006678:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [425:425:256:4294967295] 192.168.202.108@tcp LPNI seq info [424:424:8:4294967295] 00000400:00000200:1.0:1734257875.006685:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257875.006690:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257875.006694:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734257875.006711:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257875.006720:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257875.006723:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257875.006850:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257875.006855:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257875.006858:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257875.006860:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098216832, portal 10 00000400:00000010:3.0:1734257875.006865:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734257875.006866:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098216832, offset 0 00000400:00000200:3.0:1734257875.006869:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257875.006874:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257875.006877:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257875.006878:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257875.006880:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257875.006882:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257875.006883:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [426:426:255:4294967295] 192.168.202.108@tcp LPNI seq info [425:425:7:4294967295] 00000400:00000200:3.0:1734257875.006888:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257875.006891:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257875.006893:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734257875.006896:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257875.006899:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257875.006901:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257875.006906:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257875.006907:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734257875.006910:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257875.006914:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257875.006917:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:0.0:1734257875.006918:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:0.0:1734257875.006924:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098216704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257891 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257875.006966:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257875.006967:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734257875.006969:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257875.006971:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257875.006973:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734257875.006974:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734257875.006977:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098216832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257885 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257875.011369:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257875.011387:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d300 00000400:00000200:0.0:1734257875.011395:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xe39 [1] + 224 00000400:00000200:0.0:1734257875.011405:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257875.011409:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257875.011417:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098216704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257891 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257875.011464:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257875.011468:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d380 00000400:00000200:0.0:1734257875.011473:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe41 [1] + 0 00000400:00000200:0.0:1734257875.011492:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257875.011495:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257875.011499:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098216832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257885 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257875.011594:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257875.011599:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257875.011601:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257875.011614:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098216832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257885 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257875.011622:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098216832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257885 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257875.011646:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257875.011650:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257875.011655:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:1.0:1734257875.011939:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257875.011943:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257875.011945:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257875.011949:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098216704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257891 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257875.011955:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098216704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257891 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257875.011965:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734257875.011968:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:1.0:1734257875.011969:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734257880.011681:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257880.011698:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 02000000:00000010:2.0:1734257880.011828:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734257880.011836:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257880.011841:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257880.011848:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098216960, portal 25 00000400:00000010:2.0:1734257880.011852:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734257880.011854:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098216960, offset 0 00000400:00000200:2.0:1734257880.011862:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257880.011873:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257880.011878:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257880.011882:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257880.011885:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257880.011887:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257880.011889:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [427:427:256:4294967295] 192.168.202.108@tcp LPNI seq info [426:426:8:4294967295] 00000400:00000200:2.0:1734257880.011896:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257880.011901:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257880.011904:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257880.011909:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257880.011915:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257880.011919:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734257880.012034:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257880.012037:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:2.0:1734257880.012039:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257880.012052:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257880.012055:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:2.0:1734257880.012056:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734257880.012061:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098216960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257896 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257880.012147:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257880.012154:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734257880.012271:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257880.012275:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257880.012278:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257880.012280:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098217088, portal 10 00000400:00000010:3.0:1734257880.012284:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734257880.012285:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098217088, offset 0 00000400:00000200:3.0:1734257880.012289:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257880.012293:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257880.012296:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257880.012298:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257880.012299:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257880.012301:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257880.012303:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [428:428:256:4294967295] 192.168.202.108@tcp LPNI seq info [427:427:8:4294967295] 00000400:00000200:3.0:1734257880.012308:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257880.012311:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257880.012313:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734257880.012316:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257880.012319:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257880.012320:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257880.012455:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257880.012458:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734257880.012464:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257880.012467:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257880.012469:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:0.0:1734257880.012470:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734257880.012474:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098217088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257890 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257880.013641:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257880.013657:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d400 00000400:00000200:0.0:1734257880.013664:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xe49 [1] + 224 00000400:00000200:0.0:1734257880.013685:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257880.013689:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257880.013698:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098216960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257896 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257880.013757:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257880.013762:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257880.013763:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257880.013767:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098216960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257896 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257880.013773:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098216960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257896 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257880.013790:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734257880.013794:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734257880.013797:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000200:0.0:1734257880.014696:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257880.014708:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d480 00000400:00000200:0.0:1734257880.014713:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe51 [1] + 0 00000400:00000200:0.0:1734257880.014728:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257880.014731:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257880.014736:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098217088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257890 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257880.016002:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257880.016009:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257880.016011:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257880.016020:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098217088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257890 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257880.016037:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098217088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257890 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257880.016063:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257880.016067:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734257880.016072:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257885.019739:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257885.019767:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257885.019832:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257885.019838:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734257885.019939:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257885.019947:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257885.019954:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257885.019962:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098217344, portal 10 00000400:00000010:2.0:1734257885.019969:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734257885.019971:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098217344, offset 0 00000400:00000200:2.0:1734257885.019982:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257885.020003:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257885.020009:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257885.020013:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257885.020016:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257885.020018:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257885.020020:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [429:429:256:4294967295] 192.168.202.108@tcp LPNI seq info [428:428:8:4294967295] 00000400:00000200:2.0:1734257885.020028:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257885.020033:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257885.020036:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257885.020057:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257885.020065:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257885.020069:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734257885.020156:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734257885.020162:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257885.020165:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257885.020167:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098217216, portal 25 00000400:00000010:1.0:1734257885.020170:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734257885.020171:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098217216, offset 0 00000400:00000200:1.0:1734257885.020176:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257885.020180:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257885.020182:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257885.020184:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257885.020186:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257885.020188:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257885.020190:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [430:430:255:4294967295] 192.168.202.108@tcp LPNI seq info [429:429:7:4294967295] 00000400:00000200:1.0:1734257885.020195:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257885.020198:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257885.020201:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734257885.020203:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257885.020206:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257885.020213:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257885.020287:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257885.020290:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257885.020294:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257885.020298:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257885.020302:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734257885.020310:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734257885.020317:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098217344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257895 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257885.020407:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257885.020408:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734257885.020411:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257885.020414:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257885.020416:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:0.0:1734257885.020417:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:0.0:1734257885.020420:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098217216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257901 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257885.022121:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257885.022135:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d500 00000400:00000200:0.0:1734257885.022143:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xe61 [1] + 224 00000400:00000200:0.0:1734257885.022162:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257885.022165:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257885.022174:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098217216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257901 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257885.022255:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257885.022258:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257885.022260:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257885.022264:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098217216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257901 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257885.022270:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098217216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257901 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257885.022291:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734257885.022294:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734257885.022298:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734257885.034610:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257885.034631:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d580 00000400:00000200:0.0:1734257885.034640:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe59 [1] + 0 00000400:00000200:0.0:1734257885.034664:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257885.034668:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257885.034679:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098217344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257895 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257885.038012:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257885.038025:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257885.038027:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257885.038041:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098217344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257895 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257885.038051:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098217344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257895 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257885.038089:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257885.038096:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257885.038102:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257890.027992:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257890.028013:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 02000000:00000010:1.0:1734257890.030674:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0000. 00000400:00000010:1.0:1734257890.030685:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257890.030691:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257890.030698:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098217472, portal 25 00000400:00000010:1.0:1734257890.030702:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734257890.030704:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098217472, offset 0 00000400:00000200:1.0:1734257890.030715:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257890.030726:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257890.030730:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257890.030734:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257890.030737:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257890.030739:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257890.030741:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [431:431:256:4294967295] 192.168.202.108@tcp LPNI seq info [430:430:8:4294967295] 00000400:00000200:1.0:1734257890.030749:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257890.030753:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257890.030756:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734257890.030762:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257890.030769:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257890.030772:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257890.030890:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257890.030900:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734257890.030936:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734257890.030940:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50898. 00000400:00000010:0.0:1734257890.030942:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734257890.030944:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098217600, portal 10 00000400:00000010:0.0:1734257890.030948:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000100:00000200:0.0:1734257890.030949:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098217600, offset 0 00000400:00000200:0.0:1734257890.030952:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734257890.030956:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734257890.030958:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734257890.030960:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257890.030961:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257890.030963:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734257890.030964:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [432:432:255:4294967295] 192.168.202.108@tcp LPNI seq info [431:431:7:4294967295] 00000400:00000200:0.0:1734257890.030969:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734257890.030972:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257890.030974:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734257890.030976:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257890.030979:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734257890.030981:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257890.031426:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257890.031428:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:2.0:1734257890.031433:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257890.031436:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257890.031440:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:2.0:1734257890.031441:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:2.0:1734257890.031447:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098217472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257906 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257890.031502:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257890.031504:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:2.0:1734257890.031506:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257890.031508:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257890.031510:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:2.0:1734257890.031511:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:2.0:1734257890.031513:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098217600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257900 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257890.036228:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257890.036244:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d600 00000400:00000200:0.0:1734257890.036252:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xe69 [1] + 224 00000400:00000200:0.0:1734257890.036261:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257890.036265:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257890.036274:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098217472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257906 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257890.036744:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257890.036749:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d680 00000400:00000200:0.0:1734257890.036753:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe71 [1] + 0 00000400:00000200:0.0:1734257890.036776:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257890.036778:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257890.036782:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098217600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257900 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257890.037001:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257890.037006:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257890.037008:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257890.037013:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098217472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257906 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257890.037019:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098217472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257906 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257890.037041:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0000. 02000000:00000010:1.0:1734257890.037045:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734257890.037049:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:2.0:1734257890.037130:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50898. 00000400:00000200:2.0:1734257890.037134:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:2.0:1734257890.037139:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:2.0:1734257890.037143:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098217600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257900 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257890.037149:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098217600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257900 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257890.037164:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:2.0:1734257890.037166:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734257890.037169:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734257895.035667:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257895.035685:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257895.039285:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257895.039334:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257895.039691:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0000. 00000400:00000010:1.0:1734257895.039698:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257895.039704:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257895.039710:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098217728, portal 25 00000400:00000010:1.0:1734257895.039713:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734257895.039715:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098217728, offset 0 00000400:00000200:1.0:1734257895.039723:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257895.039733:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257895.039738:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257895.039741:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257895.039744:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257895.039746:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257895.039748:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [433:433:256:4294967295] 192.168.202.108@tcp LPNI seq info [432:432:8:4294967295] 00000400:00000200:1.0:1734257895.039755:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257895.039759:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257895.039762:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734257895.039767:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257895.039773:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257895.039776:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257895.039869:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257895.039881:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:1.0:1734257895.039883:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257895.039887:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257895.039891:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:1.0:1734257895.039892:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734257895.039897:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098217728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257911 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257895.039918:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257895.039922:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257895.039924:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257895.039927:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098217856, portal 10 00000400:00000010:3.0:1734257895.039931:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734257895.039932:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098217856, offset 0 00000400:00000200:3.0:1734257895.039936:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257895.039940:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257895.039942:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257895.039944:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257895.039945:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257895.039947:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257895.039948:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [434:434:256:4294967295] 192.168.202.108@tcp LPNI seq info [433:433:8:4294967295] 00000400:00000200:3.0:1734257895.039953:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257895.039956:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257895.039958:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734257895.039961:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257895.039964:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257895.039966:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257895.040246:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257895.040249:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734257895.040251:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257895.040254:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257895.040256:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:0.0:1734257895.040258:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734257895.040262:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098217856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257905 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257895.043842:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257895.043859:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d700 00000400:00000200:0.0:1734257895.043865:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xe79 [1] + 224 00000400:00000200:0.0:1734257895.043883:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257895.043886:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257895.043894:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098217728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257911 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257895.044765:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257895.044770:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257895.044772:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257895.044777:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098217728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257911 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257895.044784:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098217728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257911 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257895.044802:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0000. 02000000:00000010:1.0:1734257895.044806:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734257895.044808:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734257895.045128:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257895.045135:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d780 00000400:00000200:0.0:1734257895.045140:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe81 [1] + 0 00000400:00000200:0.0:1734257895.045152:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257895.045155:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257895.045160:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098217856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257905 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257895.045290:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257895.045302:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257895.045303:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257895.045307:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098217856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257905 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257895.045320:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098217856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257905 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257895.045336:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257895.045338:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257895.045340:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734257900.043911:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257900.043931:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 02000000:00000010:2.0:1734257900.044390:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734257900.044399:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257900.044406:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257900.044413:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098217984, portal 25 00000400:00000010:2.0:1734257900.044418:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734257900.044420:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098217984, offset 0 00000400:00000200:2.0:1734257900.044428:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257900.044442:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257900.044449:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257900.044453:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257900.044456:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257900.044458:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257900.044461:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [435:435:256:4294967295] 192.168.202.108@tcp LPNI seq info [434:434:8:4294967295] 00000400:00000200:2.0:1734257900.044468:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257900.044474:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257900.044477:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257900.044483:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257900.044491:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257900.044495:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734257900.044814:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257900.044822:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257900.044981:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257900.044991:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257900.044997:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257900.045003:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098218112, portal 10 00000400:00000010:3.0:1734257900.045009:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734257900.045011:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098218112, offset 0 00000400:00000200:3.0:1734257900.045019:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257900.045029:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257900.045032:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257900.045036:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257900.045038:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257900.045040:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257900.045042:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [436:436:255:4294967295] 192.168.202.108@tcp LPNI seq info [435:435:7:4294967295] 00000400:00000200:3.0:1734257900.045049:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257900.045054:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257900.045057:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734257900.045062:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257900.045068:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257900.045071:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734257900.046448:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257900.046454:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:2.0:1734257900.046460:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257900.046480:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257900.046486:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734257900.046488:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734257900.046496:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098217984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257916 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257900.047874:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257900.047883:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:2.0:1734257900.047889:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257900.047894:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257900.047898:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:2.0:1734257900.047900:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:2.0:1734257900.047907:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098218112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257910 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257900.048885:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257900.048897:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d800 00000400:00000200:0.0:1734257900.048904:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xe89 [1] + 224 00000400:00000200:0.0:1734257900.048912:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257900.048915:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257900.048921:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098217984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257916 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257900.048949:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257900.048953:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d880 00000400:00000200:0.0:1734257900.048958:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe91 [1] + 0 00000400:00000200:0.0:1734257900.048973:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257900.048976:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257900.048980:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098218112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257910 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257900.049097:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257900.049105:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257900.049107:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000400:00000010:2.0:1734257900.049113:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000100:00000200:3.0:1734257900.049116:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098218112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257910 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734257900.049117:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257900.049118:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257900.049122:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098217984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257916 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257900.049129:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098217984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257916 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257900.049140:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098218112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257910 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257900.049148:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734257900.049153:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734257900.049155:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 02000000:00000010:3.0:1734257900.049167:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257900.049171:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257900.049176:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734257905.051692:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257905.051713:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734257905.051769:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257905.051774:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734257905.051866:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257905.051873:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257905.051878:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257905.051884:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098218368, portal 10 00000400:00000010:2.0:1734257905.051889:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734257905.051891:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098218368, offset 0 00000400:00000200:2.0:1734257905.051899:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257905.051911:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257905.051916:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257905.051930:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257905.051933:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257905.051935:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257905.051937:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [437:437:256:4294967295] 192.168.202.108@tcp LPNI seq info [436:436:8:4294967295] 00000400:00000200:2.0:1734257905.051945:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257905.051950:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257905.051954:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257905.051959:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257905.051967:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257905.051970:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257905.052109:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257905.052112:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734257905.052116:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257905.052120:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257905.052123:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734257905.052124:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734257905.052135:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098218368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257915 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257905.052196:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257905.052200:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257905.052204:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257905.052206:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098218240, portal 25 00000400:00000010:3.0:1734257905.052209:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734257905.052211:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098218240, offset 0 00000400:00000200:3.0:1734257905.052243:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257905.052248:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257905.052251:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257905.052253:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257905.052255:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257905.052256:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257905.052258:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [438:438:256:4294967295] 192.168.202.108@tcp LPNI seq info [437:437:8:4294967295] 00000400:00000200:3.0:1734257905.052264:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257905.052268:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257905.052271:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257905.052273:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257905.052276:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257905.052279:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734257905.052407:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257905.052410:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:2.0:1734257905.052412:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257905.052415:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257905.052417:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:2.0:1734257905.052418:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:2.0:1734257905.052422:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098218240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257921 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257905.054917:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257905.054937:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60d980 00000400:00000200:0.0:1734257905.054946:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xe99 [1] + 0 00000400:00000200:0.0:1734257905.054966:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257905.054970:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257905.054981:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098218368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257915 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257905.055083:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734257905.055088:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:2.0:1734257905.055090:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257905.055094:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098218368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257915 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257905.055101:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098218368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257915 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257905.055130:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257905.055136:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257905.055142:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734257905.056450:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257905.056462:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60d900 00000400:00000200:0.0:1734257905.056468:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xea1 [1] + 224 00000400:00000200:0.0:1734257905.056481:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257905.056484:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257905.056491:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098218240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257921 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257905.056609:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257905.056613:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257905.056614:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257905.056619:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098218240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257921 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257905.056648:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098218240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257921 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257905.056663:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257905.056667:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734257905.056670:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734257910.060001:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257910.060026:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 02000000:00000010:1.0:1734257910.060201:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257910.060212:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257910.060221:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257910.060231:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098218496, portal 25 00000400:00000010:1.0:1734257910.060236:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734257910.060238:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098218496, offset 0 00000400:00000200:1.0:1734257910.060249:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257910.060265:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257910.060272:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257910.060275:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257910.060278:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257910.060280:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257910.060283:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [439:439:256:4294967295] 192.168.202.108@tcp LPNI seq info [438:438:8:4294967295] 00000400:00000200:1.0:1734257910.060292:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257910.060317:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257910.060320:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734257910.060327:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257910.060336:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257910.060340:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734257910.061947:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734257910.061954:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:2.0:1734257910.061961:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734257910.061975:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734257910.061981:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:2.0:1734257910.061983:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:2.0:1734257910.061992:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098218496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257926 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257910.062252:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257910.062266:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257910.062480:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257910.062486:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734257910.062491:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734257910.062496:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098218624, portal 10 00000400:00000010:2.0:1734257910.062502:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734257910.062504:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098218624, offset 0 00000400:00000200:2.0:1734257910.062509:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257910.062518:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257910.062524:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257910.062527:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257910.062530:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257910.062532:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257910.062534:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [440:440:256:4294967295] 192.168.202.108@tcp LPNI seq info [439:439:8:4294967295] 00000400:00000200:2.0:1734257910.062542:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257910.062546:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257910.062549:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257910.062554:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257910.062560:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257910.062563:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734257910.062666:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734257910.062678:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60da00 00000400:00000200:1.0:1734257910.062686:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xea9 [1] + 224 00000400:00000200:1.0:1734257910.062705:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257910.062708:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:1.0:1734257910.062712:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098218496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257926 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257910.062765:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257910.062767:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734257910.062770:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257910.062772:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257910.062775:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:1.0:1734257910.062776:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:1.0:1734257910.062781:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098218624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257920 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257910.062801:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257910.062804:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257910.062806:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257910.062810:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098218496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257926 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257910.062816:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098218496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257926 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257910.062837:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257910.062842:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734257910.062851:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734257910.065432:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257910.065449:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60da80 00000400:00000200:0.0:1734257910.065457:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xeb1 [1] + 0 00000400:00000200:0.0:1734257910.065478:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257910.065481:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257910.065491:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098218624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257920 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:0.0:1734257910.065541:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:0.0:1734257910.065553:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734257910.065555:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734257910.065560:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098218624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257920 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734257910.065566:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098218624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257920 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:0.0:1734257910.065619:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734257910.065626:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:0.0:1734257910.065630:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257915.067716:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257915.067740:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734257915.067804:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257915.067810:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734257915.067855:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734257915.067862:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d508f0. 00000400:00000010:0.0:1734257915.067869:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000100:00000200:0.0:1734257915.067878:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098218880, portal 10 00000400:00000010:0.0:1734257915.067887:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734257915.067889:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098218880, offset 0 00000400:00000200:0.0:1734257915.067898:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734257915.067900:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000200:0.0:1734257915.067914:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734257915.067914:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000200:0.0:1734257915.067921:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734257915.067922:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000400:00000200:0.0:1734257915.067925:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734257915.067929:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734257915.067931:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:2.0:1734257915.067931:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098218752, portal 25 00000400:00000200:0.0:1734257915.067934:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [441:441:256:4294967295] 192.168.202.108@tcp LPNI seq info [440:440:8:4294967295] 00000400:00000010:2.0:1734257915.067936:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734257915.067938:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098218752, offset 0 00000400:00000200:0.0:1734257915.067943:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:2.0:1734257915.067947:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734257915.067949:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734257915.067953:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734257915.067959:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257915.067967:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257915.067968:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257915.067974:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257915.067977:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257915.067980:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:0.0:1734257915.067982:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734257915.067982:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257915.067985:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [442:442:255:4294967295] 192.168.202.108@tcp LPNI seq info [441:441:7:4294967295] 00000400:00000200:2.0:1734257915.067993:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257915.067999:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257915.068003:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257915.068007:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257915.068015:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257915.068019:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257915.068055:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257915.068057:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:0.0:1734257915.068062:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257915.068067:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257915.068072:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:0.0:1734257915.068074:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734257915.068083:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098218880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257925 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257915.068182:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257915.068184:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257915.068188:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257915.068190:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257915.068192:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734257915.068193:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734257915.068197:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098218752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257931 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257915.071530:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257915.071555:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60db80 00000400:00000200:0.0:1734257915.071565:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xeb9 [1] + 0 00000400:00000200:0.0:1734257915.071624:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257915.071629:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257915.071640:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098218880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257925 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257915.071746:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d508f0. 00000400:00000200:2.0:1734257915.071759:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:2.0:1734257915.071762:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:2.0:1734257915.071772:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098218880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257925 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257915.071782:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098218880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257925 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257915.071812:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734257915.071819:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734257915.071822:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000200:0.0:1734257915.072066:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257915.072072:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60db00 00000400:00000200:0.0:1734257915.072078:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xec1 [1] + 224 00000400:00000200:0.0:1734257915.072088:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257915.072090:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257915.072096:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098218752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257931 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257915.072190:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257915.072194:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257915.072196:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257915.072201:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098218752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257931 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257915.072208:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098218752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257931 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257915.072228:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734257915.072237:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734257915.072241:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257920.075679:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257920.075698:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257920.075757:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257920.075763:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257920.075786:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734257920.075793:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734257920.075798:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257920.075804:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098219008, portal 25 00000400:00000010:2.0:1734257920.075807:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734257920.075809:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098219008, offset 0 00000400:00000200:2.0:1734257920.075824:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257920.075835:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257920.075839:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257920.075843:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257920.075845:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257920.075847:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:3.0:1734257920.075847:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000200:2.0:1734257920.075850:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [443:443:256:4294967295] 192.168.202.108@tcp LPNI seq info [442:442:8:4294967295] 00000400:00000010:3.0:1734257920.075852:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257920.075855:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000200:2.0:1734257920.075857:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:3.0:1734257920.075858:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098219136, portal 10 00000400:00000010:3.0:1734257920.075861:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000800:00000200:2.0:1734257920.075862:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734257920.075863:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098219136, offset 0 00000800:00000010:2.0:1734257920.075865:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000400:00000200:3.0:1734257920.075867:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734257920.075870:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257920.075872:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257920.075874:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257920.075876:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734257920.075877:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734257920.075878:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257920.075879:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734257920.075880:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734257920.075881:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [444:444:255:4294967295] 192.168.202.108@tcp LPNI seq info [443:443:7:4294967295] 00000400:00000200:3.0:1734257920.075887:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257920.075891:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257920.075893:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734257920.075896:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257920.075899:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257920.075901:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257920.077435:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257920.077441:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257920.077449:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257920.077456:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257920.077461:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734257920.077463:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734257920.077472:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098219008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257936 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257920.077548:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257920.077551:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734257920.077554:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257920.077558:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257920.077560:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734257920.077562:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:0.0:1734257920.077567:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098219136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257930 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257920.080414:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257920.080434:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60dc00 00000400:00000200:0.0:1734257920.080443:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xec9 [1] + 224 00000400:00000200:0.0:1734257920.080468:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257920.080474:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257920.080483:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098219008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257936 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257920.080794:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257920.080800:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257920.080802:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257920.080808:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098219008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257936 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257920.080814:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098219008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257936 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257920.080836:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734257920.080841:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734257920.080845:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:0.0:1734257920.081644:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257920.081656:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60dc80 00000400:00000200:0.0:1734257920.081670:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xed1 [1] + 0 00000400:00000200:0.0:1734257920.081691:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257920.081695:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257920.081702:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098219136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257930 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257920.081759:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257920.081763:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257920.081764:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257920.081769:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098219136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257930 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257920.081786:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098219136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257930 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257920.081803:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257920.081806:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257920.081808:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734257925.084140:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257925.084165:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257925.084232:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257925.084239:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734257925.084358:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257925.084366:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257925.084373:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257925.084381:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098219264, portal 25 00000400:00000010:3.0:1734257925.084386:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734257925.084388:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098219264, offset 0 00000400:00000200:3.0:1734257925.084398:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257925.084418:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257925.084424:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257925.084428:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257925.084431:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257925.084434:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:2.0:1734257925.084436:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:3.0:1734257925.084438:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [445:445:256:4294967295] 192.168.202.108@tcp LPNI seq info [444:444:8:4294967295] 00000400:00000010:2.0:1734257925.084440:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734257925.084443:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257925.084445:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098219392, portal 10 00000400:00000200:3.0:1734257925.084447:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:2.0:1734257925.084449:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734257925.084450:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098219392, offset 0 00000800:00000200:3.0:1734257925.084452:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257925.084453:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257925.084456:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000400:00000200:2.0:1734257925.084458:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257925.084460:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257925.084461:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734257925.084462:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257925.084463:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257925.084465:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257925.084467:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [446:446:255:4294967295] 192.168.202.108@tcp LPNI seq info [445:445:7:4294967295] 00000800:00000200:3.0:1734257925.084472:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257925.084474:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257925.084476:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734257925.084477:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257925.084479:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257925.084482:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257925.084486:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257925.084488:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257925.084798:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257925.084801:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734257925.084806:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257925.084810:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257925.084814:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:0.0:1734257925.084816:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:0.0:1734257925.084823:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098219264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257941 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257925.084901:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257925.084904:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257925.084906:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257925.084909:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257925.084911:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734257925.084912:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734257925.084916:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098219392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257935 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257925.086720:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257925.086736:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60dd80 00000400:00000200:0.0:1734257925.086743:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xee1 [1] + 0 00000400:00000200:0.0:1734257925.086771:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257925.086775:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257925.086790:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098219392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257935 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257925.088455:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257925.088470:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257925.088472:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257925.088483:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098219392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257935 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257925.088492:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098219392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257935 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257925.088525:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257925.088532:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257925.088537:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000200:0.0:1734257925.088917:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257925.088931:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60dd00 00000400:00000200:0.0:1734257925.088939:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xed9 [1] + 224 00000400:00000200:0.0:1734257925.088959:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257925.088963:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257925.088971:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098219264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257941 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257925.089086:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257925.089090:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257925.089092:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257925.089097:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098219264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257941 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257925.089117:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098219264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257941 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257925.089129:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257925.089134:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734257925.089136:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257930.095194:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257930.095222:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257930.095294:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257930.095308:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734257930.095441:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 02000000:00000010:2.0:1734257930.095446:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:3.0:1734257930.095449:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257930.095456:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257930.095464:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098219520, portal 25 00000400:00000010:3.0:1734257930.095471:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734257930.095473:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098219520, offset 0 00000400:00000200:3.0:1734257930.095482:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734257930.095492:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000200:3.0:1734257930.095494:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734257930.095498:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000400:00000200:3.0:1734257930.095500:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:2.0:1734257930.095503:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098219648, portal 10 00000400:00000200:3.0:1734257930.095504:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257930.095507:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257930.095509:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257930.095511:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [447:447:256:4294967295] 192.168.202.108@tcp LPNI seq info [446:446:8:4294967295] 00000400:00000200:3.0:1734257930.095518:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:2.0:1734257930.095520:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734257930.095522:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098219648, offset 0 00000800:00000200:3.0:1734257930.095523:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257930.095527:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000400:00000200:2.0:1734257930.095529:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734257930.095532:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257930.095538:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734257930.095540:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257930.095544:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257930.095549:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257930.095552:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257930.095555:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257930.095557:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257930.095560:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [448:448:255:4294967295] 192.168.202.108@tcp LPNI seq info [447:447:7:4294967295] 00000400:00000200:2.0:1734257930.095640:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257930.095644:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257930.095658:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734257930.095662:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257930.095668:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257930.095671:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257930.095849:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257930.095852:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734257930.095856:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257930.095861:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257930.095865:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:0.0:1734257930.095867:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:0.0:1734257930.095875:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098219520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257946 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257930.095947:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257930.095949:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257930.095951:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257930.095954:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257930.095956:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734257930.095958:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734257930.095962:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098219648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257940 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257930.102175:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257930.102212:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60de00 00000400:00000200:0.0:1734257930.102222:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xee9 [1] + 224 00000400:00000200:0.0:1734257930.102235:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257930.102238:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257930.102249:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098219520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257946 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257930.102287:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257930.102291:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60de80 00000400:00000200:0.0:1734257930.102296:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xef1 [1] + 0 00000400:00000200:0.0:1734257930.102309:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257930.102311:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257930.102316:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098219648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257940 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257930.102418:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257930.102422:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257930.102424:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257930.102428:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098219520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257946 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257930.102444:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098219520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257946 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257930.102467:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257930.102472:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734257930.102476:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:2.0:1734257930.102552:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257930.102556:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257930.102557:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257930.102563:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098219648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257940 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257930.102604:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098219648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257940 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257930.102627:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257930.102632:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257930.102636:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734257935.099684:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734257935.099702:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734257935.099763:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734257935.099771:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257935.099868:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257935.099874:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257935.099879:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257935.099884:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098219904, portal 10 00000400:00000010:3.0:1734257935.099889:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734257935.099891:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098219904, offset 0 00000400:00000200:3.0:1734257935.099899:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257935.099908:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257935.099913:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257935.099918:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257935.099920:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257935.099922:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257935.099925:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [449:449:256:4294967295] 192.168.202.108@tcp LPNI seq info [448:448:8:4294967295] 00000400:00000200:3.0:1734257935.099932:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257935.099937:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257935.099940:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734257935.099945:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257935.099951:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257935.099954:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257935.100202:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257935.100205:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734257935.100208:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257935.100213:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257935.100217:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734257935.100218:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:0.0:1734257935.100224:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098219904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257945 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257935.100635:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734257935.100640:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257935.100644:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257935.100647:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098219776, portal 25 00000400:00000010:1.0:1734257935.100649:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:1.0:1734257935.100650:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098219776, offset 0 00000400:00000200:1.0:1734257935.100655:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257935.100660:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257935.100662:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257935.100664:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257935.100666:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257935.100667:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257935.100669:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [450:450:256:4294967295] 192.168.202.108@tcp LPNI seq info [449:449:8:4294967295] 00000400:00000200:1.0:1734257935.100675:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257935.100679:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257935.100681:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734257935.100684:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257935.100688:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257935.100690:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257935.100967:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257935.100970:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734257935.100972:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257935.100975:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257935.100978:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:0.0:1734257935.100996:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:0.0:1734257935.101000:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098219776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257951 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257935.105129:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257935.105151:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60df80 00000400:00000200:0.0:1734257935.105159:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xef9 [1] + 0 00000400:00000200:0.0:1734257935.105182:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257935.105186:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257935.105195:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098219904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257945 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257935.105372:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257935.105376:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257935.105378:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257935.105383:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098219904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257945 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257935.105403:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098219904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257945 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257935.105436:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257935.105440:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257935.105445:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734257935.105947:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257935.105956:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60df00 00000400:00000200:0.0:1734257935.105962:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf01 [1] + 224 00000400:00000200:0.0:1734257935.105973:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257935.105977:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257935.105992:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098219776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257951 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257935.106210:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257935.106214:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257935.106215:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257935.106218:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098219776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257951 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257935.106223:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098219776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257951 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257935.106232:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734257935.106234:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734257935.106235:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734257940.107671:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734257940.107688:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257940.107741:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734257940.107747:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734257940.107764:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734257940.107772:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734257940.107788:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257940.107793:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098220032, portal 25 00000400:00000010:2.0:1734257940.107797:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734257940.107799:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098220032, offset 0 02000000:00000010:3.0:1734257940.107801:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257940.107805:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:2.0:1734257940.107806:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734257940.107816:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000200:2.0:1734257940.107818:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:3.0:1734257940.107818:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098220160, portal 10 00000400:00000200:2.0:1734257940.107822:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734257940.107822:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734257940.107823:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098220160, offset 0 00000400:00000200:2.0:1734257940.107825:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257940.107826:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257940.107828:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257940.107830:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257940.107833:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [451:451:256:4294967295] 192.168.202.108@tcp LPNI seq info [450:450:8:4294967295] 00000400:00000200:2.0:1734257940.107840:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257940.107845:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257940.107845:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257940.107846:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734257940.107848:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734257940.107848:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257940.107849:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257940.107851:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257940.107852:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [452:452:255:4294967295] 192.168.202.108@tcp LPNI seq info [451:451:7:4294967295] 00000800:00000200:2.0:1734257940.107853:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734257940.107857:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257940.107859:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257940.107860:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734257940.107862:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:3.0:1734257940.107862:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734257940.107864:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257940.107866:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257940.107868:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257940.108976:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257940.108981:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734257940.108986:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257940.108990:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257940.108994:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734257940.108996:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734257940.109227:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098220032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257956 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257940.109391:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257940.109400:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734257940.109916:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257940.109922:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257940.109931:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:0.0:1734257940.109933:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:0.0:1734257940.109939:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098220160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257950 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257940.112705:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257940.112724:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e000 00000400:00000200:0.0:1734257940.112732:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf09 [1] + 224 00000400:00000200:0.0:1734257940.112754:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257940.112758:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257940.112769:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098220032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257956 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257940.113039:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257940.113044:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257940.113045:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257940.113050:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098220032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257956 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257940.113055:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098220032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257956 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257940.113076:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734257940.113079:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734257940.113082:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734257940.114420:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257940.114440:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e080 00000400:00000200:0.0:1734257940.114449:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xf11 [1] + 0 00000400:00000200:0.0:1734257940.114471:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257940.114475:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257940.114489:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098220160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257950 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257940.114789:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257940.114796:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257940.114797:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257940.114805:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098220160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257950 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257940.114825:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098220160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257950 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257940.114846:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257940.114850:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257940.114854:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734257945.115834:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734257945.115853:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 02000000:00000010:3.0:1734257945.115935:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000100:00000010:0.0:1734257945.115962:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734257945.115970:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 00000400:00000010:3.0:1734257945.116032:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257945.116039:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257945.116045:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098220288, portal 25 00000400:00000010:3.0:1734257945.116048:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734257945.116050:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098220288, offset 0 00000400:00000200:3.0:1734257945.116058:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257945.116069:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257945.116074:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257945.116078:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257945.116080:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257945.116082:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257945.116084:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [453:453:256:4294967295] 192.168.202.108@tcp LPNI seq info [452:452:8:4294967295] 00000400:00000200:3.0:1734257945.116091:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257945.116096:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257945.116099:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734257945.116104:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257945.116110:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257945.116114:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257945.116184:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257945.116188:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734257945.116191:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257945.116194:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098220416, portal 10 00000400:00000010:2.0:1734257945.116207:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734257945.116209:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098220416, offset 0 00000400:00000200:2.0:1734257945.116214:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257945.116218:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257945.116220:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257945.116222:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257945.116224:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257945.116226:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257945.116228:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [454:454:255:4294967295] 192.168.202.108@tcp LPNI seq info [453:453:7:4294967295] 00000400:00000200:2.0:1734257945.116234:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257945.116238:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257945.116240:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257945.116243:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257945.116246:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257945.116248:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257945.119169:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257945.119177:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:1.0:1734257945.119184:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257945.119192:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257945.119197:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:1.0:1734257945.119198:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:1.0:1734257945.119208:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098220288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257961 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257945.119281:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257945.119283:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734257945.119286:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257945.119290:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257945.119292:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:1.0:1734257945.119293:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:1.0:1734257945.119298:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098220416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257955 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257945.123513:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257945.123531:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e100 00000400:00000200:0.0:1734257945.123538:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf19 [1] + 224 00000400:00000200:0.0:1734257945.123556:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257945.123565:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257945.123598:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098220288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257961 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257945.123666:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257945.123671:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257945.123673:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257945.123678:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098220288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257961 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257945.123695:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098220288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257961 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257945.123715:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257945.123719:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734257945.123722:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000200:0.0:1734257945.124589:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257945.124599:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e180 00000400:00000200:0.0:1734257945.124604:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xf21 [1] + 0 00000400:00000200:0.0:1734257945.124619:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257945.124622:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257945.124628:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098220416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257955 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257945.125991:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257945.125997:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257945.125999:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257945.126005:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098220416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257955 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257945.126012:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098220416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257955 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257945.126034:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257945.126040:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734257945.126043:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734257950.125563:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734257950.125592:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734257950.125651:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734257950.125658:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734257950.125747:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734257950.125754:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257950.125760:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257950.125765:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098220544, portal 25 00000400:00000010:1.0:1734257950.125769:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734257950.125770:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098220544, offset 0 00000400:00000200:1.0:1734257950.125778:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734257950.125787:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:1.0:1734257950.125788:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734257950.125791:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000200:1.0:1734257950.125792:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734257950.125794:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000400:00000200:1.0:1734257950.125795:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257950.125797:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:2.0:1734257950.125797:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098220672, portal 10 00000400:00000200:1.0:1734257950.125799:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257950.125801:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [455:455:256:4294967295] 192.168.202.108@tcp LPNI seq info [454:454:8:4294967295] 00000400:00000010:2.0:1734257950.125801:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000400:00000200:1.0:1734257950.125808:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257950.125812:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734257950.125812:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098220672, offset 0 00000400:00000200:2.0:1734257950.125817:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257950.125819:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000400:00000200:2.0:1734257950.125821:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734257950.125824:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734257950.125824:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257950.125826:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257950.125828:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257950.125829:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734257950.125830:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734257950.125831:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [456:456:255:4294967295] 192.168.202.108@tcp LPNI seq info [455:455:7:4294967295] 00000800:00000200:1.0:1734257950.125833:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734257950.125838:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257950.125841:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257950.125844:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257950.125847:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734257950.125960:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257950.125963:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734257950.125966:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257950.125970:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257950.125972:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:0.0:1734257950.125974:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:0.0:1734257950.125979:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098220544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257966 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734257950.126042:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257950.126044:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257950.126103:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257950.126105:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257950.126108:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257950.126111:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257950.126112:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734257950.126114:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734257950.126117:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098220672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257960 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257950.129355:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257950.129379:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e200 00000400:00000200:0.0:1734257950.129385:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf29 [1] + 224 00000400:00000200:0.0:1734257950.129398:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257950.129401:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257950.129409:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098220544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257966 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257950.129596:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257950.129600:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257950.129602:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257950.129606:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098220544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257966 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257950.129613:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098220544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257966 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257950.129630:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734257950.129633:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734257950.129636:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:0.0:1734257950.131542:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257950.131556:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e280 00000400:00000200:0.0:1734257950.131563:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xf31 [1] + 0 00000400:00000200:0.0:1734257950.131601:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257950.131605:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257950.131614:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098220672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257960 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257950.131683:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257950.131687:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257950.131689:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257950.131694:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098220672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257960 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257950.131700:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098220672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257960 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257950.131723:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257950.131728:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734257950.131732:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734257955.131694:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734257955.131714:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734257955.131771:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734257955.131778:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734257955.131880:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734257955.131888:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257955.131895:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257955.131903:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098220800, portal 25 00000400:00000010:1.0:1734257955.131909:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 00000100:00000200:1.0:1734257955.131911:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098220800, offset 0 00000400:00000200:1.0:1734257955.131919:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257955.131934:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257955.131940:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257955.131944:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257955.131948:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257955.131950:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257955.131952:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [457:457:256:4294967295] 192.168.202.108@tcp LPNI seq info [456:456:8:4294967295] 00000400:00000200:1.0:1734257955.131961:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257955.131967:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257955.131971:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734257955.131989:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257955.131997:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257955.132002:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734257955.132042:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257955.132051:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257955.132057:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257955.132063:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098220928, portal 10 00000400:00000010:3.0:1734257955.132072:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734257955.132075:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098220928, offset 0 00000400:00000200:3.0:1734257955.132082:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257955.132093:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257955.132099:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257955.132102:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257955.132104:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257955.132106:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257955.132109:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [458:458:255:4294967295] 192.168.202.108@tcp LPNI seq info [457:457:7:4294967295] 00000400:00000200:3.0:1734257955.132118:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257955.132126:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257955.132133:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734257955.132140:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257955.132147:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257955.132152:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257955.132206:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257955.132210:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734257955.132213:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257955.132218:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257955.132223:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:0.0:1734257955.132225:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:0.0:1734257955.132233:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098220800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257971 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257955.132259:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257955.132261:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734257955.132263:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257955.132266:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257955.132268:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:0.0:1734257955.132275:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734257955.132278:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098220928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257965 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257955.135343:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257955.135365:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e380 00000400:00000200:0.0:1734257955.135376:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xf41 [1] + 0 00000400:00000200:0.0:1734257955.135390:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257955.135394:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257955.135405:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098220928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257965 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257955.135448:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257955.135452:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e300 00000400:00000200:0.0:1734257955.135457:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf39 [1] + 224 00000400:00000200:0.0:1734257955.135477:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257955.135480:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257955.135486:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098220800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257971 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257955.135847:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257955.135854:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257955.135856:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257955.135862:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098220800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257971 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257955.135869:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098220800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257971 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257955.135896:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734257955.135901:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734257955.135906:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:3.0:1734257955.135985:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257955.135999:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257955.136002:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257955.136015:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098220928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257965 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257955.136049:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098220928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257965 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257955.136087:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257955.136096:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734257955.136102:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734257960.139746:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257960.139774:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257960.139881:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257960.139892:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257960.140023:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257960.140035:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257960.140045:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257960.140054:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098221184, portal 10 00000400:00000010:3.0:1734257960.140063:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734257960.140065:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098221184, offset 0 00000400:00000200:3.0:1734257960.140077:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257960.140095:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257960.140101:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257960.140105:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257960.140109:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257960.140111:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257960.140114:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [459:459:256:4294967295] 192.168.202.108@tcp LPNI seq info [458:458:8:4294967295] 00000400:00000200:3.0:1734257960.140125:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257960.140132:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257960.140136:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734257960.140142:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257960.140151:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257960.140155:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734257960.140247:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734257960.140252:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257960.140255:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257960.140257:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098221056, portal 25 00000400:00000010:1.0:1734257960.140260:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734257960.140261:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098221056, offset 0 00000400:00000200:1.0:1734257960.140266:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257960.140271:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257960.140273:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257960.140275:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257960.140277:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257960.140279:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257960.140281:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [460:460:255:4294967295] 192.168.202.108@tcp LPNI seq info [459:459:7:4294967295] 00000400:00000200:1.0:1734257960.140286:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257960.140289:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257960.140292:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734257960.140294:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257960.140298:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257960.140316:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257960.141355:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257960.141360:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734257960.141366:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257960.141371:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257960.141375:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:0.0:1734257960.141377:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734257960.141387:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098221184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257970 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257960.141684:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257960.141687:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734257960.141690:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257960.141693:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257960.141695:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734257960.141696:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734257960.141701:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098221056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257976 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257960.146019:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257960.146042:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e400 00000400:00000200:0.0:1734257960.146053:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf51 [1] + 224 00000400:00000200:0.0:1734257960.146148:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257960.146153:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257960.146166:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098221056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257976 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257960.146211:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257960.146216:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e480 00000400:00000200:0.0:1734257960.146222:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xf49 [1] + 0 00000400:00000200:0.0:1734257960.146234:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257960.146237:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257960.146243:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098221184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257970 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257960.146251:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257960.146259:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257960.146261:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257960.146268:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098221056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257976 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257960.146276:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098221056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257976 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257960.146308:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734257960.146313:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734257960.146318:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:3.0:1734257960.146710:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257960.146716:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257960.146718:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257960.146723:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098221184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257970 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257960.146744:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098221184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257970 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257960.146765:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257960.146768:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734257960.146770:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734257965.147683:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257965.147702:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734257965.147782:0:9088:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257965.147789:0:9088:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734257965.147878:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257965.147885:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734257965.147891:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257965.147897:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098221440, portal 10 00000400:00000010:2.0:1734257965.147901:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000100:00000200:2.0:1734257965.147903:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098221440, offset 0 00000400:00000200:2.0:1734257965.147921:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257965.147931:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257965.147935:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257965.147938:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257965.147941:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257965.147943:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257965.147945:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [461:461:256:4294967295] 192.168.202.108@tcp LPNI seq info [460:460:8:4294967295] 00000400:00000200:2.0:1734257965.147951:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257965.147955:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257965.147958:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257965.147963:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257965.147970:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257965.147973:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257965.148092:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257965.148094:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257965.148102:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257965.148106:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257965.148109:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734257965.148110:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734257965.148115:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098221440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257975 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257965.148182:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734257965.148186:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257965.148189:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257965.148192:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098221312, portal 25 00000400:00000010:1.0:1734257965.148194:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734257965.148195:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098221312, offset 0 00000400:00000200:1.0:1734257965.148199:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257965.148202:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257965.148205:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257965.148206:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257965.148208:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257965.148209:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257965.148211:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [462:462:256:4294967295] 192.168.202.108@tcp LPNI seq info [461:461:8:4294967295] 00000400:00000200:1.0:1734257965.148216:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257965.148219:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257965.148221:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734257965.148223:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257965.148227:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257965.148228:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257965.148324:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257965.148326:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734257965.148328:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257965.148331:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257965.148333:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:0.0:1734257965.148334:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:0.0:1734257965.148337:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098221312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257981 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257965.150291:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257965.150309:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e580 00000400:00000200:0.0:1734257965.150316:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xf59 [1] + 0 00000400:00000200:0.0:1734257965.150334:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257965.150338:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257965.150348:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098221440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257965.150449:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257965.150453:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257965.150455:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257965.150459:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098221440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257975 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257965.150465:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098221440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257975 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257965.150493:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257965.150500:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257965.150503:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734257965.152110:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257965.152122:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e500 00000400:00000200:0.0:1734257965.152130:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf61 [1] + 224 00000400:00000200:0.0:1734257965.152150:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257965.152154:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257965.152163:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098221312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257981 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257965.152228:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257965.152234:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257965.152235:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257965.152241:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098221312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257981 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257965.152248:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098221312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257981 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257965.152271:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734257965.152276:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734257965.152279:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734257970.155681:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257970.155741:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734257970.155798:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257970.155804:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734257970.155945:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257970.155958:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257970.155966:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257970.155974:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098221568, portal 25 00000400:00000010:3.0:1734257970.155979:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734257970.155981:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098221568, offset 0 00000400:00000200:3.0:1734257970.155991:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257970.156007:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257970.156013:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257970.156016:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257970.156020:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257970.156022:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257970.156025:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [463:463:256:4294967295] 192.168.202.108@tcp LPNI seq info [462:462:8:4294967295] 00000400:00000200:3.0:1734257970.156034:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257970.156040:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257970.156044:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734257970.156050:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257970.156058:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257970.156062:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257970.156424:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257970.156431:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734257970.156437:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257970.156442:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098221696, portal 10 00000400:00000010:2.0:1734257970.156452:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734257970.156454:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098221696, offset 0 00000400:00000200:2.0:1734257970.156461:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257970.156478:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257970.156483:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257970.156486:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257970.156488:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257970.156490:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257970.156493:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [464:464:255:4294967295] 192.168.202.108@tcp LPNI seq info [463:463:7:4294967295] 00000400:00000200:2.0:1734257970.156500:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257970.156505:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257970.156509:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734257970.156513:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257970.156520:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257970.156524:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734257970.156795:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257970.156800:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:1.0:1734257970.156803:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257970.156809:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257970.156813:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:1.0:1734257970.156814:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:1.0:1734257970.156822:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098221568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257986 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734257970.156864:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257970.156867:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734257970.156869:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257970.156872:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257970.156873:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:1.0:1734257970.156875:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:1.0:1734257970.156879:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098221696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257980 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257970.161696:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257970.161723:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e600 00000400:00000200:0.0:1734257970.161732:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf69 [1] + 224 00000400:00000200:0.0:1734257970.161743:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257970.161747:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257970.161759:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098221568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257986 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257970.161795:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257970.161799:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e680 00000400:00000200:0.0:1734257970.161805:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xf71 [1] + 0 00000400:00000200:0.0:1734257970.161821:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257970.161823:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257970.161827:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098221696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257980 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257970.162387:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257970.162400:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257970.162402:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257970.162412:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098221568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257986 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257970.162439:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098221568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257986 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257970.162466:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257970.162474:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734257970.162479:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:2.0:1734257970.162606:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257970.162613:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257970.162615:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257970.162621:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098221696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257980 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257970.162627:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098221696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257980 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257970.162653:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257970.162658:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734257970.162662:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257975.164295:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257975.164318:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734257975.164394:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257975.164404:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734257975.164470:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257975.164476:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257975.164480:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257975.164485:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098221952, portal 10 00000400:00000010:3.0:1734257975.164489:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734257975.164491:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098221952, offset 0 00000400:00000200:3.0:1734257975.164497:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257975.164506:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257975.164510:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257975.164512:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257975.164515:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257975.164516:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257975.164518:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [465:465:256:4294967295] 192.168.202.108@tcp LPNI seq info [464:464:8:4294967295] 00000400:00000200:3.0:1734257975.164524:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257975.164527:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257975.164530:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734257975.164534:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257975.164540:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257975.164542:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734257975.164698:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734257975.164702:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734257975.164706:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257975.164708:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098221824, portal 25 00000400:00000010:2.0:1734257975.164711:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734257975.164713:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098221824, offset 0 00000400:00000200:2.0:1734257975.164717:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257975.164722:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257975.164734:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257975.164736:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257975.164738:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257975.164740:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257975.164742:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [466:466:255:4294967295] 192.168.202.108@tcp LPNI seq info [465:465:7:4294967295] 00000400:00000200:2.0:1734257975.164748:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257975.164752:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257975.164754:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734257975.164757:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257975.164761:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257975.164763:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257975.165399:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257975.165404:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734257975.165410:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257975.165415:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257975.165419:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:0.0:1734257975.165421:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734257975.165430:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098221952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257985 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257975.165520:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257975.165523:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734257975.165527:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257975.165530:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257975.165533:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734257975.165534:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734257975.165848:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098221824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257991 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257975.168831:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257975.168856:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e700 00000400:00000200:0.0:1734257975.168865:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf81 [1] + 224 00000400:00000200:0.0:1734257975.168879:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257975.168883:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257975.168894:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098221824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257975.168941:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257975.168946:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e780 00000400:00000200:0.0:1734257975.169245:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xf79 [1] + 0 00000400:00000200:0.0:1734257975.169267:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257975.169270:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257975.169274:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098221952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257985 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257975.169544:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257975.169549:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257975.169551:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257975.169556:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098221824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257991 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257975.169563:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098221824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257991 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257975.169627:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734257975.169631:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734257975.169635:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:3.0:1734257975.169708:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257975.169713:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257975.169714:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257975.169719:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098221952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257985 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257975.169738:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098221952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257985 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257975.169756:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257975.169759:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734257975.169762:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257980.174768:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734257980.174791:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734257980.174857:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734257980.174865:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734257980.174967:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734257980.174980:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257980.174987:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257980.174995:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098222080, portal 25 00000400:00000010:1.0:1734257980.174999:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734257980.175001:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098222080, offset 0 00000400:00000200:1.0:1734257980.175022:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257980.175036:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257980.175040:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257980.175044:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257980.175048:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257980.175049:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257980.175052:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [467:467:256:4294967295] 192.168.202.108@tcp LPNI seq info [466:466:8:4294967295] 00000400:00000200:1.0:1734257980.175059:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257980.175065:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257980.175069:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734257980.175075:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257980.175084:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257980.175087:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257980.175232:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257980.175235:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734257980.175242:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257980.175246:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257980.175250:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:0.0:1734257980.175251:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734257980.175257:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098222080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257996 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257980.175296:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257980.175305:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257980.175308:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257980.175310:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098222208, portal 10 00000400:00000010:3.0:1734257980.175313:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734257980.175314:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098222208, offset 0 00000400:00000200:3.0:1734257980.175317:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257980.175321:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257980.175323:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257980.175325:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257980.175326:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257980.175327:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257980.175328:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [468:468:256:4294967295] 192.168.202.108@tcp LPNI seq info [467:467:8:4294967295] 00000400:00000200:3.0:1734257980.175333:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257980.175335:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257980.175336:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734257980.175338:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257980.175341:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257980.175342:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257980.175389:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257980.175391:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734257980.175394:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257980.175397:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257980.175399:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734257980.175400:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734257980.175403:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098222208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257990 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257980.177322:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257980.177340:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e880 00000400:00000200:0.0:1734257980.177348:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xf91 [1] + 0 00000400:00000200:0.0:1734257980.177369:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257980.177372:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257980.177382:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098222208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257980.177477:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257980.177480:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257980.177482:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257980.177486:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098222208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257990 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257980.177504:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098222208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257990 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257980.177528:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257980.177531:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734257980.177535:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734257980.177797:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257980.177803:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e800 00000400:00000200:0.0:1734257980.177807:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf89 [1] + 224 00000400:00000200:0.0:1734257980.177817:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257980.177820:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257980.177825:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098222080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257996 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257980.177907:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257980.177911:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257980.177912:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257980.177916:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098222080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257996 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257980.177921:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098222080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734257996 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257980.177933:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734257980.177936:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734257980.177937:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734257985.180342:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734257985.180383:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734257985.180463:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734257985.180471:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734257985.180736:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257985.180742:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257985.180748:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257985.180754:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098222336, portal 25 00000400:00000010:3.0:1734257985.180758:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734257985.180760:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098222336, offset 0 00000400:00000200:3.0:1734257985.180767:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257985.180778:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257985.180783:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257985.180787:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257985.180790:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257985.180792:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257985.180795:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [469:469:256:4294967295] 192.168.202.108@tcp LPNI seq info [468:468:8:4294967295] 00000400:00000200:3.0:1734257985.180802:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257985.180806:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257985.180809:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734257985.180813:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257985.180820:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257985.180823:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734257985.180976:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257985.180986:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734257985.180993:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257985.180998:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098222464, portal 10 00000400:00000010:2.0:1734257985.181004:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000100:00000200:2.0:1734257985.181006:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098222464, offset 0 00000400:00000200:2.0:1734257985.181014:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257985.181025:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257985.181028:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257985.181042:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257985.181044:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257985.181047:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257985.181049:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [470:470:255:4294967295] 192.168.202.108@tcp LPNI seq info [469:469:7:4294967295] 00000400:00000200:2.0:1734257985.181057:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257985.181061:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257985.181064:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734257985.181069:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257985.181075:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257985.181078:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257985.181107:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257985.181110:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734257985.181113:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257985.181117:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257985.181121:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734257985.181122:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734257985.181128:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098222336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258001 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734257985.181151:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257985.181152:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734257985.181154:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257985.181156:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257985.181158:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734257985.181159:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734257985.181162:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098222464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257995 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257985.184807:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257985.184826:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60e980 00000400:00000200:0.0:1734257985.184837:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xfa1 [1] + 0 00000400:00000200:0.0:1734257985.184852:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257985.184856:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257985.184867:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098222464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257985.184907:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257985.184912:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60e900 00000400:00000200:0.0:1734257985.184917:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xf99 [1] + 224 00000400:00000200:0.0:1734257985.184934:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257985.184944:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257985.184948:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098222336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258001 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734257985.185120:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734257985.185125:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734257985.185127:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257985.185132:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098222464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257995 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734257985.185137:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098222464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734257995 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257985.185165:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734257985.185171:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734257985.185175:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:3.0:1734257985.185676:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257985.185680:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257985.185681:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257985.185687:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098222336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258001 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257985.185702:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098222336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258001 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257985.185714:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257985.185718:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734257985.185720:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734257990.189800:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734257990.189822:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734257990.189883:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734257990.189890:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257990.189996:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734257990.190003:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257990.190010:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257990.190016:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098222592, portal 25 00000400:00000010:3.0:1734257990.190020:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734257990.190022:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098222592, offset 0 00000400:00000200:3.0:1734257990.190030:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257990.190043:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257990.190048:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257990.190051:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257990.190053:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257990.190055:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257990.190058:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [471:471:256:4294967295] 192.168.202.108@tcp LPNI seq info [470:470:8:4294967295] 00000400:00000200:3.0:1734257990.190065:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257990.190070:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257990.190074:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734257990.190080:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257990.190086:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257990.190090:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734257990.190253:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257990.190256:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734257990.190260:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257990.190264:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257990.190268:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734257990.190269:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734257990.190275:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098222592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258006 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734257990.190337:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734257990.190341:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734257990.190344:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734257990.190346:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098222720, portal 10 00000400:00000010:2.0:1734257990.190350:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734257990.190351:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098222720, offset 0 00000400:00000200:2.0:1734257990.190355:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734257990.190359:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734257990.190362:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734257990.190363:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734257990.190376:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734257990.190377:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734257990.190379:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [472:472:256:4294967295] 192.168.202.108@tcp LPNI seq info [471:471:8:4294967295] 00000400:00000200:2.0:1734257990.190385:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734257990.190389:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734257990.190392:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734257990.190394:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734257990.190398:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734257990.190400:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257990.190472:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257990.190474:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734257990.190477:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257990.190479:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257990.190482:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734257990.190483:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734257990.190486:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098222720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257990.193040:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257990.193128:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ea80 00000400:00000200:0.0:1734257990.193137:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xfb1 [1] + 0 00000400:00000200:0.0:1734257990.193161:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257990.193165:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257990.196658:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098222720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258000 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257990.196786:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:3.0:1734257990.196791:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:3.0:1734257990.196793:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:3.0:1734257990.196799:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098222720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257990.196821:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098222720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258000 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257990.196846:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734257990.196851:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734257990.196854:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734257990.197705:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257990.197720:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ea00 00000400:00000200:0.0:1734257990.197727:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xfa9 [1] + 224 00000400:00000200:0.0:1734257990.197742:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257990.197746:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257990.197753:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098222592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258006 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257990.197821:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257990.197825:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257990.197826:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257990.197830:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098222592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258006 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257990.197836:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098222592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258006 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257990.197848:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734257990.197852:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734257990.197854:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734257995.195695:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734257995.195716:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 02000000:00000010:1.0:1734257995.195799:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734257995.195806:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734257995.195811:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257995.195817:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098222848, portal 25 00000400:00000010:1.0:1734257995.195821:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734257995.195822:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098222848, offset 0 00000400:00000200:1.0:1734257995.195830:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734257995.195841:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734257995.195855:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734257995.195858:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734257995.195861:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734257995.195863:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734257995.195865:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [473:473:256:4294967295] 192.168.202.108@tcp LPNI seq info [472:472:8:4294967295] 00000400:00000200:1.0:1734257995.195872:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734257995.195877:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734257995.195881:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734257995.195885:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734257995.195892:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734257995.195895:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734257995.195992:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734257995.195994:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:1.0:1734257995.195997:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734257995.196000:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734257995.196003:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:1.0:1734257995.196005:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734257995.196010:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098222848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258011 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734257995.196419:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734257995.196427:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734257995.196547:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734257995.196552:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734257995.196555:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257995.196558:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098222976, portal 10 00000400:00000010:3.0:1734257995.196562:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734257995.196564:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098222976, offset 0 00000400:00000200:3.0:1734257995.196592:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734257995.196598:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734257995.196601:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734257995.196604:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734257995.196606:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734257995.196607:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734257995.196609:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [474:474:256:4294967295] 192.168.202.108@tcp LPNI seq info [473:473:8:4294967295] 00000400:00000200:3.0:1734257995.196615:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734257995.196626:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734257995.196628:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734257995.196631:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734257995.196636:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734257995.196637:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734257995.196788:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734257995.196790:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734257995.196792:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257995.196795:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734257995.196798:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734257995.196799:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734257995.196804:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098222976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258005 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734257995.198618:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257995.198633:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60eb00 00000400:00000200:0.0:1734257995.198639:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xfb9 [1] + 224 00000400:00000200:0.0:1734257995.198657:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257995.198660:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257995.198669:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098222848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734257995.199033:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734257995.199037:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734257995.199039:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734257995.199043:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098222848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258011 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734257995.199050:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098222848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258011 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734257995.199067:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734257995.199071:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734257995.199074:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734257995.199326:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734257995.199333:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60eb80 00000400:00000200:0.0:1734257995.199338:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xfc1 [1] + 0 00000400:00000200:0.0:1734257995.199348:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734257995.199358:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734257995.199362:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098222976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258005 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734257995.199436:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734257995.199439:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734257995.199440:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734257995.199444:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098222976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258005 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734257995.199450:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098222976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258005 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734257995.199469:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734257995.199472:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734257995.199474:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258000.206375:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258000.206392:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258000.206444:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258000.206450:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258000.206563:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734258000.206589:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb00. 00000400:00000010:2.0:1734258000.206596:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258000.206601:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098223104, portal 25 00000400:00000010:2.0:1734258000.206605:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258000.206607:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098223104, offset 0 00000400:00000200:2.0:1734258000.206615:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258000.206626:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258000.206630:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258000.206634:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258000.206637:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258000.206638:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258000.206641:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [475:475:256:4294967295] 192.168.202.108@tcp LPNI seq info [474:474:8:4294967295] 00000400:00000200:2.0:1734258000.206648:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258000.206654:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258000.206657:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258000.206662:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:3.0:1734258000.206666:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000800:00000200:2.0:1734258000.206668:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258000.206672:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:3.0:1734258000.206672:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258000.206675:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258000.206677:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098223232, portal 10 00000400:00000010:3.0:1734258000.206682:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734258000.206683:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098223232, offset 0 00000400:00000200:3.0:1734258000.206687:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258000.206692:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258000.206694:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258000.206696:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258000.206698:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258000.206699:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258000.206701:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [476:476:255:4294967295] 192.168.202.108@tcp LPNI seq info [475:475:7:4294967295] 00000400:00000200:3.0:1734258000.206707:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258000.206710:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258000.206724:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734258000.206727:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258000.206731:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258000.206733:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258000.206897:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258000.206900:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258000.206904:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258000.206908:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258000.206911:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734258000.206913:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734258000.206920:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098223104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258016 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258000.206975:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258000.206977:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734258000.206979:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258000.206981:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258000.206983:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734258000.206984:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734258000.206988:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098223232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258010 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258000.209755:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258000.209771:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ec80 00000400:00000200:0.0:1734258000.209779:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xfd1 [1] + 0 00000400:00000200:0.0:1734258000.209789:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258000.209793:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258000.209801:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098223232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258010 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258000.209850:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258000.209855:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ec00 00000400:00000200:0.0:1734258000.209859:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xfc9 [1] + 224 00000400:00000200:0.0:1734258000.209871:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258000.209874:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258000.209878:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098223104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258000.210133:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258000.210138:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258000.210139:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258000.210144:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098223232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258010 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258000.210152:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098223232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258010 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258000.210175:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258000.210179:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258000.210183:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:2.0:1734258000.211318:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb00. 00000400:00000200:2.0:1734258000.211329:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734258000.211331:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258000.211336:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098223104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258016 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258000.211342:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098223104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258016 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258000.211355:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258000.211358:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:2.0:1734258000.211360:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258005.211710:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258005.211733:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258005.211797:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258005.211803:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734258005.212223:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258005.212231:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258005.212238:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258005.212246:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098223360, portal 25 00000400:00000010:3.0:1734258005.212250:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734258005.212252:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098223360, offset 0 00000400:00000200:3.0:1734258005.212263:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258005.212278:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258005.212284:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258005.212299:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258005.212302:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258005.212305:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258005.212308:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [477:477:256:4294967295] 192.168.202.108@tcp LPNI seq info [476:476:8:4294967295] 00000400:00000200:3.0:1734258005.212316:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258005.212322:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258005.212326:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734258005.212347:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258005.212357:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258005.212362:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258005.212600:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258005.212604:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb00. 00000400:00000010:2.0:1734258005.212608:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258005.212610:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098223488, portal 10 00000400:00000010:2.0:1734258005.212614:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734258005.212615:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098223488, offset 0 00000400:00000200:2.0:1734258005.212619:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258005.212624:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258005.212626:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258005.212628:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258005.212630:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258005.212631:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258005.212634:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [478:478:255:4294967295] 192.168.202.108@tcp LPNI seq info [477:477:7:4294967295] 00000400:00000200:2.0:1734258005.212639:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258005.212642:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258005.212645:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258005.212647:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258005.212651:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258005.212653:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258005.212729:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258005.212732:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734258005.212737:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258005.212741:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258005.212744:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734258005.212746:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734258005.212753:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098223360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258021 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258005.212823:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258005.212825:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258005.212827:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258005.212830:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258005.212831:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734258005.212832:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734258005.212835:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098223488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258015 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258005.216709:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258005.216730:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ed80 00000400:00000200:0.0:1734258005.216753:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xfe1 [1] + 0 00000400:00000200:0.0:1734258005.216766:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258005.216769:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258005.216780:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098223488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258015 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258005.216819:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258005.216823:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ed00 00000400:00000200:0.0:1734258005.216827:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xfd9 [1] + 224 00000400:00000200:0.0:1734258005.216839:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258005.216842:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258005.216846:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098223360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258005.217049:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb00. 00000400:00000200:2.0:1734258005.217055:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734258005.217057:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258005.217068:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098223488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258015 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258005.217076:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098223488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258015 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734258005.217100:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 00000400:00000010:3.0:1734258005.217303:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258005.217308:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258005.217310:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258005.217315:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098223360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258021 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258005.217321:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098223360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258021 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258005.217338:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258005.217344:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734258005.217347:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 02000000:00000010:2.0:1734258005.222488:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258005.222505:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258005.222512:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258010.220274:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258010.220301:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258010.221185:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258010.221198:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734258010.221493:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734258010.221518:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734258010.221526:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258010.221534:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098223616, portal 25 00000400:00000010:1.0:1734258010.221539:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734258010.221541:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098223616, offset 0 00000400:00000200:1.0:1734258010.221553:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258010.221591:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258010.221598:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258010.221603:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258010.221607:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258010.221610:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258010.221613:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [479:479:256:4294967295] 192.168.202.108@tcp LPNI seq info [478:478:8:4294967295] 00000400:00000200:1.0:1734258010.221622:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258010.221629:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258010.221633:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734258010.221639:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258010.221650:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258010.221654:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258010.223075:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258010.223085:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb00. 00000400:00000010:2.0:1734258010.223090:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258010.223096:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098223744, portal 10 00000400:00000010:2.0:1734258010.223102:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258010.223104:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098223744, offset 0 00000400:00000200:2.0:1734258010.223110:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258010.223120:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258010.223124:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258010.223127:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258010.223129:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258010.223132:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258010.223134:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [480:480:255:4294967295] 192.168.202.108@tcp LPNI seq info [479:479:7:4294967295] 00000400:00000200:2.0:1734258010.223141:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258010.223146:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258010.223150:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258010.223154:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258010.223161:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258010.223164:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258010.223350:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258010.223354:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734258010.223359:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258010.223364:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258010.223368:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:0.0:1734258010.223370:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:0.0:1734258010.223379:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098223616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258026 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258010.223485:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258010.223487:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258010.223490:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258010.223492:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258010.223494:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734258010.223495:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734258010.223507:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098223744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258020 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258010.230016:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258010.230042:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ee80 00000400:00000200:0.0:1734258010.230053:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xff1 [1] + 0 00000400:00000200:0.0:1734258010.230065:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258010.230070:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258010.230082:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098223744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258020 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258010.230129:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258010.230133:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ee00 00000400:00000200:0.0:1734258010.230139:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0xfe9 [1] + 224 00000400:00000200:0.0:1734258010.230181:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258010.230185:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258010.230191:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098223616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258026 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258010.230260:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734258010.230266:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734258010.230268:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258010.230274:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098223616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258026 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258010.230281:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098223616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258026 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258010.230311:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734258010.230316:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734258010.230320:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:2.0:1734258010.230724:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb00. 00000400:00000200:2.0:1734258010.230729:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734258010.230730:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258010.230745:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098223744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258020 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258010.230751:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098223744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258020 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258010.230771:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258010.230776:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258010.230779:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258015.227794:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258015.227815:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258015.227864:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258015.227869:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258015.227970:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258015.227983:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258015.227990:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258015.227998:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098224000, portal 10 00000400:00000010:3.0:1734258015.228005:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258015.228008:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098224000, offset 0 00000400:00000200:3.0:1734258015.228018:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258015.228032:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258015.228038:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258015.228042:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258015.228046:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258015.228048:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258015.228051:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [481:481:256:4294967295] 192.168.202.108@tcp LPNI seq info [480:480:8:4294967295] 00000400:00000200:3.0:1734258015.228059:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258015.228065:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258015.228068:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734258015.228074:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258015.228094:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258015.228098:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258015.229788:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258015.229793:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734258015.229798:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258015.229805:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258015.229810:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734258015.229812:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734258015.229821:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098224000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258025 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258015.229908:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734258015.229914:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734258015.229918:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258015.229931:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098223872, portal 25 00000400:00000010:1.0:1734258015.229934:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734258015.229936:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098223872, offset 0 00000400:00000200:1.0:1734258015.229942:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258015.229949:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258015.229953:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258015.229956:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258015.229959:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258015.229961:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258015.229963:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [482:482:256:4294967295] 192.168.202.108@tcp LPNI seq info [481:481:8:4294967295] 00000400:00000200:1.0:1734258015.229969:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258015.229974:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258015.229977:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734258015.229980:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258015.229987:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258015.229989:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258015.230113:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258015.230120:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734258015.230122:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258015.230125:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258015.230128:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:0.0:1734258015.230129:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:0.0:1734258015.230132:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098223872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258031 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258015.234803:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258015.234823:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ef80 00000400:00000200:0.0:1734258015.234833:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0xff9 [1] + 0 00000400:00000200:0.0:1734258015.234857:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258015.234861:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258015.234872:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098224000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258025 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258015.234956:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258015.234961:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258015.234963:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258015.234971:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098224000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258025 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258015.234977:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098224000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258025 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258015.235007:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258015.235011:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258015.235018:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734258015.250957:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258015.250979:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ef00 00000400:00000200:0.0:1734258015.250989:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1001 [1] + 224 00000400:00000200:0.0:1734258015.251013:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258015.251018:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258015.251029:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098223872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258031 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258015.251109:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734258015.251114:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734258015.251116:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258015.251122:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098223872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258031 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258015.251129:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098223872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258031 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258015.251151:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734258015.251156:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734258015.251161:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258020.235690:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258020.235710:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 02000000:00000010:2.0:1734258020.235866:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734258020.235873:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb00. 00000400:00000010:2.0:1734258020.235877:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258020.235882:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098224128, portal 25 00000400:00000010:2.0:1734258020.235885:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258020.235886:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098224128, offset 0 00000400:00000200:2.0:1734258020.235893:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258020.235902:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258020.235907:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258020.235910:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258020.235913:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258020.235915:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258020.235917:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [483:483:256:4294967295] 192.168.202.108@tcp LPNI seq info [482:482:8:4294967295] 00000400:00000200:2.0:1734258020.235924:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258020.235929:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258020.235932:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258020.235937:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258020.235944:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258020.235947:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258020.236385:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258020.236388:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:2.0:1734258020.236391:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258020.236395:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258020.236409:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258020.236410:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258020.236416:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098224128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258036 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258020.237351:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258020.237365:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734258020.237606:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258020.237613:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258020.237618:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258020.237623:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098224256, portal 10 00000400:00000010:3.0:1734258020.237629:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734258020.237631:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098224256, offset 0 00000400:00000200:3.0:1734258020.237637:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258020.237646:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258020.237651:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258020.237654:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258020.237656:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258020.237658:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258020.237660:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [484:484:256:4294967295] 192.168.202.108@tcp LPNI seq info [483:483:8:4294967295] 00000400:00000200:3.0:1734258020.237667:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258020.237677:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258020.237680:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734258020.237685:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258020.237691:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258020.237702:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734258020.237922:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:2.0:1734258020.237932:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f000 00000800:00000200:0.0:1734258020.237938:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:2.0:1734258020.237939:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1009 [1] + 224 00000800:00000010:0.0:1734258020.237941:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734258020.237943:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258020.237946:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258020.237948:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734258020.237953:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000400:00000200:2.0:1734258020.237954:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258020.237957:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258020.237959:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098224256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258030 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258020.237963:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098224128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258036 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:0.0:1734258020.237985:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb00. 00000400:00000200:0.0:1734258020.237987:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:0.0:1734258020.237987:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734258020.237990:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098224128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258036 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734258020.237994:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098224128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258036 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:0.0:1734258020.238008:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:0.0:1734258020.238011:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258020.238013:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734258020.239265:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258020.239279:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f080 00000400:00000200:0.0:1734258020.239444:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1011 [1] + 0 00000400:00000200:0.0:1734258020.239466:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258020.239469:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258020.239477:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098224256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258030 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258020.239616:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258020.239622:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258020.239626:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258020.239630:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098224256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258030 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258020.239636:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098224256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258030 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258020.239660:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258020.239664:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258020.239668:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258025.243821:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258025.243842:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258025.243901:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258025.243907:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258025.244018:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734258025.244025:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734258025.244031:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258025.244037:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098224384, portal 25 00000400:00000010:1.0:1734258025.244040:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734258025.244051:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098224384, offset 0 00000400:00000200:1.0:1734258025.244059:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258025.244068:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258025.244073:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258025.244076:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258025.244079:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258025.244081:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258025.244083:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [485:485:256:4294967295] 192.168.202.108@tcp LPNI seq info [484:484:8:4294967295] 00000400:00000200:1.0:1734258025.244089:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258025.244094:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258025.244097:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734258025.244102:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258025.244107:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258025.244110:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258025.244170:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258025.244174:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258025.244176:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258025.244179:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098224512, portal 10 00000400:00000010:2.0:1734258025.244182:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258025.244183:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098224512, offset 0 00000400:00000200:2.0:1734258025.244186:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258025.244190:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258025.244192:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258025.244193:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258025.244195:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258025.244196:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258025.244197:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [486:486:255:4294967295] 192.168.202.108@tcp LPNI seq info [485:485:7:4294967295] 00000400:00000200:2.0:1734258025.244202:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258025.244205:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258025.244207:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258025.244209:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258025.244212:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258025.244218:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258025.244278:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258025.244308:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734258025.244312:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258025.244315:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258025.244319:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:0.0:1734258025.244320:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:0.0:1734258025.244330:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098224384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258041 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258025.244386:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258025.244388:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258025.244391:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258025.244393:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258025.244395:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734258025.244396:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734258025.244399:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098224512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258035 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258025.255129:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258025.255148:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f100 00000400:00000200:0.0:1734258025.255156:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1019 [1] + 224 00000400:00000200:0.0:1734258025.255165:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258025.255168:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258025.255178:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098224384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258041 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258025.256360:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258025.256370:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f180 00000400:00000200:0.0:1734258025.256376:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1021 [1] + 0 00000400:00000200:0.0:1734258025.256393:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258025.256396:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258025.256402:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098224512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258035 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258025.256499:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734258025.256504:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734258025.256506:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258025.256511:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098224384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258041 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258025.256518:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098224384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258041 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258025.256538:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258025.256542:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734258025.256546:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:2.0:1734258025.256610:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258025.256613:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258025.256614:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258025.256618:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098224512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258035 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258025.256624:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098224512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258035 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258025.256639:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258025.256643:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258025.256645:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258030.251681:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258030.251700:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 02000000:00000010:1.0:1734258030.251806:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734258030.251814:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734258030.251820:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258030.251825:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098224640, portal 25 00000400:00000010:1.0:1734258030.251829:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734258030.251831:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098224640, offset 0 00000400:00000200:1.0:1734258030.251838:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258030.251858:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258030.251863:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258030.251866:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258030.251868:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258030.251870:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258030.251873:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [487:487:256:4294967295] 192.168.202.108@tcp LPNI seq info [486:486:8:4294967295] 00000400:00000200:1.0:1734258030.251880:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258030.251885:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258030.251888:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734258030.251893:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258030.251900:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258030.251903:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258030.252004:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258030.252008:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:1.0:1734258030.252011:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258030.252014:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258030.252017:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:1.0:1734258030.252019:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734258030.252024:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098224640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258046 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258030.252590:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258030.252599:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258030.252881:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258030.252885:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258030.252890:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258030.252892:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098224768, portal 10 00000400:00000010:2.0:1734258030.252896:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734258030.252898:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098224768, offset 0 00000400:00000200:2.0:1734258030.252903:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258030.252908:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258030.252911:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258030.252913:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258030.252915:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258030.252916:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258030.252919:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [488:488:256:4294967295] 192.168.202.108@tcp LPNI seq info [487:487:8:4294967295] 00000400:00000200:2.0:1734258030.252924:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258030.252928:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258030.252931:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258030.252934:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258030.252939:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258030.252941:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258030.253293:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258030.253300:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258030.253303:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258030.253306:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258030.253308:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734258030.253310:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734258030.253314:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098224768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258040 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258030.254675:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258030.254695:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f200 00000400:00000200:0.0:1734258030.255161:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1029 [1] + 224 00000400:00000200:0.0:1734258030.255192:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258030.255196:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258030.255206:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098224640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258046 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258030.255737:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734258030.255746:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734258030.255749:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258030.255758:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098224640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258046 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258030.255767:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098224640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258046 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258030.255786:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258030.255791:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734258030.255795:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000200:0.0:1734258030.257279:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258030.257298:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f280 00000400:00000200:0.0:1734258030.257306:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1031 [1] + 0 00000400:00000200:0.0:1734258030.257325:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258030.257328:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258030.257339:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098224768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258030.258614:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258030.258625:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258030.258627:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258030.258636:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098224768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258040 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258030.258645:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098224768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258040 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258030.258670:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258030.258677:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258030.258680:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258035.259681:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258035.259700:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258035.259756:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258035.259762:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258035.259878:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734258035.259886:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258035.259893:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258035.259899:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098224896, portal 25 00000400:00000010:2.0:1734258035.259903:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734258035.259905:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098224896, offset 0 00000400:00000200:2.0:1734258035.259913:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258035.259927:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258035.259932:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258035.259935:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258035.259939:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258035.259941:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258035.259943:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [489:489:256:4294967295] 192.168.202.108@tcp LPNI seq info [488:488:8:4294967295] 00000400:00000200:2.0:1734258035.259951:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258035.259956:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258035.259960:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258035.259964:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258035.259971:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258035.259974:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258035.260112:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258035.260115:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258035.260119:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258035.260124:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258035.260127:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734258035.260137:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734258035.260144:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098224896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258051 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258035.260284:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258035.260289:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258035.260293:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258035.260295:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098225024, portal 10 00000400:00000010:3.0:1734258035.260300:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734258035.260301:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098225024, offset 0 00000400:00000200:3.0:1734258035.260305:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258035.260310:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258035.260312:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258035.260314:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258035.260315:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258035.260317:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258035.260319:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [490:490:256:4294967295] 192.168.202.108@tcp LPNI seq info [489:489:8:4294967295] 00000400:00000200:3.0:1734258035.260324:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258035.260327:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258035.260330:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734258035.260333:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258035.260336:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258035.260338:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258035.260430:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258035.260432:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734258035.260434:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258035.260437:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258035.260440:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734258035.260441:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734258035.260444:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098225024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258045 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258035.262816:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258035.262831:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f380 00000400:00000200:0.0:1734258035.262839:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1041 [1] + 0 00000400:00000200:0.0:1734258035.262856:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258035.262859:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258035.262867:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098225024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258045 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258035.262941:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258035.262945:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258035.262947:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258035.262951:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098225024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258045 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258035.262957:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098225024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258045 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258035.262983:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258035.262987:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258035.262991:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734258035.266301:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258035.266320:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f300 00000400:00000200:0.0:1734258035.266329:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1039 [1] + 224 00000400:00000200:0.0:1734258035.266351:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258035.266354:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258035.266364:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098224896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258051 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258035.266460:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258035.266472:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258035.266474:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258035.266478:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098224896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258051 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258035.266484:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098224896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258051 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258035.266505:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734258035.266509:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734258035.266511:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258040.267678:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258040.267697:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258040.267751:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258040.267757:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258040.267769:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734258040.267776:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258040.267782:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258040.267787:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098225152, portal 25 00000400:00000010:2.0:1734258040.267794:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258040.267796:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098225152, offset 0 00000400:00000200:2.0:1734258040.267803:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258040.267813:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258040.267817:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258040.267820:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258040.267823:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258040.267824:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258040.267827:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [491:491:256:4294967295] 192.168.202.108@tcp LPNI seq info [490:490:8:4294967295] 00000400:00000200:2.0:1734258040.267833:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258040.267842:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258040.267846:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258040.267850:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258040.267857:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258040.267860:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258040.267959:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258040.267961:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:2.0:1734258040.267964:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258040.267972:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258040.267975:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734258040.267977:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258040.267982:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098225152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258056 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258040.268050:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258040.268054:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258040.268057:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258040.268060:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098225280, portal 10 00000400:00000010:3.0:1734258040.268064:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734258040.268065:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098225280, offset 0 00000400:00000200:3.0:1734258040.268069:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258040.268074:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258040.268076:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258040.268078:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258040.268080:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258040.268081:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258040.268083:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [492:492:256:4294967295] 192.168.202.108@tcp LPNI seq info [491:491:8:4294967295] 00000400:00000200:3.0:1734258040.268089:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258040.268092:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258040.268095:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258040.268097:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258040.268101:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258040.268102:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258040.268652:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258040.268655:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734258040.268658:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258040.268661:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258040.268664:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734258040.268665:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734258040.268669:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098225280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258050 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258040.271205:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258040.271220:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f400 00000400:00000200:0.0:1734258040.271227:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1049 [1] + 224 00000400:00000200:0.0:1734258040.271246:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258040.271249:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258040.271259:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098225152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258056 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258040.271918:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258040.271924:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258040.271926:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258040.271931:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098225152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258056 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258040.271938:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098225152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258056 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258040.271959:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734258040.271962:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734258040.271965:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:0.0:1734258040.272958:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258040.272971:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f480 00000400:00000200:0.0:1734258040.272977:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1051 [1] + 0 00000400:00000200:0.0:1734258040.272993:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258040.272997:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258040.273003:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098225280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258050 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258040.273494:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258040.273506:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258040.273507:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258040.273512:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098225280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258050 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258040.273519:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098225280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258050 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258040.273538:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258040.273542:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734258040.273545:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258045.276265:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258045.276288:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258045.276351:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258045.276358:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258045.276434:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 02000000:00000010:2.0:1734258045.276454:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258045.276460:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258045.276467:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258045.276474:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098225536, portal 10 00000400:00000010:2.0:1734258045.276480:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258045.276482:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098225536, offset 0 00000400:00000200:2.0:1734258045.276490:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258045.276503:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258045.276508:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258045.276512:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258045.276515:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258045.276517:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258045.276519:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [493:493:256:4294967295] 192.168.202.108@tcp LPNI seq info [492:492:8:4294967295] 00000400:00000200:2.0:1734258045.276527:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258045.276533:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258045.276536:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258045.276547:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258045.276555:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258045.276558:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258045.276726:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258045.276728:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258045.276732:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258045.276740:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258045.276744:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734258045.276746:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734258045.276752:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098225536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258055 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258045.277693:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734258045.277705:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258045.277710:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098225408, portal 25 00000400:00000010:1.0:1734258045.277713:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734258045.277715:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098225408, offset 0 00000400:00000200:1.0:1734258045.277720:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258045.277726:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258045.277730:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258045.277732:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258045.277735:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258045.277736:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258045.277740:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [494:494:256:4294967295] 192.168.202.108@tcp LPNI seq info [493:493:8:4294967295] 00000400:00000200:1.0:1734258045.277747:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258045.277752:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258045.277757:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734258045.277763:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258045.277772:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258045.277776:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258045.277908:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258045.277911:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734258045.277915:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258045.277918:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258045.277921:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734258045.277922:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734258045.277928:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098225408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258061 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258045.283164:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258045.283186:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f580 00000400:00000200:0.0:1734258045.283197:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1059 [1] + 0 00000400:00000200:0.0:1734258045.283210:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258045.283214:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258045.283224:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098225536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258055 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258045.283263:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258045.283267:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f500 00000400:00000200:0.0:1734258045.283271:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1061 [1] + 224 00000400:00000200:0.0:1734258045.283286:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258045.283289:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258045.283293:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098225408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258061 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258045.283398:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258045.283403:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258045.283406:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258045.283410:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098225536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258055 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258045.283416:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098225536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258055 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258045.283444:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258045.283449:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258045.283453:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:1.0:1734258045.284487:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734258045.284496:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734258045.284498:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258045.284506:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098225408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258061 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258045.284515:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098225408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258061 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258045.284533:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258045.284539:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734258045.284542:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258050.286626:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258050.286657:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258050.286745:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258050.286752:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734258050.287018:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258050.287028:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258050.287035:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258050.287043:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098225664, portal 25 00000400:00000010:3.0:1734258050.287048:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734258050.287050:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098225664, offset 0 00000400:00000200:3.0:1734258050.287061:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258050.287076:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258050.287083:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258050.287097:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258050.287100:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258050.287103:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258050.287107:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [495:495:256:4294967295] 192.168.202.108@tcp LPNI seq info [494:494:8:4294967295] 00000400:00000200:3.0:1734258050.287116:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258050.287124:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258050.287128:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734258050.287134:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258050.287145:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258050.287150:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258050.287496:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258050.287499:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734258050.287503:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258050.287509:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258050.287514:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734258050.287516:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734258050.287523:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098225664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258066 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258050.288848:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258050.288859:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258050.288864:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258050.288870:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098225792, portal 10 00000400:00000010:2.0:1734258050.288876:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734258050.288877:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098225792, offset 0 00000400:00000200:2.0:1734258050.288884:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258050.288894:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258050.288900:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258050.288902:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258050.288906:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258050.288908:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258050.288910:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [496:496:256:4294967295] 192.168.202.108@tcp LPNI seq info [495:495:8:4294967295] 00000400:00000200:2.0:1734258050.288917:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258050.288921:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258050.288924:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258050.288928:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258050.288947:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258050.288951:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258050.290018:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258050.290024:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258050.290029:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258050.290034:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258050.290038:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734258050.290040:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734258050.290048:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098225792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258060 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258050.292551:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258050.292604:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f600 00000400:00000200:0.0:1734258050.292614:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1069 [1] + 224 00000400:00000200:0.0:1734258050.292639:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258050.292642:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258050.292653:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098225664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258066 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258050.293478:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258050.293485:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258050.293496:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258050.293502:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098225664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258066 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258050.293509:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098225664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258066 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258050.293533:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258050.293539:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734258050.293543:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000200:0.0:1734258050.298053:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258050.298079:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f680 00000400:00000200:0.0:1734258050.298099:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1071 [1] + 0 00000400:00000200:0.0:1734258050.298130:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258050.298135:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258050.298157:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098225792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258060 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258050.299838:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258050.299849:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258050.299851:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258050.299862:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098225792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258060 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258050.299871:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098225792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258060 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258050.299907:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258050.299915:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258050.299920:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734258055.293809:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258055.293829:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 02000000:00000010:1.0:1734258055.294534:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734258055.294543:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734258055.294550:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258055.294598:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098225920, portal 25 00000400:00000010:1.0:1734258055.294603:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734258055.294605:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098225920, offset 0 00000400:00000200:1.0:1734258055.294614:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258055.294625:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258055.294631:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258055.294635:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258055.294638:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258055.294640:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258055.294642:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [497:497:256:4294967295] 192.168.202.108@tcp LPNI seq info [496:496:8:4294967295] 00000400:00000200:1.0:1734258055.294650:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258055.294655:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258055.294659:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734258055.294663:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258055.294672:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258055.294676:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734258055.295950:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258055.295966:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258055.296033:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258055.296039:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258055.296043:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258055.296057:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098226048, portal 10 00000400:00000010:2.0:1734258055.296063:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734258055.296065:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098226048, offset 0 00000400:00000200:2.0:1734258055.296070:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258055.296078:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258055.296082:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258055.296084:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258055.296087:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258055.296088:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258055.296091:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [498:498:255:4294967295] 192.168.202.108@tcp LPNI seq info [497:497:7:4294967295] 00000400:00000200:2.0:1734258055.296097:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258055.296101:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258055.296104:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258055.296108:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258055.296114:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258055.296125:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258055.296187:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258055.296190:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:1.0:1734258055.296194:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258055.296197:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258055.296201:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:1.0:1734258055.296202:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734258055.296208:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098225920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258071 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258055.296263:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258055.296265:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734258055.296268:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258055.296271:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258055.296272:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:1.0:1734258055.296273:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:1.0:1734258055.296276:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098226048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258065 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258055.299223:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258055.299241:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f700 00000400:00000200:0.0:1734258055.299249:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1079 [1] + 224 00000400:00000200:0.0:1734258055.299269:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258055.299273:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258055.299284:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098225920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258071 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258055.299826:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734258055.299832:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734258055.299834:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258055.299840:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098225920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258071 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258055.299848:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098225920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258071 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258055.299874:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258055.299936:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734258055.299940:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734258055.305785:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258055.305802:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f780 00000400:00000200:0.0:1734258055.305811:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1081 [1] + 0 00000400:00000200:0.0:1734258055.305831:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258055.305835:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258055.305845:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098226048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258065 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258055.307792:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258055.307803:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258055.307805:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258055.307815:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098226048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258065 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258055.307824:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098226048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258065 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258055.307851:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258055.307857:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258055.307861:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258060.300169:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258060.300193:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258060.300434:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:2.0:1734258060.300434:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 02000000:00000010:0.0:1734258060.300441:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 00000400:00000010:2.0:1734258060.300443:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258060.300449:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258060.300457:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098226176, portal 25 00000400:00000010:2.0:1734258060.300462:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734258060.300464:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098226176, offset 0 00000400:00000200:2.0:1734258060.300474:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258060.300488:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258060.300493:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258060.300496:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258060.300500:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258060.300502:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258060.300505:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [499:499:256:4294967295] 192.168.202.108@tcp LPNI seq info [498:498:8:4294967295] 00000400:00000200:2.0:1734258060.300513:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258060.300519:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258060.300522:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258060.300528:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258060.300535:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258060.300539:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258060.300540:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258060.300544:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258060.300547:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258060.300550:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098226304, portal 10 00000400:00000010:3.0:1734258060.300554:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734258060.300555:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098226304, offset 0 00000400:00000200:3.0:1734258060.300559:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258060.300563:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258060.300565:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258060.300593:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258060.300595:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258060.300596:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258060.300598:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [500:500:255:4294967295] 192.168.202.108@tcp LPNI seq info [499:499:7:4294967295] 00000400:00000200:3.0:1734258060.300604:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258060.300607:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258060.300610:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734258060.300612:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258060.300616:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258060.300618:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258060.300814:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258060.300818:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734258060.300824:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258060.300827:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258060.300831:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:1.0:1734258060.300833:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:1.0:1734258060.300840:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098226176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258076 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258060.301670:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258060.301674:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734258060.301678:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258060.301682:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258060.301685:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:1.0:1734258060.301686:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:1.0:1734258060.301691:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098226304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258070 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258060.306133:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258060.306156:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f880 00000400:00000200:0.0:1734258060.306166:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1091 [1] + 0 00000400:00000200:0.0:1734258060.306178:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258060.306194:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258060.306205:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098226304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258070 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258060.306246:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258060.306251:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f800 00000400:00000200:0.0:1734258060.306256:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1089 [1] + 224 00000400:00000200:0.0:1734258060.306271:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258060.306274:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258060.306280:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098226176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258076 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258060.306351:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258060.306357:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258060.306360:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258060.306366:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098226176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258076 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258060.306372:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098226176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258076 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258060.306401:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734258060.306407:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734258060.306411:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:3.0:1734258060.306482:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258060.306486:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258060.306487:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258060.306492:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098226304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258070 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258060.306503:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098226304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258070 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258060.306521:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258060.306524:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734258060.306526:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258065.308400:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258065.308427:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258065.308499:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258065.308507:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258065.308624:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258065.308632:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258065.308639:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258065.308647:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098226432, portal 25 00000400:00000010:3.0:1734258065.308653:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734258065.308655:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098226432, offset 0 00000400:00000200:3.0:1734258065.308665:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258065.308679:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258065.308685:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258065.308689:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258065.308692:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258065.308694:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258065.308697:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [501:501:256:4294967295] 192.168.202.108@tcp LPNI seq info [500:500:8:4294967295] 00000400:00000200:3.0:1734258065.308705:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258065.308711:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258065.308717:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734258065.308723:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258065.308732:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258065.308736:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258065.308833:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258065.308838:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258065.308841:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258065.308844:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098226560, portal 10 00000400:00000010:2.0:1734258065.308848:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734258065.308850:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098226560, offset 0 00000400:00000200:2.0:1734258065.308854:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258065.308859:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258065.308862:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258065.308864:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258065.308865:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258065.308867:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258065.308869:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [502:502:255:4294967295] 192.168.202.108@tcp LPNI seq info [501:501:7:4294967295] 00000400:00000200:2.0:1734258065.308875:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258065.308879:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258065.308881:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258065.308884:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258065.308887:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258065.308889:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258065.309040:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258065.309043:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734258065.309047:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258065.309052:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258065.309056:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734258065.309057:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734258065.309066:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098226432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258081 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258065.311633:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258065.311642:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258065.311652:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258065.311660:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258065.311666:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734258065.311669:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734258065.311679:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098226560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258075 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258065.316328:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258065.316357:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60f900 00000400:00000200:0.0:1734258065.316365:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1099 [1] + 224 00000400:00000200:0.0:1734258065.316382:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258065.316385:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258065.316394:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098226432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258081 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258065.316703:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258065.316707:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60f980 00000400:00000200:0.0:1734258065.316712:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x10a1 [1] + 0 00000400:00000200:0.0:1734258065.316721:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258065.316724:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258065.316730:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098226560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258075 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258065.316943:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258065.316948:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258065.316950:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258065.316955:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098226432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258081 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258065.316980:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098226432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258081 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258065.317000:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258065.317005:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734258065.317008:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:2.0:1734258065.317113:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258065.317121:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258065.317122:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258065.317126:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098226560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258075 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258065.317132:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098226560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258075 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258065.317148:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258065.317151:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258065.317153:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734258070.315809:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258070.315832:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258070.315887:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258070.315895:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258070.315996:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258070.316009:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258070.316016:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258070.316024:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098226816, portal 10 00000400:00000010:2.0:1734258070.316031:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734258070.316033:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098226816, offset 0 00000400:00000200:2.0:1734258070.316043:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258070.316056:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258070.316061:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:1.0:1734258070.316064:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000200:2.0:1734258070.316065:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258070.316068:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:1.0:1734258070.316069:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000200:2.0:1734258070.316071:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:1.0:1734258070.316073:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000200:2.0:1734258070.316074:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [503:503:256:4294967295] 192.168.202.108@tcp LPNI seq info [502:502:8:4294967295] 00000100:00000200:1.0:1734258070.316076:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098226688, portal 25 00000400:00000010:1.0:1734258070.316079:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000400:00000200:2.0:1734258070.316083:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258070.316088:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:1.0:1734258070.316092:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098226688, offset 0 00000800:00000010:2.0:1734258070.316092:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734258070.316097:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734258070.316098:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734258070.316102:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258070.316104:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258070.316106:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734258070.316106:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734258070.316109:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258070.316110:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734258070.316110:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734258070.316113:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [504:504:255:4294967295] 192.168.202.108@tcp LPNI seq info [503:503:7:4294967295] 00000400:00000200:1.0:1734258070.316119:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258070.316123:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258070.316125:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734258070.316128:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258070.316132:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258070.316134:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258070.316607:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258070.316611:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258070.316616:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258070.316623:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258070.316628:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734258070.316629:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734258070.316636:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098226816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258080 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258070.316694:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258070.316696:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734258070.316698:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258070.316701:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258070.316704:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734258070.316715:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734258070.316720:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098226688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258086 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258070.319211:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258070.319232:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60fa00 00000400:00000200:0.0:1734258070.319241:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x10b1 [1] + 224 00000400:00000200:0.0:1734258070.319265:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258070.319269:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258070.319280:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098226688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258086 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258070.319389:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258070.319394:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60fa80 00000400:00000200:0.0:1734258070.319400:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x10a9 [1] + 0 00000400:00000200:0.0:1734258070.319408:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258070.319411:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258070.319416:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098226816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258080 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258070.319530:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258070.319535:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258070.319547:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258070.319552:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098226816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258080 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258070.319560:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098226816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258080 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258070.319628:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258070.319636:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258070.319643:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:1.0:1734258070.319715:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:1.0:1734258070.319719:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734258070.319721:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258070.319726:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098226688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258086 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258070.319733:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098226688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258086 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258070.319746:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734258070.319750:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734258070.319752:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734258075.323729:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258075.323756:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 02000000:00000010:1.0:1734258075.324722:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734258075.324732:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1210. 00000400:00000010:1.0:1734258075.324739:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258075.324748:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098226944, portal 25 00000400:00000010:1.0:1734258075.324754:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258075.324756:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098226944, offset 0 00000400:00000200:1.0:1734258075.324765:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258075.324792:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258075.324799:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258075.324803:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258075.324806:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258075.324809:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258075.324812:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [505:505:256:4294967295] 192.168.202.108@tcp LPNI seq info [504:504:8:4294967295] 00000400:00000200:1.0:1734258075.324820:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258075.324826:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258075.324830:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734258075.324835:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258075.324844:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258075.324848:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258075.325016:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258075.325019:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:1.0:1734258075.325021:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258075.325026:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258075.325029:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258075.325030:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258075.325037:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098226944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258091 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258075.325248:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258075.325261:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258075.327530:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258075.327547:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258075.327555:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258075.327564:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098227072, portal 10 00000400:00000010:3.0:1734258075.327591:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734258075.327594:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098227072, offset 0 00000400:00000200:3.0:1734258075.327605:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258075.327621:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258075.327628:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258075.327632:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258075.327635:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258075.327637:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258075.327640:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [506:506:256:4294967295] 192.168.202.108@tcp LPNI seq info [505:505:8:4294967295] 00000400:00000200:3.0:1734258075.327649:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258075.327655:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258075.327660:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734258075.327666:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258075.327676:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258075.327681:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734258075.328046:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258075.328057:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60fb00 00000400:00000200:0.0:1734258075.328065:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x10b9 [1] + 224 00000400:00000200:0.0:1734258075.328095:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258075.328099:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258075.328109:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098226944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258091 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258075.328176:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258075.328178:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734258075.328181:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258075.328183:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258075.328186:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734258075.328188:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734258075.328193:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098227072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258085 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:0.0:1734258075.328373:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1210. 00000400:00000200:0.0:1734258075.328377:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:0.0:1734258075.328378:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:0.0:1734258075.328382:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098226944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258091 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734258075.328389:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098226944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258091 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:0.0:1734258075.328410:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:0.0:1734258075.328416:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258075.328420:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000200:0.0:1734258075.332404:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258075.332427:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60fb80 00000400:00000200:0.0:1734258075.332437:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x10c1 [1] + 0 00000400:00000200:0.0:1734258075.332466:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258075.332471:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258075.332482:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098227072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258085 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258075.332960:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258075.332966:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258075.332968:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258075.332975:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098227072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258085 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258075.332997:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098227072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258085 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258075.333032:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258075.333039:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258075.333044:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258080.331770:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258080.331802:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258080.331914:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258080.331922:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258080.331958:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258080.331967:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258080.331975:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258080.331983:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098227200, portal 25 00000400:00000010:1.0:1734258080.331988:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734258080.331990:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098227200, offset 0 00000400:00000200:1.0:1734258080.332000:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734258080.332013:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000200:1.0:1734258080.332017:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:3.0:1734258080.332019:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:1.0:1734258080.332023:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734258080.332023:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258080.332026:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098227328, portal 10 00000400:00000200:1.0:1734258080.332028:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:3.0:1734258080.332032:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000400:00000200:1.0:1734258080.332033:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:3.0:1734258080.332033:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098227328, offset 0 00000400:00000200:3.0:1734258080.332038:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258080.332042:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258080.332046:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [507:507:256:4294967295] 192.168.202.108@tcp LPNI seq info [506:506:8:4294967295] 00000400:00000200:1.0:1734258080.332056:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258080.332062:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258080.332066:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734258080.332073:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258080.332081:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258080.332085:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734258080.333661:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258080.333665:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258080.333668:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258080.333671:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258080.333674:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258080.333676:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [508:508:255:4294967295] 192.168.202.108@tcp LPNI seq info [507:507:7:4294967295] 00000400:00000200:3.0:1734258080.333684:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258080.333689:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258080.333692:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258080.333696:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258080.333702:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258080.333705:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258080.334615:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258080.334623:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734258080.334629:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258080.334636:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258080.334642:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:0.0:1734258080.334644:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:0.0:1734258080.334656:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098227200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258096 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258080.335132:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258080.335135:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734258080.335139:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258080.335142:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258080.335145:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734258080.335146:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734258080.335152:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098227328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258090 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258080.336616:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258080.336631:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60fc00 00000400:00000200:0.0:1734258080.336639:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x10c9 [1] + 224 00000400:00000200:0.0:1734258080.336650:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258080.336653:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258080.336660:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098227200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258096 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258080.336697:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258080.336702:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60fc80 00000400:00000200:0.0:1734258080.336707:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x10d1 [1] + 0 00000400:00000200:0.0:1734258080.336725:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258080.336727:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258080.336731:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098227328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258090 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258080.336886:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258080.336891:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258080.336893:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258080.336898:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098227328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258090 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258080.336916:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098227328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258090 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258080.336953:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258080.336958:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734258080.336963:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:1.0:1734258080.337001:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258080.337006:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258080.337007:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258080.337013:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098227200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258096 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258080.337021:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098227200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258096 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258080.337035:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258080.337038:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734258080.337040:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258085.340111:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258085.340134:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258085.340629:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258085.340638:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258085.340859:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258085.340867:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258085.340875:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258085.340882:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098227456, portal 25 00000400:00000010:1.0:1734258085.340887:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734258085.340890:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098227456, offset 0 00000400:00000200:1.0:1734258085.340899:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258085.340914:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258085.340919:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258085.340923:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258085.340926:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258085.340928:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258085.340931:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [509:509:256:4294967295] 192.168.202.108@tcp LPNI seq info [508:508:8:4294967295] 00000400:00000200:1.0:1734258085.340954:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258085.340960:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258085.340963:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734258085.340969:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258085.340977:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258085.340981:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258085.341098:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258085.341101:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:1.0:1734258085.341104:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258085.341108:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258085.341112:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:1.0:1734258085.341114:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734258085.341120:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098227456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258101 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258085.341295:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258085.341300:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258085.341304:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258085.341306:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098227584, portal 10 00000400:00000010:2.0:1734258085.341311:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734258085.341312:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098227584, offset 0 00000400:00000200:2.0:1734258085.341316:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258085.341321:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258085.341323:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258085.341325:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258085.341327:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258085.341328:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258085.341330:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [510:510:256:4294967295] 192.168.202.108@tcp LPNI seq info [509:509:8:4294967295] 00000400:00000200:2.0:1734258085.341336:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258085.341339:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258085.341341:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258085.341344:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258085.341348:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258085.341350:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258085.341769:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258085.341771:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258085.341774:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258085.341778:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258085.341780:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734258085.341781:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734258085.341785:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098227584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258095 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258085.368080:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258085.368120:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60fd80 00000400:00000200:0.0:1734258085.368131:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x10e1 [1] + 0 00000400:00000200:0.0:1734258085.368144:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258085.368148:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258085.368160:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098227584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258095 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258085.368215:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258085.368220:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60fd00 00000400:00000200:0.0:1734258085.368224:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x10d9 [1] + 224 00000400:00000200:0.0:1734258085.368259:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258085.368262:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258085.368268:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098227456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258101 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258085.368876:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258085.368882:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258085.368884:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258085.368890:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098227584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258095 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258085.368907:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098227584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258095 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258085.368950:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258085.368957:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258085.368963:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:1.0:1734258085.372268:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258085.372282:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258085.372285:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258085.372299:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098227456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258101 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258085.372309:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098227456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258101 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258085.372334:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258085.372340:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:1.0:1734258085.372344:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258090.349147:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258090.349174:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258090.349256:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258090.349264:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258090.349337:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258090.349346:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258090.349353:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258090.349362:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098227712, portal 25 00000400:00000010:1.0:1734258090.349367:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734258090.349369:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098227712, offset 0 00000400:00000200:1.0:1734258090.349385:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258090.349400:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258090.349405:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258090.349409:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258090.349412:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258090.349413:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258090.349416:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [511:511:256:4294967295] 192.168.202.108@tcp LPNI seq info [510:510:8:4294967295] 00000400:00000200:1.0:1734258090.349423:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258090.349427:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258090.349431:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734258090.349436:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258090.349443:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258090.349446:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258090.349541:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258090.349546:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258090.349549:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258090.349552:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098227840, portal 10 00000400:00000010:2.0:1734258090.349557:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734258090.349558:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098227840, offset 0 00000400:00000200:2.0:1734258090.349562:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258090.349566:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258090.349590:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1734258090.349592:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:2.0:1734258090.349592:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258090.349594:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000010:0.0:1734258090.349595:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:2.0:1734258090.349595:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258090.349597:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [512:512:255:4294967295] 192.168.202.108@tcp LPNI seq info [511:511:7:4294967295] 00000400:00000200:0.0:1734258090.349599:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258090.349602:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:0.0:1734258090.349604:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000800:00000200:2.0:1734258090.349607:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258090.349608:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:0.0:1734258090.349609:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000800:00000010:2.0:1734258090.349610:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258090.349612:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:0.0:1734258090.349616:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098227712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258106 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258090.349616:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258090.349618:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258090.349645:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258090.349647:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258090.349650:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258090.349653:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258090.349654:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734258090.349655:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734258090.349658:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098227840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258100 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258090.353157:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258090.353176:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60fe00 00000400:00000200:0.0:1734258090.353184:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x10e9 [1] + 224 00000400:00000200:0.0:1734258090.353206:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258090.353210:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258090.353219:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098227712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258106 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258090.353425:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258090.353429:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258090.353431:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258090.353436:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098227712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258106 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258090.353442:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098227712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258106 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258090.353460:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258090.353464:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734258090.353467:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000200:0.0:1734258090.353978:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258090.353986:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60fe80 00000400:00000200:0.0:1734258090.353991:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x10f1 [1] + 0 00000400:00000200:0.0:1734258090.354008:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258090.354011:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258090.354024:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098227840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258100 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258090.354183:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258090.354187:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258090.354188:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258090.354193:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098227840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258100 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258090.354209:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098227840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258100 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258090.354227:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258090.354231:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258090.354234:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258095.355682:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258095.355701:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 02000000:00000010:1.0:1734258095.355811:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258095.355819:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258095.355824:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258095.355831:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098227968, portal 25 00000400:00000010:1.0:1734258095.355835:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734258095.355836:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098227968, offset 0 00000400:00000200:1.0:1734258095.355844:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258095.355855:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258095.355869:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258095.355873:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258095.355876:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258095.355877:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258095.355880:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [513:513:256:4294967295] 192.168.202.108@tcp LPNI seq info [512:512:8:4294967295] 00000400:00000200:1.0:1734258095.355887:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258095.355892:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258095.355895:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734258095.355900:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258095.355907:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258095.355911:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258095.356025:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258095.356028:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:1.0:1734258095.356031:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258095.356034:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258095.356038:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:1.0:1734258095.356039:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734258095.356046:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098227968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258111 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258095.356623:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258095.356631:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258095.356707:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258095.356712:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258095.356715:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258095.356718:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098228096, portal 10 00000400:00000010:3.0:1734258095.356723:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734258095.356724:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098228096, offset 0 00000400:00000200:3.0:1734258095.356728:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258095.356742:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258095.356744:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258095.356746:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258095.356748:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258095.356749:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258095.356751:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [514:514:256:4294967295] 192.168.202.108@tcp LPNI seq info [513:513:8:4294967295] 00000400:00000200:3.0:1734258095.356756:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258095.356760:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258095.356762:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734258095.356765:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258095.356769:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258095.356771:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258095.356849:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258095.356851:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734258095.356853:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258095.356856:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258095.356859:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734258095.356860:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734258095.356864:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098228096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258105 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258095.357421:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258095.357429:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c60ff00 00000400:00000200:0.0:1734258095.357435:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x10f9 [1] + 224 00000400:00000200:0.0:1734258095.357448:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258095.357451:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258095.357456:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098227968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258111 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258095.357525:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258095.357529:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258095.357530:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258095.357534:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098227968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258111 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258095.357541:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098227968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258111 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258095.357556:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258095.357560:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734258095.357562:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000200:0.0:1734258095.359240:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258095.359262:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c60ff80 00000400:00000200:0.0:1734258095.359268:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1101 [1] + 0 00000400:00000200:0.0:1734258095.359282:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258095.359284:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258095.359291:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098228096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258105 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258095.359349:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258095.359353:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258095.359355:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258095.359360:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098228096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258105 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258095.359377:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098228096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258105 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258095.359396:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258095.359400:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258095.359403:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258100.363797:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258100.363839:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258100.363908:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258100.363916:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258100.363939:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000400:00000010:2.0:1734258100.363948:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258100.363956:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258100.363962:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098228224, portal 25 00000400:00000010:2.0:1734258100.363966:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258100.363968:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098228224, offset 0 00000400:00000200:2.0:1734258100.363980:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258100.363995:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258100.364001:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258100.364005:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258100.364009:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258100.364012:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:3.0:1734258100.364031:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258100.364035:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258100.364038:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258100.364040:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098228352, portal 10 00000400:00000010:3.0:1734258100.364044:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258100.364045:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098228352, offset 0 00000400:00000200:3.0:1734258100.364049:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258100.364075:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [515:515:256:4294967295] 192.168.202.108@tcp LPNI seq info [514:514:8:4294967295] 00000400:00000200:2.0:1734258100.364083:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:3.0:1734258100.364089:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734258100.364090:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258100.364091:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258100.364093:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258100.364094:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000010:2.0:1734258100.364095:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734258100.364096:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258100.364097:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [516:516:255:4294967295] 192.168.202.108@tcp LPNI seq info [515:515:7:4294967295] 00000800:00000200:2.0:1734258100.364099:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258100.364105:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258100.364106:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258100.364109:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258100.364109:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258100.364111:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734258100.364113:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258100.364116:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258100.364118:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258100.364258:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258100.364261:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258100.364267:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258100.364271:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258100.364275:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734258100.364277:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734258100.364285:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098228224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258116 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258100.364512:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258100.364515:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734258100.364518:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258100.364521:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258100.364523:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734258100.364524:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734258100.364528:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098228352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258110 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258100.370434:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258100.370452:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610000 00000400:00000200:0.0:1734258100.370459:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1109 [1] + 224 00000400:00000200:0.0:1734258100.370469:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258100.370473:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258100.370482:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098228224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258116 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258100.370519:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258100.370524:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610080 00000400:00000200:0.0:1734258100.370528:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1111 [1] + 0 00000400:00000200:0.0:1734258100.370545:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258100.370556:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258100.370560:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098228352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258110 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258100.370773:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258100.370779:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258100.370780:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258100.370785:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098228224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258116 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258100.370802:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098228224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258116 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258100.370825:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:2.0:1734258100.370830:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734258100.370833:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:3.0:1734258100.370894:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258100.370899:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258100.370900:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258100.370904:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098228352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258110 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258100.370919:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098228352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258110 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258100.370935:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258100.370938:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258100.370940:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258105.373197:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258105.373226:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258105.373297:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258105.373305:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258105.373960:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258105.373968:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258105.373976:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258105.373984:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098228480, portal 25 00000400:00000010:3.0:1734258105.373989:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734258105.373991:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098228480, offset 0 00000400:00000200:3.0:1734258105.374002:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258105.374018:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258105.374025:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258105.374029:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258105.374032:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258105.374034:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258105.374036:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [517:517:256:4294967295] 192.168.202.108@tcp LPNI seq info [516:516:8:4294967295] 00000400:00000200:3.0:1734258105.374044:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258105.374050:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258105.374055:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734258105.374062:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258105.374070:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258105.374073:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258105.374170:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258105.374176:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258105.374180:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258105.374182:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098228608, portal 10 00000400:00000010:2.0:1734258105.374188:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734258105.374189:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098228608, offset 0 00000400:00000200:2.0:1734258105.374194:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258105.374200:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258105.374202:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258105.374203:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258105.374205:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258105.374207:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258105.374208:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [518:518:255:4294967295] 192.168.202.108@tcp LPNI seq info [517:517:7:4294967295] 00000400:00000200:2.0:1734258105.374213:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258105.374216:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258105.374219:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258105.374221:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258105.374225:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258105.374226:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258105.374608:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258105.374612:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734258105.374617:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258105.374621:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258105.374625:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734258105.374626:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734258105.374634:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098228480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258121 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258105.374915:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258105.374918:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258105.374921:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258105.374924:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258105.374927:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734258105.374929:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734258105.374934:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098228608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258115 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258105.378526:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258105.378548:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610100 00000400:00000200:0.0:1734258105.378556:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1119 [1] + 224 00000400:00000200:0.0:1734258105.378611:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258105.378617:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258105.379755:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098228480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258121 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258105.379808:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258105.379828:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610180 00000400:00000200:0.0:1734258105.379834:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1121 [1] + 0 00000400:00000010:3.0:1734258105.379841:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258105.379845:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000200:0.0:1734258105.379847:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:3.0:1734258105.379848:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000400:00000200:0.0:1734258105.379850:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:3.0:1734258105.379852:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098228480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258121 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734258105.379855:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098228608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258115 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258105.379867:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098228480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258121 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258105.379912:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258105.379915:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258105.379916:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258105.379920:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098228608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258115 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258105.379933:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098228608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258115 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258105.379959:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258105.379964:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258105.379967:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 02000000:00000010:3.0:1734258105.380203:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258105.380208:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734258105.380210:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258110.379757:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258110.379783:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258110.379844:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258110.379851:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734258110.380071:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258110.380084:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258110.380092:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258110.380098:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098228736, portal 25 00000400:00000010:3.0:1734258110.380102:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258110.380104:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098228736, offset 0 00000400:00000200:3.0:1734258110.380111:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258110.380124:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258110.380128:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258110.380132:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258110.380134:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258110.380136:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258110.380139:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [519:519:256:4294967295] 192.168.202.108@tcp LPNI seq info [518:518:8:4294967295] 00000400:00000200:3.0:1734258110.380147:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258110.380151:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258110.380154:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734258110.380159:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258110.380166:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258110.380169:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258110.380705:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258110.380711:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258110.380715:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258110.380719:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098228864, portal 10 00000400:00000010:2.0:1734258110.380724:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734258110.380725:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098228864, offset 0 00000400:00000200:2.0:1734258110.380729:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258110.380734:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258110.380737:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258110.380739:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258110.380740:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258110.380742:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258110.380744:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [520:520:255:4294967295] 192.168.202.108@tcp LPNI seq info [519:519:7:4294967295] 00000400:00000200:2.0:1734258110.380749:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258110.380752:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258110.380755:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258110.380758:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258110.380762:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258110.380764:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258110.382335:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258110.382340:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734258110.382349:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258110.382356:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258110.382360:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:0.0:1734258110.382362:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734258110.382370:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098228736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258126 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258110.382433:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258110.382434:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258110.382437:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258110.382439:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258110.382441:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734258110.382442:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734258110.382445:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098228864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258120 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258110.385536:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258110.385556:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610280 00000400:00000200:0.0:1734258110.385563:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1131 [1] + 0 00000400:00000200:0.0:1734258110.385597:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258110.385609:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258110.385627:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098228864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258120 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258110.385664:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258110.385668:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610200 00000400:00000200:0.0:1734258110.385673:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1129 [1] + 224 00000400:00000200:0.0:1734258110.385683:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258110.385686:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258110.385691:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098228736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258126 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258110.385866:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258110.385871:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258110.385872:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258110.385877:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098228864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258120 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258110.385893:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098228864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258120 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258110.385918:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258110.385922:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258110.385926:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:3.0:1734258110.385990:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258110.385994:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258110.385995:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258110.385999:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098228736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258126 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258110.386012:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098228736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258126 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258110.386021:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258110.386025:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258110.386026:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258115.388344:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258115.388363:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258115.388425:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258115.388431:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258115.389025:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734258115.389033:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258115.389039:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258115.389044:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098228992, portal 25 00000400:00000010:2.0:1734258115.389049:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734258115.389051:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098228992, offset 0 00000400:00000200:2.0:1734258115.389058:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734258115.389067:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000200:2.0:1734258115.389070:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:3.0:1734258115.389071:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:2.0:1734258115.389074:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734258115.389075:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258115.389077:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098229120, portal 10 00000400:00000200:2.0:1734258115.389078:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258115.389080:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258115.389082:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:3.0:1734258115.389082:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258115.389083:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098229120, offset 0 00000400:00000200:2.0:1734258115.389084:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [521:521:256:4294967295] 192.168.202.108@tcp LPNI seq info [520:520:8:4294967295] 00000400:00000200:3.0:1734258115.389087:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258115.389092:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258115.389097:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258115.389099:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734258115.389101:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000400:00000200:3.0:1734258115.389101:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258115.389103:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734258115.389105:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258115.389105:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258115.389106:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258115.389108:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [522:522:255:4294967295] 192.168.202.108@tcp LPNI seq info [521:521:7:4294967295] 00000800:00000200:2.0:1734258115.389111:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734258115.389114:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258115.389115:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258115.389117:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258115.389119:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734258115.389121:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258115.389125:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258115.389127:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258115.389763:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258115.389767:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258115.389773:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258115.389778:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258115.389782:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:0.0:1734258115.389784:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734258115.389792:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098228992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258131 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258115.389857:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258115.389859:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734258115.389861:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258115.389864:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258115.389866:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:0.0:1734258115.389867:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734258115.389870:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098229120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258125 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258115.394357:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258115.394384:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610300 00000400:00000200:0.0:1734258115.394391:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1139 [1] + 224 00000400:00000200:0.0:1734258115.394402:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258115.394405:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258115.394414:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098228992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258131 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258115.394453:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258115.394458:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610380 00000400:00000200:0.0:1734258115.394462:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1141 [1] + 0 00000400:00000200:0.0:1734258115.394475:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258115.394478:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258115.394482:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098229120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258125 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258115.394708:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258115.394712:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258115.394714:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258115.394718:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098228992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258131 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258115.394732:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098228992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258131 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258115.394754:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258115.394758:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734258115.394760:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:3.0:1734258115.394809:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258115.394812:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258115.394813:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258115.394817:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098229120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258125 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258115.394830:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098229120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258125 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258115.394843:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258115.394846:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734258115.394847:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258120.395675:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258120.395694:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258120.395748:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258120.395754:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258120.395768:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734258120.395775:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258120.395780:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258120.395786:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098229248, portal 25 00000400:00000010:2.0:1734258120.395789:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258120.395790:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098229248, offset 0 00000400:00000200:2.0:1734258120.395797:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258120.395807:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258120.395811:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258120.395814:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258120.395817:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258120.395818:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258120.395821:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [523:523:256:4294967295] 192.168.202.108@tcp LPNI seq info [522:522:8:4294967295] 00000400:00000200:2.0:1734258120.395828:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:3.0:1734258120.395828:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000800:00000200:2.0:1734258120.395832:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734258120.395833:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000800:00000010:2.0:1734258120.395834:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000010:3.0:1734258120.395835:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258120.395838:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098229376, portal 10 00000800:00000200:2.0:1734258120.395839:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:3.0:1734258120.395843:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000800:00000200:2.0:1734258120.395844:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:3.0:1734258120.395844:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098229376, offset 0 00000800:00000200:2.0:1734258120.395847:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734258120.395848:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258120.395853:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258120.395855:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258120.395857:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258120.395859:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258120.395860:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258120.395862:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [524:524:255:4294967295] 192.168.202.108@tcp LPNI seq info [523:523:7:4294967295] 00000400:00000200:3.0:1734258120.395873:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258120.395876:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258120.395878:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734258120.395881:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258120.395885:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258120.395887:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258120.396483:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258120.396486:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258120.396490:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258120.396494:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258120.396498:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:0.0:1734258120.396499:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:0.0:1734258120.396506:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098229248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258136 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258120.397498:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258120.397503:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734258120.397509:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258120.397513:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258120.397517:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734258120.397530:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734258120.397537:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098229376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258130 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258120.400708:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258120.400725:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610480 00000400:00000200:0.0:1734258120.400734:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1151 [1] + 0 00000400:00000200:0.0:1734258120.400753:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258120.400757:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258120.400766:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098229376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258130 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258120.400831:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258120.400835:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258120.400838:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258120.400842:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098229376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258130 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258120.400860:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098229376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258130 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258120.400886:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258120.400890:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258120.400894:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734258120.401912:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258120.401921:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610400 00000400:00000200:0.0:1734258120.401927:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1149 [1] + 224 00000400:00000200:0.0:1734258120.401938:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258120.401940:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258120.401947:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098229248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258136 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258120.402100:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258120.402107:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258120.402108:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258120.402112:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098229248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258136 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258120.402129:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098229248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258136 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258120.402147:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258120.402152:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:2.0:1734258120.402155:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258125.404136:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258125.404156:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 02000000:00000010:3.0:1734258125.404671:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258125.404679:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258125.404684:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258125.404689:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098229504, portal 25 00000400:00000010:3.0:1734258125.404693:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258125.404694:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098229504, offset 0 00000400:00000200:3.0:1734258125.404701:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258125.404711:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258125.404715:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258125.404718:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258125.404721:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258125.404722:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258125.404725:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [525:525:256:4294967295] 192.168.202.108@tcp LPNI seq info [524:524:8:4294967295] 00000400:00000200:3.0:1734258125.404732:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258125.404736:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258125.404739:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734258125.404744:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258125.404751:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258125.404754:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258125.404850:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258125.404853:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:3.0:1734258125.404856:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258125.404859:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258125.404862:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258125.404871:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258125.404878:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098229504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258141 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258125.406347:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258125.406362:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258125.407182:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258125.407189:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258125.407194:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258125.407198:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098229632, portal 10 00000400:00000010:3.0:1734258125.407203:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734258125.407204:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098229632, offset 0 00000400:00000200:3.0:1734258125.407210:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258125.407220:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258125.407224:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258125.407227:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258125.407229:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258125.407231:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258125.407233:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [526:526:256:4294967295] 192.168.202.108@tcp LPNI seq info [525:525:8:4294967295] 00000400:00000200:3.0:1734258125.407240:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258125.407244:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258125.407246:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734258125.407250:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258125.407256:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258125.407259:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734258125.408208:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258125.408219:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610500 00000400:00000200:0.0:1734258125.408224:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1159 [1] + 224 00000400:00000200:0.0:1734258125.408243:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258125.408247:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258125.408255:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098229504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258125.408314:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258125.408317:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734258125.408319:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258125.408321:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258125.408324:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734258125.408325:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734258125.408329:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098229632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258135 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258125.408563:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258125.408579:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:3.0:1734258125.408581:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258125.408584:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098229504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258141 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258125.408590:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098229504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258141 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258125.408604:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258125.408611:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258125.408613:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734258125.411548:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258125.411564:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610580 00000400:00000200:0.0:1734258125.411596:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1161 [1] + 0 00000400:00000200:0.0:1734258125.411617:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258125.411621:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258125.411629:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098229632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258135 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258125.412100:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258125.412105:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258125.412107:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258125.412111:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098229632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258135 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258125.412117:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098229632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258135 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258125.412140:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258125.412144:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258125.412148:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258130.411682:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258130.411702:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 02000000:00000010:1.0:1734258130.412309:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258130.412325:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258130.412332:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258130.412338:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098229760, portal 25 00000400:00000010:1.0:1734258130.412342:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734258130.412344:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098229760, offset 0 00000400:00000200:1.0:1734258130.412352:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258130.412363:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258130.412367:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258130.412370:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258130.412373:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258130.412375:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258130.412378:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [527:527:256:4294967295] 192.168.202.108@tcp LPNI seq info [526:526:8:4294967295] 00000400:00000200:1.0:1734258130.412385:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258130.412390:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258130.412394:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734258130.412400:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258130.412409:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258130.412413:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258130.412605:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258130.412608:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:2.0:1734258130.412611:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258130.412615:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258130.412619:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:2.0:1734258130.412620:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:2.0:1734258130.412627:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098229760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258146 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258130.417378:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258130.417407:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258130.418070:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258130.418078:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258130.418086:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258130.418093:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098229888, portal 10 00000400:00000010:3.0:1734258130.418100:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258130.418102:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098229888, offset 0 00000400:00000200:3.0:1734258130.418113:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258130.418129:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258130.418134:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258130.418138:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258130.418141:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258130.418143:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258130.418146:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [528:528:256:4294967295] 192.168.202.108@tcp LPNI seq info [527:527:8:4294967295] 00000400:00000200:3.0:1734258130.418154:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258130.418160:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258130.418164:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734258130.418170:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258130.418177:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258130.418196:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258130.418372:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258130.418375:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:2.0:1734258130.418380:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258130.418385:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258130.418389:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:2.0:1734258130.418391:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:2.0:1734258130.418399:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098229888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258140 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258130.424190:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258130.424209:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610600 00000400:00000200:0.0:1734258130.424218:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1169 [1] + 224 00000400:00000200:0.0:1734258130.424229:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258130.424233:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258130.424243:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098229760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258146 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258130.424476:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258130.424482:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610680 00000400:00000010:1.0:1734258130.424483:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258130.424487:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258130.424489:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000400:00000200:0.0:1734258130.424494:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1171 [1] + 0 00000100:00000200:1.0:1734258130.424494:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098229760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258146 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258130.424500:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098229760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258146 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258130.424505:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258130.424507:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258130.424512:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098229888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258140 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258130.424520:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258130.424524:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734258130.424527:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:3.0:1734258130.424601:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258130.424606:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258130.424607:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258130.424612:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098229888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258140 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258130.424619:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098229888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258140 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258130.424639:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258130.424642:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258130.424645:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258135.435712:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258135.435731:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258135.436500:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258135.436511:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734258135.436621:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:2.0:1734258135.436625:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734258135.436629:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:3.0:1734258135.436629:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734258135.436635:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000400:00000010:3.0:1734258135.436635:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258135.436641:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098230144, portal 10 00000400:00000010:3.0:1734258135.436647:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:2.0:1734258135.436667:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098230016, portal 25 00000100:00000200:3.0:1734258135.436667:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098230144, offset 0 00000400:00000010:2.0:1734258135.436670:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734258135.436671:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098230016, offset 0 00000400:00000200:3.0:1734258135.436677:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258135.436690:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258135.436697:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258135.436701:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258135.436703:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258135.436705:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258135.436708:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [529:529:256:4294967295] 192.168.202.108@tcp LPNI seq info [528:528:8:4294967295] 00000400:00000200:3.0:1734258135.436716:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258135.436721:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258135.436725:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734258135.436731:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258135.436739:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258135.436743:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734258135.436751:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258135.436756:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258135.436758:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258135.436759:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258135.436776:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258135.436778:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258135.436780:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [530:530:255:4294967295] 192.168.202.108@tcp LPNI seq info [529:529:7:4294967295] 00000400:00000200:2.0:1734258135.436785:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258135.436788:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258135.436791:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258135.436793:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258135.436796:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258135.436798:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258135.436814:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258135.436816:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:3.0:1734258135.436819:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258135.436823:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258135.436826:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:3.0:1734258135.436828:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734258135.436834:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098230144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258145 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734258135.436896:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258135.436898:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734258135.436900:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258135.436902:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258135.436904:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:3.0:1734258135.436905:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:3.0:1734258135.436908:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098230016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258151 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258135.446792:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258135.446811:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610780 00000400:00000200:0.0:1734258135.446819:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1179 [1] + 0 00000400:00000200:0.0:1734258135.446840:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258135.446844:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258135.446853:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098230144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258145 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258135.448974:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258135.448988:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610700 00000400:00000200:0.0:1734258135.448996:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x117d [1] + 224 00000400:00000200:0.0:1734258135.449016:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258135.449020:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258135.449031:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098230016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258151 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258135.449161:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258135.449167:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258135.449169:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258135.449176:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098230144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258145 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258135.449183:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098230144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258145 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258135.449218:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258135.449223:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258135.449228:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:2.0:1734258135.449599:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258135.449604:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258135.449605:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258135.449610:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098230016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258151 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258135.449616:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098230016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258151 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258135.449631:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734258135.449634:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734258135.449636:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734258140.443715:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258140.443738:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258140.443791:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258140.443796:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734258140.443872:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 02000000:00000010:3.0:1734258140.443884:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:1.0:1734258140.443885:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:3.0:1734258140.443890:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:1.0:1734258140.443892:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000400:00000010:3.0:1734258140.443894:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258140.443900:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098230400, portal 10 00000400:00000010:3.0:1734258140.443906:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734258140.443908:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098230400, offset 0 00000100:00000200:1.0:1734258140.443909:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098230272, portal 25 00000400:00000010:1.0:1734258140.443920:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000400:00000200:3.0:1734258140.443926:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:1.0:1734258140.443931:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098230272, offset 0 00000400:00000200:1.0:1734258140.443941:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258140.443941:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258140.443948:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258140.443951:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258140.443956:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258140.443958:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258140.443961:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [531:531:256:4294967295] 192.168.202.108@tcp LPNI seq info [530:530:8:4294967295] 00000400:00000200:3.0:1734258140.443968:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258140.443973:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258140.443977:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734258140.443980:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734258140.443983:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734258140.443985:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258140.443990:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734258140.443991:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734258140.443994:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734258140.443994:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734258140.443996:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258140.443999:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [532:532:255:4294967295] 192.168.202.108@tcp LPNI seq info [531:531:7:4294967295] 00000400:00000200:1.0:1734258140.444006:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258140.444011:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258140.444015:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734258140.444021:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258140.444029:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258140.444034:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258140.444075:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258140.444085:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734258140.444090:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258140.444095:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258140.444100:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734258140.444102:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734258140.444109:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098230400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258150 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258140.444404:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258140.444406:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734258140.444410:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258140.444413:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258140.444416:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:0.0:1734258140.444418:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:0.0:1734258140.444422:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098230272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258156 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258140.447716:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258140.447737:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610880 00000400:00000200:0.0:1734258140.447746:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1189 [1] + 0 00000400:00000200:0.0:1734258140.447772:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258140.447776:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258140.447789:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098230400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258150 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258140.447912:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258140.447917:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258140.447919:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258140.447925:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098230400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258150 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258140.447933:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098230400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258150 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258140.448075:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258140.448082:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734258140.448089:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734258140.448234:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258140.448240:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610800 00000400:00000200:0.0:1734258140.448245:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x118d [1] + 224 00000400:00000200:0.0:1734258140.448257:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258140.448260:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258140.448266:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098230272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258156 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258140.448651:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258140.448656:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258140.448657:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258140.448664:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098230272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258156 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258140.448671:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098230272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258156 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258140.448684:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258140.448688:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734258140.448690:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258145.451690:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258145.451724:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258145.451782:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258145.451789:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734258145.451903:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258145.451910:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258145.451917:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258145.451923:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098230528, portal 25 00000400:00000010:1.0:1734258145.451927:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258145.451934:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098230528, offset 0 00000400:00000200:1.0:1734258145.451941:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258145.451953:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258145.451957:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258145.451961:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258145.451964:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258145.451965:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258145.451968:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [533:533:256:4294967295] 192.168.202.108@tcp LPNI seq info [532:532:8:4294967295] 00000400:00000200:1.0:1734258145.451976:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258145.451981:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258145.451984:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734258145.451989:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258145.451996:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258145.451999:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258145.452199:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258145.452202:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734258145.452206:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258145.452210:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 02000000:00000010:2.0:1734258145.452221:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258145.452226:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000200:0.0:1734258145.453132:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:0.0:1734258145.453136:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:0.0:1734258145.453148:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098230528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258161 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258145.453176:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258145.453181:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098230656, portal 10 00000400:00000010:2.0:1734258145.453187:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734258145.453188:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098230656, offset 0 00000400:00000200:2.0:1734258145.453196:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258145.453202:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258145.453205:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258145.453207:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258145.453209:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258145.453211:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258145.453219:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [534:534:256:4294967295] 192.168.202.108@tcp LPNI seq info [533:533:8:4294967295] 00000400:00000200:2.0:1734258145.453225:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258145.453229:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258145.453232:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258145.453236:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258145.453240:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258145.453242:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258145.453373:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258145.453376:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258145.453379:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258145.453382:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258145.453384:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734258145.453385:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734258145.453389:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098230656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258155 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258145.455980:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258145.456001:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610900 00000400:00000200:0.0:1734258145.456009:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1199 [1] + 224 00000400:00000200:0.0:1734258145.456021:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258145.456024:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258145.456035:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098230528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258161 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258145.456075:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258145.456079:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610980 00000400:00000200:0.0:1734258145.456084:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x11a1 [1] + 0 00000400:00000200:0.0:1734258145.456101:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258145.456113:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258145.456119:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098230656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258155 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258145.456265:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258145.456270:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258145.456272:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258145.456277:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098230656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258155 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258145.456278:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258145.456283:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000100:00000200:2.0:1734258145.456284:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098230656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258155 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258145.456285:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258145.456291:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098230528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258161 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258145.456299:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098230528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258161 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258145.456315:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:2.0:1734258145.456315:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734258145.456320:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 02000000:00000010:2.0:1734258145.456320:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258145.456325:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:2.0:1734258145.456325:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258150.459942:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258150.459966:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 02000000:00000010:1.0:1734258150.460055:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258150.460069:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258150.460077:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258150.460085:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098230784, portal 25 00000400:00000010:1.0:1734258150.460089:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258150.460091:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098230784, offset 0 00000400:00000200:1.0:1734258150.460102:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000010:0.0:1734258150.460742:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258150.460751:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 00000400:00000200:1.0:1734258150.460873:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258150.460879:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258150.460883:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258150.460887:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258150.460889:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258150.460892:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [535:535:256:4294967295] 192.168.202.108@tcp LPNI seq info [534:534:8:4294967295] 00000400:00000200:1.0:1734258150.460900:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258150.460906:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258150.460910:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 02000000:00000010:2.0:1734258150.460967:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734258150.460973:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258150.460977:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258150.460980:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098230912, portal 10 00000400:00000010:2.0:1734258150.460985:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734258150.460986:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098230912, offset 0 00000400:00000200:2.0:1734258150.460991:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258150.460996:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258150.460998:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258150.461000:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258150.461002:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258150.461003:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258150.461005:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [536:536:255:4294967295] 192.168.202.108@tcp LPNI seq info [535:535:7:4294967295] 00000400:00000200:2.0:1734258150.461017:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258150.461021:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258150.461023:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258150.461026:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258150.461034:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258150.461038:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258150.461470:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258150.461477:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258150.461483:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258150.463647:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258150.463656:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258150.463676:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258150.463684:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258150.463691:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734258150.463693:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734258150.463704:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098230912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258160 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258150.463786:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258150.463788:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734258150.463790:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258150.463793:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258150.463795:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:0.0:1734258150.463796:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734258150.463800:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098230784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258166 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258150.466393:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258150.466415:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610a00 00000400:00000200:0.0:1734258150.466425:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x11a9 [1] + 224 00000400:00000200:0.0:1734258150.466437:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258150.466441:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258150.466451:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098230784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258166 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258150.466500:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258150.466518:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610a80 00000400:00000200:0.0:1734258150.466523:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x11b1 [1] + 0 00000400:00000200:0.0:1734258150.466536:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258150.466539:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258150.466544:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098230912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258160 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258150.466885:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258150.466890:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258150.466892:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258150.466898:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098230784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258166 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258150.466904:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098230784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258166 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258150.466928:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258150.466933:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734258150.466937:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:2.0:1734258150.467001:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258150.467005:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258150.467006:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258150.467010:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098230912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258160 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258150.467015:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098230912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258160 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258150.467033:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258150.467038:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258150.467040:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258155.467669:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258155.467687:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258155.467738:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258155.467744:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258155.467763:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258155.467771:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258155.467777:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258155.467783:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098231040, portal 25 00000400:00000010:1.0:1734258155.467787:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734258155.467789:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098231040, offset 0 00000400:00000200:1.0:1734258155.467796:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258155.467807:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258155.467812:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258155.467825:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258155.467828:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258155.467830:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258155.467833:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [537:537:256:4294967295] 192.168.202.108@tcp LPNI seq info [536:536:8:4294967295] 00000400:00000200:1.0:1734258155.467839:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258155.467844:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258155.467847:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734258155.467852:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258155.467859:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258155.467862:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258155.467936:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258155.467940:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258155.467943:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258155.467945:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098231168, portal 10 00000400:00000010:3.0:1734258155.467949:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734258155.467950:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098231168, offset 0 00000400:00000200:3.0:1734258155.467954:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258155.467962:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258155.467964:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1734258155.467965:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:3.0:1734258155.467966:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258155.467967:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000010:0.0:1734258155.467968:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:3.0:1734258155.467969:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258155.467970:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [538:538:255:4294967295] 192.168.202.108@tcp LPNI seq info [537:537:7:4294967295] 00000400:00000200:0.0:1734258155.467971:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258155.467975:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:0.0:1734258155.467976:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000800:00000200:3.0:1734258155.467978:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258155.467979:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000800:00000010:3.0:1734258155.467980:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000400:00000010:0.0:1734258155.467981:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000800:00000200:3.0:1734258155.467983:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258155.467986:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:0.0:1734258155.467987:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098231040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258171 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734258155.467987:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258155.468009:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258155.468010:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734258155.468012:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258155.468015:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258155.468016:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734258155.468017:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734258155.468020:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098231168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258165 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258155.470510:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258155.470524:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610b00 00000400:00000200:0.0:1734258155.470530:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x11b9 [1] + 224 00000400:00000200:0.0:1734258155.470547:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258155.470556:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258155.470566:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098231040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258171 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258155.471513:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258155.471520:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258155.471522:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258155.471528:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098231040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258171 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258155.471536:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098231040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258171 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258155.471557:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258155.471561:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734258155.471565:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734258155.472013:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258155.472026:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610b80 00000400:00000200:0.0:1734258155.472032:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x11c1 [1] + 0 00000400:00000200:0.0:1734258155.472052:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258155.472055:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258155.472062:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098231168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258165 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258155.472281:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258155.472285:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258155.472286:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258155.472290:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098231168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258165 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258155.472296:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098231168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258165 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:3.0:1734258155.472308:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:3.0:1734258155.479053:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258155.479067:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258155.479071:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258160.477486:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258160.477515:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258160.477607:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258160.477616:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258160.478360:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258160.478370:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258160.478379:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258160.478388:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098231424, portal 10 00000400:00000010:3.0:1734258160.478398:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734258160.478400:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098231424, offset 0 00000400:00000200:3.0:1734258160.478410:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258160.478442:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258160.478449:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258160.478454:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258160.478457:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258160.478460:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258160.478463:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [539:539:256:4294967295] 192.168.202.108@tcp LPNI seq info [538:538:8:4294967295] 00000400:00000200:3.0:1734258160.478471:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258160.478477:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258160.478481:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734258160.478488:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258160.478498:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258160.478503:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258160.478732:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258160.478735:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734258160.478738:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258160.478742:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258160.478746:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734258160.478747:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734258160.478755:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098231424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258170 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258160.479355:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734258160.479364:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258160.479369:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258160.479373:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098231296, portal 25 00000400:00000010:2.0:1734258160.479376:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258160.479377:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098231296, offset 0 00000400:00000200:2.0:1734258160.479382:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258160.479389:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258160.479392:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258160.479394:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258160.479396:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258160.479397:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258160.479399:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [540:540:256:4294967295] 192.168.202.108@tcp LPNI seq info [539:539:8:4294967295] 00000400:00000200:2.0:1734258160.479406:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258160.479418:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258160.479421:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258160.479424:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258160.479429:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258160.479432:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258160.479616:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258160.479619:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258160.479622:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258160.479625:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258160.479628:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734258160.479630:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734258160.479634:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098231296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258176 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258160.486156:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258160.486192:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610c80 00000400:00000200:0.0:1734258160.486202:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x11c9 [1] + 0 00000400:00000200:0.0:1734258160.486223:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258160.486258:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258160.486269:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098231424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258170 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258160.487626:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258160.487641:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258160.487643:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258160.487654:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098231424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258170 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258160.487662:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098231424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258170 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258160.487693:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258160.487698:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258160.487703:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734258160.488178:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258160.488192:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610c00 00000400:00000200:0.0:1734258160.488199:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x11d1 [1] + 224 00000400:00000200:0.0:1734258160.488219:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258160.488223:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258160.488243:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098231296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258176 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258160.488621:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258160.488627:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258160.488630:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258160.488636:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098231296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258176 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258160.488652:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098231296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258176 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258160.488669:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734258160.488673:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734258160.488675:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258165.483683:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258165.483704:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258165.483757:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258165.483763:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734258165.483777:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258165.483784:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258165.483793:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258165.483799:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098231552, portal 25 00000400:00000010:3.0:1734258165.483803:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734258165.483805:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098231552, offset 0 00000400:00000200:3.0:1734258165.483816:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258165.483826:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258165.483842:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258165.483845:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258165.483848:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258165.483850:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258165.483852:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [541:541:256:4294967295] 192.168.202.108@tcp LPNI seq info [540:540:8:4294967295] 00000400:00000200:3.0:1734258165.483860:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258165.483865:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258165.483868:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734258165.483873:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258165.483879:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258165.483882:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258165.484656:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258165.484664:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:3.0:1734258165.484668:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258165.484672:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258165.484676:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734258165.484678:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734258165.484685:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098231552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258181 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258165.484842:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258165.484846:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258165.484850:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258165.484853:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098231680, portal 10 00000400:00000010:2.0:1734258165.484857:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734258165.484858:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098231680, offset 0 00000400:00000200:2.0:1734258165.484862:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258165.484867:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258165.484871:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258165.484873:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258165.484875:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258165.484876:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258165.484878:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [542:542:256:4294967295] 192.168.202.108@tcp LPNI seq info [541:541:8:4294967295] 00000400:00000200:2.0:1734258165.484884:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258165.484893:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258165.484903:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258165.484906:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258165.484910:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258165.484913:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258165.485669:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258165.485673:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258165.485676:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258165.485680:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258165.485683:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734258165.485684:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734258165.485689:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098231680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258175 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258165.493991:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258165.494010:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610d00 00000400:00000200:0.0:1734258165.494019:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x11d9 [1] + 224 00000400:00000200:0.0:1734258165.494041:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258165.494053:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258165.494063:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098231552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258165.496206:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258165.496218:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258165.496219:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258165.496230:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098231552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258181 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258165.496239:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098231552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258181 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258165.496262:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258165.496268:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734258165.496271:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734258165.499325:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258165.499343:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610d80 00000400:00000200:0.0:1734258165.499350:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x11e1 [1] + 0 00000400:00000200:0.0:1734258165.499370:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258165.499374:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258165.499383:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098231680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258175 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258165.499491:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258165.499496:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258165.499498:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258165.499503:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098231680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258175 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258165.499508:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098231680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258175 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258165.499531:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258165.499536:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258165.499540:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258170.491691:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258170.491710:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 02000000:00000010:1.0:1734258170.492191:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258170.492199:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258170.492205:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258170.492211:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098231808, portal 25 00000400:00000010:1.0:1734258170.492215:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734258170.492216:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098231808, offset 0 00000400:00000200:1.0:1734258170.492224:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258170.492237:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258170.492242:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258170.492245:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258170.492247:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258170.492258:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258170.492261:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [543:543:256:4294967295] 192.168.202.108@tcp LPNI seq info [542:542:8:4294967295] 00000400:00000200:1.0:1734258170.492268:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258170.492273:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258170.492277:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734258170.492282:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258170.492289:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258170.492292:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258170.492396:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258170.492398:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:1.0:1734258170.492401:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258170.492405:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258170.492408:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:1.0:1734258170.492409:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734258170.492414:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098231808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258186 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258170.493243:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258170.493258:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734258170.494006:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258170.494015:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258170.494020:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258170.494025:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098231936, portal 10 00000400:00000010:2.0:1734258170.494032:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734258170.494034:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098231936, offset 0 00000400:00000200:2.0:1734258170.494041:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258170.494051:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258170.494055:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258170.494058:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258170.494061:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258170.494063:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258170.494065:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [544:544:256:4294967295] 192.168.202.108@tcp LPNI seq info [543:543:8:4294967295] 00000400:00000200:2.0:1734258170.494074:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258170.494078:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258170.494082:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258170.494095:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258170.494101:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258170.494105:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258170.494683:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258170.494687:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258170.494691:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258170.494695:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258170.494699:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:1.0:1734258170.494701:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:1.0:1734258170.494707:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098231936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258180 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258170.494768:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258170.494777:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610e00 00000400:00000200:0.0:1734258170.494783:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x11e9 [1] + 224 00000400:00000200:0.0:1734258170.494796:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258170.494799:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258170.494804:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098231808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258186 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258170.497271:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258170.497288:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610e80 00000400:00000200:0.0:1734258170.497296:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x11f1 [1] + 0 00000400:00000200:0.0:1734258170.497315:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258170.497318:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258170.497327:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098231936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258180 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258170.497449:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258170.497453:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258170.497454:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258170.497460:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098231808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258186 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258170.497466:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098231808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258186 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258170.497496:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258170.497500:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734258170.497504:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:2.0:1734258170.497599:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258170.497603:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258170.497604:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258170.497608:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098231936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258180 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258170.497613:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098231936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258180 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258170.497629:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258170.497633:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258170.497636:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258175.499882:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258175.499901:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258175.499950:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258175.499955:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734258175.500312:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258175.500319:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258175.500324:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258175.500331:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098232064, portal 25 00000400:00000010:1.0:1734258175.500335:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734258175.500337:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098232064, offset 0 00000400:00000200:1.0:1734258175.500346:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258175.500359:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258175.500364:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258175.500367:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258175.500370:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258175.500372:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258175.500379:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [545:545:256:4294967295] 192.168.202.108@tcp LPNI seq info [544:544:8:4294967295] 00000400:00000200:1.0:1734258175.500387:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258175.500393:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258175.500397:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734258175.500403:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258175.500409:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258175.500413:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258175.501081:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258175.501098:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258175.501102:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258175.501105:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098232192, portal 10 00000400:00000010:3.0:1734258175.501108:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734258175.501119:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098232192, offset 0 00000400:00000200:3.0:1734258175.501124:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258175.501129:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258175.501131:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258175.501133:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258175.501135:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258175.501136:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258175.501138:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [546:546:255:4294967295] 192.168.202.108@tcp LPNI seq info [545:545:7:4294967295] 00000400:00000200:3.0:1734258175.501144:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258175.501148:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258175.501150:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734258175.501153:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258175.501157:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258175.501160:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258175.501715:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258175.501718:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:1.0:1734258175.501721:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258175.501726:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258175.501730:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:1.0:1734258175.501731:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734258175.501739:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098232064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258191 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258175.501807:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258175.501809:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:1.0:1734258175.501811:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258175.501814:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258175.501816:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:1.0:1734258175.501818:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:1.0:1734258175.501821:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098232192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258185 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258175.504972:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258175.504989:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c610f80 00000400:00000200:0.0:1734258175.504996:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1201 [1] + 0 00000400:00000200:0.0:1734258175.505004:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258175.505007:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258175.505015:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098232192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258185 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258175.505304:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258175.505309:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c610f00 00000400:00000200:0.0:1734258175.505313:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x11f9 [1] + 224 00000400:00000010:3.0:1734258175.505351:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258175.505355:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258175.505356:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258175.505360:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098232192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258185 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258175.505367:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098232192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258185 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258175.505389:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258175.505393:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734258175.505397:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734258175.505447:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258175.505450:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258175.505454:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098232064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258175.505516:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258175.505519:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258175.505520:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258175.505524:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098232064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258191 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258175.505528:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098232064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258191 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258175.505537:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258175.505539:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734258175.505541:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258180.507851:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258180.507872:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258180.508343:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258180.508352:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258180.508434:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258180.508441:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258180.508447:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258180.508452:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098232320, portal 25 00000400:00000010:1.0:1734258180.508455:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734258180.508457:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098232320, offset 0 00000400:00000200:1.0:1734258180.508464:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258180.508475:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258180.508479:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258180.508482:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258180.508485:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258180.508487:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258180.508490:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [547:547:256:4294967295] 192.168.202.108@tcp LPNI seq info [546:546:8:4294967295] 00000400:00000200:1.0:1734258180.508508:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258180.508512:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258180.508515:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734258180.508519:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258180.508525:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258180.508528:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258180.508607:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258180.508612:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258180.508621:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258180.508623:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098232448, portal 10 00000400:00000010:3.0:1734258180.508627:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734258180.508628:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098232448, offset 0 00000400:00000200:3.0:1734258180.508632:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258180.508636:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258180.508638:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258180.508639:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258180.508641:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258180.508642:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258180.508644:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [548:548:255:4294967295] 192.168.202.108@tcp LPNI seq info [547:547:7:4294967295] 00000400:00000200:3.0:1734258180.508649:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258180.508652:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258180.508654:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734258180.508656:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258180.508659:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258180.508660:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258180.508730:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258180.508733:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734258180.508737:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258180.508740:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258180.508744:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:0.0:1734258180.508745:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:0.0:1734258180.508757:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098232320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258196 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258180.509058:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258180.509061:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734258180.509064:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258180.509066:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258180.509068:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734258180.509069:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734258180.509084:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098232448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258190 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258180.510388:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258180.510402:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611000 00000400:00000200:0.0:1734258180.510407:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1209 [1] + 224 00000400:00000200:0.0:1734258180.510424:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258180.510427:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258180.510434:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098232320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258196 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258180.510490:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258180.510494:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258180.510496:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258180.510500:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098232320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258196 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258180.510507:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098232320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258196 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258180.510524:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258180.510528:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734258180.510532:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000200:0.0:1734258180.512819:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258180.512835:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611080 00000400:00000200:0.0:1734258180.512841:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1211 [1] + 0 00000400:00000200:0.0:1734258180.512859:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258180.512862:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258180.512871:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098232448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258190 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258180.513304:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258180.513309:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258180.513311:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258180.513316:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098232448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258190 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258180.513322:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098232448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258190 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258180.513345:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258180.513349:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258180.513353:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258185.515895:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258185.515919:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258185.515975:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258185.515982:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258185.516072:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258185.516160:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258185.516168:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258185.516176:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098232704, portal 10 00000400:00000010:2.0:1734258185.516182:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 02000000:00000010:3.0:1734258185.516183:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000100:00000200:2.0:1734258185.516185:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098232704, offset 0 00000400:00000010:3.0:1734258185.516193:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000200:2.0:1734258185.516195:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734258185.516202:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000400:00000200:2.0:1734258185.516211:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258185.516217:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:3.0:1734258185.516219:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098232576, portal 25 00000400:00000200:2.0:1734258185.516220:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:3.0:1734258185.516223:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000400:00000200:2.0:1734258185.516224:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258185.516226:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:3.0:1734258185.516226:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098232576, offset 0 00000400:00000200:2.0:1734258185.516229:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [549:549:256:4294967295] 192.168.202.108@tcp LPNI seq info [548:548:8:4294967295] 00000400:00000200:3.0:1734258185.516233:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258185.516237:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258185.516243:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258185.516247:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258185.516254:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258185.516271:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258185.516275:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734258185.516310:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258185.516314:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258185.516318:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258185.516321:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258185.516322:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258185.516325:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [550:550:255:4294967295] 192.168.202.108@tcp LPNI seq info [549:549:7:4294967295] 00000400:00000200:3.0:1734258185.516333:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258185.516337:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258185.516342:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734258185.516347:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258185.516354:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258185.516357:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258185.516391:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258185.516399:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258185.516405:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258185.516410:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258185.516420:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734258185.516421:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734258185.516428:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098232704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258195 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258185.516502:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258185.516505:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734258185.516507:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258185.516510:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258185.516512:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734258185.516513:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734258185.516518:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098232576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258201 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258185.520287:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258185.520308:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611180 00000400:00000200:0.0:1734258185.520318:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1219 [1] + 0 00000400:00000200:0.0:1734258185.520330:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258185.520334:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258185.520345:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098232704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258195 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258185.520389:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258185.520393:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611100 00000400:00000200:0.0:1734258185.520398:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1221 [1] + 224 00000400:00000200:0.0:1734258185.520414:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258185.520417:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258185.520422:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098232576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258201 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258185.520434:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258185.520439:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258185.520440:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258185.520446:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098232704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258195 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258185.520452:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098232704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258195 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258185.520480:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258185.520486:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258185.520491:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:3.0:1734258185.520499:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258185.520504:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258185.520505:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258185.520511:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098232576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258201 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258185.520517:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098232576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258201 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258185.520530:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258185.520534:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258185.520536:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258190.524230:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258190.524274:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258190.524354:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258190.524361:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258190.524476:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258190.524484:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258190.524491:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258190.524497:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098232960, portal 10 00000400:00000010:2.0:1734258190.524503:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734258190.524505:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098232960, offset 0 00000400:00000200:2.0:1734258190.524513:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258190.524525:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258190.524529:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258190.524533:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258190.524536:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258190.524537:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258190.524540:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [551:551:256:4294967295] 192.168.202.108@tcp LPNI seq info [550:550:8:4294967295] 00000400:00000200:2.0:1734258190.524548:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258190.524553:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258190.524557:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258190.524563:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:1.0:1734258190.525003:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258190.525010:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258190.525013:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258190.525016:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098232832, portal 25 00000400:00000010:1.0:1734258190.525018:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:1.0:1734258190.525020:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098232832, offset 0 00000400:00000200:1.0:1734258190.525025:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258190.525030:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258190.525034:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258190.525036:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258190.525038:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258190.525040:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258190.525042:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [552:552:255:4294967295] 192.168.202.108@tcp LPNI seq info [551:551:7:4294967295] 00000400:00000200:1.0:1734258190.525047:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258190.525059:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258190.525062:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734258190.525065:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258190.525071:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258190.525075:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258190.525152:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258190.525160:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258190.525917:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258190.525921:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734258190.525925:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258190.525930:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258190.525934:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:0.0:1734258190.525936:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:0.0:1734258190.525945:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098232832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258206 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258190.526534:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258190.526537:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258190.526541:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258190.526545:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258190.526547:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734258190.526548:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734258190.526553:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098232960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258200 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258190.528622:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258190.528640:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611200 00000400:00000200:0.0:1734258190.528648:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1231 [1] + 224 00000400:00000200:0.0:1734258190.528659:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258190.528662:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258190.528806:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098232832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258206 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258190.528848:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258190.528852:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611280 00000400:00000200:0.0:1734258190.528859:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1229 [1] + 0 00000400:00000200:0.0:1734258190.528875:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258190.528884:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258190.528889:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098232960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258190.528980:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258190.528984:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258190.528985:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258190.528990:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098232832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258206 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258190.529007:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098232832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258206 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258190.529029:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258190.529034:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:1.0:1734258190.529038:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:2.0:1734258190.529108:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258190.529111:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258190.529113:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258190.529117:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098232960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258200 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258190.529122:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098232960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258200 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258190.529138:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258190.529141:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258190.529143:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258195.531940:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258195.532003:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258195.532071:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258195.532079:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258195.532191:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258195.532204:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258195.532211:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258195.532219:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098233216, portal 10 00000400:00000010:3.0:1734258195.532225:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734258195.532238:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098233216, offset 0 00000400:00000200:3.0:1734258195.532247:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258195.532259:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258195.532264:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258195.532268:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258195.532272:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258195.532274:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258195.532277:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [553:553:256:4294967295] 192.168.202.108@tcp LPNI seq info [552:552:8:4294967295] 00000400:00000200:3.0:1734258195.532285:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258195.532290:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258195.532294:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734258195.532300:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258195.532309:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258195.532313:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734258195.532390:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258195.532397:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258195.532402:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258195.532407:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098233088, portal 25 00000400:00000010:1.0:1734258195.532411:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734258195.532412:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098233088, offset 0 00000400:00000200:1.0:1734258195.532419:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258195.532427:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258195.532431:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258195.532434:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258195.532437:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258195.532439:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258195.532441:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [554:554:255:4294967295] 192.168.202.108@tcp LPNI seq info [553:553:7:4294967295] 00000400:00000200:1.0:1734258195.532448:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258195.532453:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258195.532465:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734258195.532470:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258195.532476:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258195.532479:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258195.532969:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258195.532972:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734258195.532978:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258195.532982:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258195.532987:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734258195.532988:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734258195.532999:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098233216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258205 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258195.533086:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258195.533088:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734258195.533090:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258195.533093:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258195.533094:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734258195.533095:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734258195.533099:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098233088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258211 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258195.538495:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258195.538519:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611380 00000400:00000200:0.0:1734258195.538528:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1239 [1] + 0 00000400:00000200:0.0:1734258195.538554:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258195.538558:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258195.538601:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098233216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258205 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258195.538706:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258195.538712:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258195.538714:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258195.538720:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098233216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258205 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258195.538726:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098233216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258205 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258195.538759:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258195.538764:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258195.538768:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734258195.539017:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258195.539024:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611300 00000400:00000200:0.0:1734258195.539029:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1241 [1] + 224 00000400:00000200:0.0:1734258195.539039:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258195.539042:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258195.539047:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098233088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258211 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258195.539116:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258195.539120:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258195.539121:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258195.539128:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098233088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258211 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258195.539135:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098233088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258211 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258195.539147:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258195.539151:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734258195.539152:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258200.539695:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258200.539718:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258200.539780:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258200.539787:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258200.539881:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258200.539888:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258200.539894:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258200.539900:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098233472, portal 10 00000400:00000010:3.0:1734258200.539906:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734258200.539907:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098233472, offset 0 00000400:00000200:3.0:1734258200.539956:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258200.539967:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258200.539971:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258200.539975:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258200.539978:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258200.539980:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258200.539983:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [555:555:256:4294967295] 192.168.202.108@tcp LPNI seq info [554:554:8:4294967295] 00000400:00000200:3.0:1734258200.539990:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258200.539996:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258200.540000:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734258200.540005:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258200.540014:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258200.540018:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258200.540296:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258200.540300:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734258200.540303:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258200.540307:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258200.540311:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734258200.540312:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734258200.540319:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098233472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258210 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258200.540390:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258200.540399:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258200.540403:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258200.540405:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098233344, portal 25 00000400:00000010:1.0:1734258200.540408:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734258200.540409:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098233344, offset 0 00000400:00000200:1.0:1734258200.540413:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258200.540417:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258200.540420:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258200.540422:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258200.540424:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258200.540425:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258200.540427:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [556:556:256:4294967295] 192.168.202.108@tcp LPNI seq info [555:555:8:4294967295] 00000400:00000200:1.0:1734258200.540432:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258200.540435:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258200.540438:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734258200.540447:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258200.540450:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258200.540452:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258200.540855:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258200.540858:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734258200.540861:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258200.540865:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258200.540868:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:0.0:1734258200.540869:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734258200.540873:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098233344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258216 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258200.544464:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258200.544484:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611480 00000400:00000200:0.0:1734258200.544504:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1249 [1] + 0 00000400:00000200:0.0:1734258200.544516:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258200.544519:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258200.544530:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098233472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258210 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258200.545603:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258200.545614:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611400 00000400:00000200:0.0:1734258200.545621:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1251 [1] + 224 00000400:00000200:0.0:1734258200.545643:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258200.545646:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258200.545653:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098233344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258216 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258200.545767:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258200.545772:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258200.545773:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258200.545779:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098233472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258210 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258200.545786:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098233472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258210 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258200.545816:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258200.545821:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258200.545826:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:1.0:1734258200.545892:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258200.545896:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258200.545897:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258200.545902:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098233344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258216 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258200.545907:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098233344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258216 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258200.545927:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258200.545930:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734258200.545932:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258205.547696:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258205.547715:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 02000000:00000010:3.0:1734258205.547985:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258205.547992:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258205.547998:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258205.548005:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098233600, portal 25 00000400:00000010:3.0:1734258205.548009:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258205.548010:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098233600, offset 0 00000400:00000200:3.0:1734258205.548019:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258205.548039:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258205.548044:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258205.548047:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258205.548050:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258205.548052:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258205.548054:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [557:557:256:4294967295] 192.168.202.108@tcp LPNI seq info [556:556:8:4294967295] 00000400:00000200:3.0:1734258205.548062:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258205.548067:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258205.548070:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734258205.548075:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258205.548082:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258205.548085:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258205.548196:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258205.548198:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:3.0:1734258205.548201:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258205.548205:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258205.548208:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258205.548210:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258205.548215:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098233600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258221 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258205.549518:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258205.549535:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258205.549604:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734258205.549609:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258205.549614:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258205.549618:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098233728, portal 10 00000400:00000010:3.0:1734258205.549623:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734258205.549625:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098233728, offset 0 00000400:00000200:3.0:1734258205.549630:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258205.549638:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258205.549643:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258205.549645:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258205.549648:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258205.549658:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258205.549661:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [558:558:256:4294967295] 192.168.202.108@tcp LPNI seq info [557:557:8:4294967295] 00000400:00000200:3.0:1734258205.549667:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258205.549672:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258205.549675:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734258205.549680:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258205.549685:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258205.549688:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734258205.550335:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734258205.550345:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611500 00000400:00000200:1.0:1734258205.550350:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1259 [1] + 224 00000400:00000200:1.0:1734258205.550367:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258205.550370:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:1.0:1734258205.550384:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098233600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258221 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258205.550557:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258205.550560:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734258205.550562:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258205.550566:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258205.550583:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734258205.550586:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734258205.550590:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098233728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258215 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258205.552736:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:0.0:1734258205.552737:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:3.0:1734258205.552743:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:3.0:1734258205.552745:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000400:00000200:0.0:1734258205.552749:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611580 00000100:00000200:3.0:1734258205.552753:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098233600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258221 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258205.552756:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1261 [1] + 0 00000100:00000200:3.0:1734258205.552762:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098233600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258221 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258205.552780:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258205.552785:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734258205.552789:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000200:0.0:1734258205.552812:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258205.552816:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258205.552834:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098233728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258215 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258205.556867:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258205.556890:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258205.556892:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258205.556906:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098233728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258215 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258205.556915:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098233728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258215 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258205.556945:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734258205.556950:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258205.556955:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258210.557553:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258210.557587:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258210.557644:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258210.557652:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258210.557678:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258210.557684:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258210.557699:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258210.557704:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098233856, portal 25 00000400:00000010:3.0:1734258210.557707:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258210.557709:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098233856, offset 0 00000400:00000200:3.0:1734258210.557715:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734258210.557718:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:3.0:1734258210.557724:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734258210.557726:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000200:3.0:1734258210.557728:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734258210.557730:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000400:00000200:3.0:1734258210.557732:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:2.0:1734258210.557733:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098233984, portal 10 00000400:00000200:3.0:1734258210.557734:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:2.0:1734258210.557736:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000400:00000200:3.0:1734258210.557736:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:2.0:1734258210.557738:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098233984, offset 0 00000400:00000200:3.0:1734258210.557739:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [559:559:256:4294967295] 192.168.202.108@tcp LPNI seq info [558:558:8:4294967295] 00000400:00000200:2.0:1734258210.557742:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258210.557746:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258210.557750:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258210.557753:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734258210.557757:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258210.557763:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258210.557766:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734258210.557793:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258210.557796:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258210.557798:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258210.557799:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258210.557801:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258210.557802:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [560:560:255:4294967295] 192.168.202.108@tcp LPNI seq info [559:559:7:4294967295] 00000400:00000200:2.0:1734258210.557808:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258210.557811:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258210.557813:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258210.557816:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258210.557820:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258210.557822:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258210.557883:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258210.557886:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734258210.557891:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258210.557895:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258210.557898:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734258210.557899:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734258210.557906:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098233856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258226 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258210.557961:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258210.557963:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258210.557966:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258210.557969:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258210.557970:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734258210.557971:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734258210.557974:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098233984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258220 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258210.561792:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258210.561808:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611680 00000400:00000200:0.0:1734258210.561815:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1271 [1] + 0 00000400:00000200:0.0:1734258210.561825:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258210.561828:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258210.561847:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098233984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258220 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258210.561883:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258210.561896:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611600 00000400:00000200:0.0:1734258210.561901:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1269 [1] + 224 00000400:00000200:0.0:1734258210.561915:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258210.561918:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258210.561923:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098233856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258226 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258210.561969:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258210.561974:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258210.561975:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258210.561980:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098233984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258220 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258210.561987:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098233984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258220 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258210.562011:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258210.562016:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258210.562020:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:3.0:1734258210.562206:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258210.562210:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258210.562211:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258210.562221:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098233856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258226 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258210.562227:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098233856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258226 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258210.562243:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258210.562246:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734258210.562248:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258215.563960:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258215.563979:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 02000000:00000010:1.0:1734258215.564565:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258215.564597:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258215.564603:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258215.564609:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098234112, portal 25 00000400:00000010:1.0:1734258215.564614:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734258215.564616:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098234112, offset 0 00000400:00000200:1.0:1734258215.564622:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258215.564634:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258215.564639:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258215.564642:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258215.564655:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258215.564656:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258215.564659:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [561:561:256:4294967295] 192.168.202.108@tcp LPNI seq info [560:560:8:4294967295] 00000400:00000200:1.0:1734258215.564666:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258215.564672:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258215.564676:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734258215.564681:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258215.564687:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258215.564691:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258215.564843:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258215.564845:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:2.0:1734258215.564848:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258215.564852:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258215.564856:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:2.0:1734258215.564857:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:2.0:1734258215.564863:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098234112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258231 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258215.566156:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258215.566169:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258215.566210:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258215.566215:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258215.566227:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258215.566231:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098234240, portal 10 00000400:00000010:2.0:1734258215.566236:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734258215.566238:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098234240, offset 0 00000400:00000200:2.0:1734258215.566243:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258215.566250:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258215.566254:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258215.566256:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258215.566258:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258215.566260:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258215.566262:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [562:562:256:4294967295] 192.168.202.108@tcp LPNI seq info [561:561:8:4294967295] 00000400:00000200:2.0:1734258215.566267:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258215.566282:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258215.566285:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258215.566289:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258215.566294:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258215.566296:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258215.566409:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258215.566411:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258215.566414:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258215.566417:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258215.566420:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734258215.566421:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734258215.566430:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098234240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258225 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258215.572181:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258215.572200:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611700 00000400:00000200:0.0:1734258215.572209:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1279 [1] + 224 00000400:00000200:0.0:1734258215.572221:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258215.572225:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258215.572237:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098234112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258231 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258215.573116:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:0.0:1734258215.573121:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734258215.573122:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258215.573125:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000400:00000200:0.0:1734258215.573129:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611780 00000100:00000200:1.0:1734258215.573131:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098234112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258231 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258215.573133:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1281 [1] + 0 00000100:00000200:1.0:1734258215.573138:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098234112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258231 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258215.573156:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 02000000:00000010:1.0:1734258215.573162:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258215.573167:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000400:00000200:0.0:1734258215.573169:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000010:1.0:1734258215.573172:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000200:0.0:1734258215.573309:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098234240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258225 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258215.573616:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258215.573621:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258215.573622:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258215.573627:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098234240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258225 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258215.573631:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098234240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258225 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258215.573652:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258215.573657:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258215.573660:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258220.571718:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258220.571743:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258220.572522:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258220.572533:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258220.572559:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258220.572591:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258220.572598:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258220.572607:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098234368, portal 25 00000400:00000010:1.0:1734258220.572611:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734258220.572613:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098234368, offset 0 00000400:00000200:1.0:1734258220.572621:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258220.572635:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258220.572641:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258220.572644:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258220.572647:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258220.572649:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258220.572665:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [563:563:256:4294967295] 192.168.202.108@tcp LPNI seq info [562:562:8:4294967295] 00000400:00000200:1.0:1734258220.572673:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258220.572678:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258220.572682:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734258220.572687:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258220.572695:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258220.572699:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258220.572773:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258220.572777:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258220.572780:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258220.572783:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098234496, portal 10 00000400:00000010:3.0:1734258220.572792:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734258220.572793:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098234496, offset 0 00000400:00000200:3.0:1734258220.572797:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258220.572801:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258220.572803:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258220.572805:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258220.572807:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258220.572808:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258220.572810:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [564:564:255:4294967295] 192.168.202.108@tcp LPNI seq info [563:563:7:4294967295] 00000400:00000200:3.0:1734258220.572815:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258220.572817:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258220.572820:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734258220.572822:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258220.572825:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258220.572826:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258220.572978:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258220.572981:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:2.0:1734258220.572986:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258220.572991:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258220.572995:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:2.0:1734258220.572996:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:2.0:1734258220.573003:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098234368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258236 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258220.575800:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258220.575808:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:2.0:1734258220.575816:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258220.575824:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258220.575830:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:2.0:1734258220.575832:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:2.0:1734258220.575843:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098234496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258230 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258220.578510:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258220.578531:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611800 00000400:00000200:0.0:1734258220.578538:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1289 [1] + 224 00000400:00000200:0.0:1734258220.578550:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258220.578554:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258220.578564:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098234368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258236 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258220.578629:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258220.578633:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611880 00000400:00000200:0.0:1734258220.578638:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1291 [1] + 0 00000400:00000200:0.0:1734258220.578653:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258220.578656:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258220.578661:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098234496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258230 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258220.579119:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258220.579126:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258220.579127:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258220.579133:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098234496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258230 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258220.579140:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098234496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258230 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258220.579173:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258220.579177:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258220.579182:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:1.0:1734258220.579252:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258220.579255:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258220.579257:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258220.579261:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098234368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258236 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258220.579267:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098234368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258236 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258220.579278:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258220.579281:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734258220.579282:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258225.579769:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258225.579788:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258225.579842:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258225.579849:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258225.579950:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258225.579957:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258225.579963:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258225.579970:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098234624, portal 25 00000400:00000010:1.0:1734258225.579976:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734258225.579978:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098234624, offset 0 00000400:00000200:1.0:1734258225.579985:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258225.579997:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258225.580001:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258225.580004:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258225.580007:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258225.580009:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258225.580011:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [565:565:256:4294967295] 192.168.202.108@tcp LPNI seq info [564:564:8:4294967295] 00000400:00000200:1.0:1734258225.580029:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258225.580034:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258225.580037:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734258225.580042:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258225.580049:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258225.580052:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258225.580217:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258225.580220:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734258225.580224:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258225.580228:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258225.580235:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734258225.580237:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734258225.580242:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098234624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258241 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258225.580275:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258225.580280:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258225.580284:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258225.580290:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098234752, portal 10 00000400:00000010:2.0:1734258225.580294:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258225.580295:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098234752, offset 0 00000400:00000200:2.0:1734258225.580299:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258225.580304:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258225.580306:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258225.580308:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258225.580309:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258225.580311:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258225.580312:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [566:566:256:4294967295] 192.168.202.108@tcp LPNI seq info [565:565:8:4294967295] 00000400:00000200:2.0:1734258225.580318:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258225.580321:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258225.580324:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258225.580327:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258225.580331:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258225.580333:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258225.581008:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258225.581011:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258225.581014:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258225.581017:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258225.581020:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:0.0:1734258225.581021:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:0.0:1734258225.581025:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098234752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258235 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258225.583993:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258225.584011:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611900 00000400:00000200:0.0:1734258225.584018:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1299 [1] + 224 00000400:00000200:0.0:1734258225.584029:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258225.584033:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258225.584042:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098234624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258241 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258225.584080:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258225.584084:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611980 00000400:00000200:0.0:1734258225.584088:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x12a1 [1] + 0 00000400:00000200:0.0:1734258225.584104:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258225.584106:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258225.584110:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098234752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258235 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258225.584370:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258225.584375:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258225.584377:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258225.584383:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098234752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258235 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258225.584389:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098234752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258235 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258225.584425:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258225.584431:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258225.584437:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:1.0:1734258225.584659:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258225.584665:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258225.584667:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258225.584673:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098234624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258241 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258225.584680:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098234624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258241 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258225.584693:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258225.584697:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734258225.584699:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258230.587828:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258230.587852:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 02000000:00000010:1.0:1734258230.588556:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258230.588602:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258230.588613:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258230.588623:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098234880, portal 25 00000400:00000010:1.0:1734258230.588630:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734258230.588632:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098234880, offset 0 00000400:00000200:1.0:1734258230.588643:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258230.588658:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258230.588664:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258230.588669:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258230.588672:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258230.588674:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258230.588678:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [567:567:256:4294967295] 192.168.202.108@tcp LPNI seq info [566:566:8:4294967295] 00000400:00000200:1.0:1734258230.588696:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258230.588717:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258230.588720:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734258230.588727:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258230.588737:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258230.588741:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258230.590514:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258230.590522:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:2.0:1734258230.590529:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258230.590540:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258230.590545:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:2.0:1734258230.590548:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:2.0:1734258230.590561:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098234880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258246 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258230.590611:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258230.590644:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258230.590843:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258230.590851:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258230.590857:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258230.590862:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098235008, portal 10 00000400:00000010:2.0:1734258230.590868:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734258230.590870:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098235008, offset 0 00000400:00000200:2.0:1734258230.590877:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258230.590891:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258230.590897:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258230.590900:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258230.590903:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258230.590905:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258230.590908:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [568:568:256:4294967295] 192.168.202.108@tcp LPNI seq info [567:567:8:4294967295] 00000400:00000200:2.0:1734258230.590915:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258230.590920:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258230.590923:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258230.590928:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258230.590935:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258230.590938:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258230.591230:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258230.591234:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258230.591238:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258230.591244:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258230.591249:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:0.0:1734258230.591251:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734258230.591258:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098235008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258240 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258230.592625:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258230.592639:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611a80 00000400:00000200:0.0:1734258230.592647:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x12b1 [1] + 0 00000400:00000200:0.0:1734258230.592702:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258230.592706:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258230.592715:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098235008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258240 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258230.592912:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258230.592917:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258230.592919:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258230.592924:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098235008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258240 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258230.592937:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098235008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258240 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258230.592979:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258230.592985:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258230.592990:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734258230.593622:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258230.593630:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611a00 00000400:00000200:0.0:1734258230.593636:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x12a9 [1] + 224 00000400:00000200:0.0:1734258230.593654:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258230.593657:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258230.593664:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098234880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258246 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258230.593841:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258230.593845:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258230.593847:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258230.593852:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098234880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258246 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258230.593857:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098234880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258246 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258230.593870:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258230.593873:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734258230.593875:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258235.595754:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258235.595779:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258235.595845:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258235.595853:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258235.595974:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000400:00000010:2.0:1734258235.595982:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258235.595990:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258235.595998:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098235136, portal 25 00000400:00000010:2.0:1734258235.596002:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734258235.596004:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098235136, offset 0 00000400:00000200:2.0:1734258235.596013:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258235.596027:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258235.596032:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258235.596037:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258235.596040:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258235.596043:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258235.596046:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [569:569:256:4294967295] 192.168.202.108@tcp LPNI seq info [568:568:8:4294967295] 00000400:00000200:2.0:1734258235.596055:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258235.596062:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258235.596066:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258235.596072:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258235.596081:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258235.596085:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258235.596784:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258235.596792:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258235.596796:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258235.596799:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098235264, portal 10 00000400:00000010:3.0:1734258235.596804:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734258235.596820:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098235264, offset 0 00000400:00000200:3.0:1734258235.596826:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258235.596831:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258235.596833:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258235.596836:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258235.596838:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258235.596839:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258235.596841:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [570:570:255:4294967295] 192.168.202.108@tcp LPNI seq info [569:569:7:4294967295] 00000400:00000200:3.0:1734258235.596847:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258235.596850:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258235.596853:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734258235.596855:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258235.596860:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258235.596862:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258235.601863:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258235.601869:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258235.601888:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258235.601898:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258235.601903:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734258235.601905:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734258235.601917:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098235136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258251 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258235.601988:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258235.601990:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734258235.601992:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258235.601995:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258235.601997:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734258235.601999:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734258235.602003:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098235264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258245 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258235.603621:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258235.603637:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611b00 00000400:00000200:0.0:1734258235.603652:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x12b9 [1] + 224 00000400:00000200:0.0:1734258235.603662:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258235.603664:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258235.603672:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098235136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258251 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258235.603704:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258235.603708:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611b80 00000400:00000200:0.0:1734258235.603712:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x12c1 [1] + 0 00000400:00000200:0.0:1734258235.603725:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258235.603727:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258235.603731:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098235264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258245 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258235.603807:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258235.603811:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258235.603813:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258235.603817:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098235136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258251 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258235.603836:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098235136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258251 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258235.603856:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:2.0:1734258235.603859:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734258235.603862:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:3.0:1734258235.603916:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258235.603919:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258235.603920:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258235.603924:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098235264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258245 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258235.603929:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098235264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258245 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258235.603941:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258235.603943:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258235.603945:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734258240.603756:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258240.603793:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 02000000:00000010:2.0:1734258240.603920:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000100:00000010:0.0:1734258240.603922:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 00000400:00000010:2.0:1734258240.603927:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 02000000:00000010:0.0:1734258240.603929:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 00000400:00000010:2.0:1734258240.603933:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258240.603939:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098235392, portal 25 00000400:00000010:2.0:1734258240.603943:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734258240.603944:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098235392, offset 0 00000400:00000200:2.0:1734258240.603952:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258240.603965:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258240.603970:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258240.603974:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258240.603977:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258240.603979:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258240.603981:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [571:571:256:4294967295] 192.168.202.108@tcp LPNI seq info [570:570:8:4294967295] 00000400:00000200:2.0:1734258240.603987:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258240.603991:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258240.603994:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 02000000:00000010:3.0:1734258240.603995:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000800:00000200:2.0:1734258240.603998:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:3.0:1734258240.604000:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258240.604004:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000800:00000200:2.0:1734258240.604005:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:3.0:1734258240.604006:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098235520, portal 10 00000800:00000200:2.0:1734258240.604007:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:3.0:1734258240.604011:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734258240.604013:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098235520, offset 0 00000400:00000200:3.0:1734258240.604036:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258240.604040:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258240.604043:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258240.604046:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258240.604048:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258240.604049:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258240.604051:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [572:572:255:4294967295] 192.168.202.108@tcp LPNI seq info [571:571:7:4294967295] 00000400:00000200:3.0:1734258240.604057:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258240.604060:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258240.604062:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734258240.604065:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258240.604068:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258240.604070:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258240.604285:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258240.604287:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258240.604292:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258240.604296:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258240.604301:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734258240.604302:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734258240.604312:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098235392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258256 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258240.604384:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258240.604385:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734258240.604387:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258240.604390:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258240.604392:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734258240.604394:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734258240.604397:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098235520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258250 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258240.609323:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258240.609347:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611c00 00000400:00000200:0.0:1734258240.609357:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x12c9 [1] + 224 00000400:00000200:0.0:1734258240.609373:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258240.609377:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258240.609391:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098235392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258256 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258240.609440:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258240.609445:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611c80 00000400:00000200:0.0:1734258240.609451:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x12d1 [1] + 0 00000400:00000200:0.0:1734258240.609473:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258240.609486:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258240.609492:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098235520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258250 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258240.609663:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258240.609684:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258240.609686:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258240.609698:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098235520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258250 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258240.609707:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098235520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258250 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258240.609739:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258240.609747:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258240.609752:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:2.0:1734258240.610393:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258240.610400:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258240.610402:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258240.610408:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098235392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258256 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258240.610429:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098235392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258256 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258240.610451:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:2.0:1734258240.610456:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734258240.610459:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258245.611969:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258245.612001:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258245.612067:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258245.612074:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734258245.612744:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258245.612760:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258245.612769:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258245.612778:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098235648, portal 25 00000400:00000010:3.0:1734258245.612783:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734258245.612785:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098235648, offset 0 00000400:00000200:3.0:1734258245.612795:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258245.612825:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258245.612831:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258245.612835:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258245.612838:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258245.612840:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258245.612843:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [573:573:256:4294967295] 192.168.202.108@tcp LPNI seq info [572:572:8:4294967295] 00000400:00000200:3.0:1734258245.612851:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258245.612856:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258245.612860:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734258245.612865:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258245.612874:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258245.612877:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258245.613134:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258245.613137:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734258245.613141:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258245.613145:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258245.613148:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734258245.613150:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734258245.613157:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098235648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258261 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258245.613642:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258245.613651:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258245.613657:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258245.613662:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098235776, portal 10 00000400:00000010:2.0:1734258245.613669:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258245.613671:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098235776, offset 0 00000400:00000200:2.0:1734258245.613679:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258245.613690:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258245.613694:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258245.613697:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258245.613700:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258245.613702:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258245.613704:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [574:574:256:4294967295] 192.168.202.108@tcp LPNI seq info [573:573:8:4294967295] 00000400:00000200:2.0:1734258245.613711:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258245.613716:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258245.613719:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258245.613723:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258245.613729:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258245.613732:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258245.613862:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258245.613865:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258245.613869:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258245.613872:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258245.613875:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734258245.613877:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734258245.613882:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098235776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258255 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258245.616935:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258245.616962:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611d00 00000400:00000200:0.0:1734258245.616976:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x12d9 [1] + 224 00000400:00000200:0.0:1734258245.617018:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258245.617023:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258245.617037:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098235648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258261 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258245.617411:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258245.617427:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258245.617430:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258245.617446:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098235648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258261 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258245.617454:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098235648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258261 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258245.617482:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258245.617489:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258245.617494:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734258245.617705:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258245.617720:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611d80 00000400:00000200:0.0:1734258245.617725:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x12e1 [1] + 0 00000400:00000200:0.0:1734258245.617735:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258245.617738:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258245.617744:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098235776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258255 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258245.618460:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258245.618467:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258245.618469:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258245.618475:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098235776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258255 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258245.618492:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098235776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258255 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258245.618521:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258245.618526:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258245.618530:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734258250.619691:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258250.619710:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258250.619768:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258250.619775:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258250.619817:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258250.619825:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258250.619831:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258250.619838:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098235904, portal 25 00000400:00000010:3.0:1734258250.619843:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734258250.619844:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098235904, offset 0 00000400:00000200:3.0:1734258250.619852:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258250.619864:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258250.619869:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258250.619883:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258250.619885:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258250.619887:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258250.619890:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [575:575:256:4294967295] 192.168.202.108@tcp LPNI seq info [574:574:8:4294967295] 02000000:00000010:2.0:1734258250.619891:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258250.619895:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258250.619898:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000400:00000200:3.0:1734258250.619898:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:2.0:1734258250.619901:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098236032, portal 10 00000800:00000200:3.0:1734258250.619904:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734258250.619905:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734258250.619906:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098236032, offset 0 00000800:00000010:3.0:1734258250.619907:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000400:00000200:2.0:1734258250.619911:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734258250.619912:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734258250.619916:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258250.619918:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:3.0:1734258250.619919:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734258250.619920:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258250.619922:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734258250.619923:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734258250.619924:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258250.619925:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [576:576:255:4294967295] 192.168.202.108@tcp LPNI seq info [575:575:7:4294967295] 00000400:00000200:2.0:1734258250.619931:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258250.619934:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258250.619936:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258250.619938:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258250.619942:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258250.619943:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258250.620016:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258250.620019:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734258250.620023:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258250.620027:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258250.620031:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734258250.620032:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734258250.620039:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098235904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258266 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258250.620096:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258250.620098:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258250.620100:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258250.620103:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258250.620105:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734258250.620106:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734258250.620109:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098236032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258260 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258250.623854:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258250.623877:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611e00 00000400:00000200:0.0:1734258250.623886:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x12e9 [1] + 224 00000400:00000200:0.0:1734258250.623918:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258250.623932:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258250.623944:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098235904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258266 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258250.624039:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258250.624045:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258250.624047:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258250.624053:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098235904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258266 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258250.624060:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098235904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258266 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258250.624080:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258250.624084:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734258250.624088:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734258250.624866:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258250.624876:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611e80 00000400:00000200:0.0:1734258250.624882:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x12f1 [1] + 0 00000400:00000200:0.0:1734258250.624895:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258250.624898:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258250.624904:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098236032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258260 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258250.625020:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258250.625026:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258250.625027:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258250.625032:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098236032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258260 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258250.625050:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098236032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258260 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258250.625074:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258250.625079:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258250.625082:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258255.628439:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258255.628458:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258255.628523:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258255.628530:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258255.628599:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258255.628606:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258255.628612:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258255.628619:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098236160, portal 25 00000400:00000010:1.0:1734258255.628623:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734258255.628624:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098236160, offset 0 00000400:00000200:1.0:1734258255.628632:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258255.628647:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258255.628652:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258255.628655:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258255.628658:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258255.628659:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258255.628662:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [577:577:256:4294967295] 192.168.202.108@tcp LPNI seq info [576:576:8:4294967295] 02000000:00000010:3.0:1734258255.628664:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258255.628668:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:1.0:1734258255.628669:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:3.0:1734258255.628670:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258255.628672:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098236288, portal 10 00000800:00000200:1.0:1734258255.628674:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734258255.628675:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734258255.628677:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098236288, offset 0 00000400:00000200:3.0:1734258255.628680:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258255.628684:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258255.628685:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734258255.628686:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000400:00000200:3.0:1734258255.628687:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258255.628688:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734258255.628691:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258255.628693:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258255.628695:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [578:578:255:4294967295] 192.168.202.108@tcp LPNI seq info [577:577:7:4294967295] 00000800:00000200:1.0:1734258255.628698:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734258255.628700:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258255.628701:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258255.628703:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258255.628705:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734258255.628707:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258255.628710:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258255.628712:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258255.628803:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258255.628806:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734258255.628809:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258255.628813:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258255.628817:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:0.0:1734258255.628818:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734258255.628826:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098236160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258271 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258255.628891:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258255.628893:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734258255.628895:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258255.628898:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258255.628900:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:0.0:1734258255.628901:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734258255.628904:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098236288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258265 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258255.631792:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258255.631816:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c611f80 00000400:00000200:0.0:1734258255.631823:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1301 [1] + 0 00000400:00000200:0.0:1734258255.631838:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258255.631841:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258255.631849:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098236288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258265 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258255.632066:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258255.632069:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258255.632071:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258255.632076:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098236288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258265 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258255.632081:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098236288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258265 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258255.632104:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258255.632107:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258255.632112:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734258255.632564:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258255.632596:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c611f00 00000400:00000200:0.0:1734258255.632601:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x12f9 [1] + 224 00000400:00000200:0.0:1734258255.632614:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258255.632617:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258255.632622:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098236160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258271 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258255.632725:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258255.632777:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258255.632779:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258255.632783:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098236160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258271 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258255.632788:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098236160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258271 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258255.632799:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258255.632802:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734258255.632803:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258260.635729:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258260.635749:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258260.636387:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258260.636396:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258260.636467:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258260.636475:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258260.636481:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258260.636486:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098236544, portal 10 00000400:00000010:3.0:1734258260.636492:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734258260.636494:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098236544, offset 0 02000000:00000010:1.0:1734258260.636498:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000200:3.0:1734258260.636501:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734258260.636502:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258260.636506:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258260.636509:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098236416, portal 25 00000400:00000010:1.0:1734258260.636511:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734258260.636513:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098236416, offset 0 00000400:00000200:3.0:1734258260.636514:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258260.636518:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258260.636519:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258260.636521:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258260.636524:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258260.636526:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258260.636542:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [579:579:256:4294967295] 192.168.202.108@tcp LPNI seq info [578:578:8:4294967295] 00000400:00000200:3.0:1734258260.636549:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258260.636555:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258260.636558:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734258260.636563:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258260.636606:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258260.636609:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258260.637278:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258260.637283:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734258260.637287:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258260.637292:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258260.637296:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734258260.637298:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734258260.637304:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098236544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258270 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734258260.637492:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258260.637496:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258260.637498:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258260.637500:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258260.637502:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258260.637503:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [580:580:255:4294967295] 192.168.202.108@tcp LPNI seq info [579:579:7:4294967295] 00000400:00000200:1.0:1734258260.637509:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258260.637513:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258260.637516:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734258260.637526:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258260.637531:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258260.637533:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258260.637618:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258260.637621:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734258260.637623:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258260.637626:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258260.637628:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734258260.637633:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734258260.637637:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098236416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258276 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258260.642788:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258260.642805:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612080 00000400:00000200:0.0:1734258260.642813:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1309 [1] + 0 00000400:00000200:0.0:1734258260.642823:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258260.642827:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258260.642837:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098236544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258270 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258260.642872:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258260.642876:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612000 00000400:00000200:0.0:1734258260.642881:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1311 [1] + 224 00000400:00000200:0.0:1734258260.642898:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258260.642902:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258260.642906:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098236416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258276 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258260.643118:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258260.643124:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258260.643126:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258260.643131:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098236416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258276 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258260.643137:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098236416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258276 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258260.643157:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258260.643161:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734258260.643164:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:3.0:1734258260.643727:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258260.643733:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258260.643734:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258260.643740:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098236544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258270 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258260.643747:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098236544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258270 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258260.643765:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258260.643768:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258260.643771:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258265.643990:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258265.644008:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258265.644191:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258265.644198:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734258265.644285:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258265.644292:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258265.644297:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258265.644302:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098236672, portal 25 00000400:00000010:1.0:1734258265.644306:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 02000000:00000010:2.0:1734258265.644583:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258265.644587:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258265.644590:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:1.0:1734258265.644591:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098236672, offset 0 00000100:00000200:2.0:1734258265.644592:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098236800, portal 10 00000400:00000010:2.0:1734258265.644596:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000400:00000200:1.0:1734258265.644599:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734258265.644603:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098236800, offset 0 00000400:00000200:2.0:1734258265.644606:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258265.644610:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258265.644613:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258265.644859:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258265.644863:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258265.644865:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258265.644868:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [581:581:256:4294967295] 192.168.202.108@tcp LPNI seq info [580:580:8:4294967295] 00000400:00000200:1.0:1734258265.644924:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258265.644929:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258265.644931:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734258265.644933:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000400:00000200:2.0:1734258265.644934:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258265.644935:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734258265.644937:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734258265.644937:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258265.644939:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258265.644940:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [582:582:255:4294967295] 192.168.202.108@tcp LPNI seq info [581:581:7:4294967295] 00000800:00000200:1.0:1734258265.644943:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734258265.644945:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258265.644948:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258265.644950:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258265.644952:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258265.644955:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258265.644956:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258265.644956:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258265.646659:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258265.646664:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258265.646669:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258265.646675:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258265.646680:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734258265.646681:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734258265.646689:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098236800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258265.646753:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258265.646755:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734258265.646757:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258265.646759:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258265.646761:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:0.0:1734258265.646762:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:0.0:1734258265.646765:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098236672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258281 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258265.652682:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258265.652697:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612180 00000400:00000200:0.0:1734258265.652703:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1321 [1] + 0 00000400:00000200:0.0:1734258265.652719:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258265.652722:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258265.652730:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098236800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258275 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258265.652889:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258265.652892:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258265.652894:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258265.652898:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098236800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258265.652915:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098236800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258275 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258265.652940:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258265.652944:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258265.652949:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734258265.655730:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258265.655745:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612100 00000400:00000200:0.0:1734258265.655753:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1319 [1] + 224 00000400:00000200:0.0:1734258265.655769:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258265.655772:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258265.655780:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098236672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258281 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258265.657038:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258265.657046:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258265.657048:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258265.657056:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098236672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258281 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258265.657063:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098236672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258281 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258265.657082:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258265.657085:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734258265.657089:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258270.651700:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258270.651720:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258270.651781:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258270.651788:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258270.651893:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258270.651901:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258270.651907:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258270.651919:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098236928, portal 25 00000400:00000010:3.0:1734258270.651923:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734258270.651925:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098236928, offset 0 00000400:00000200:3.0:1734258270.651935:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258270.651948:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:2.0:1734258270.651950:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:3.0:1734258270.651954:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734258270.651955:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000200:3.0:1734258270.651957:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:2.0:1734258270.651958:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258270.651960:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098237056, portal 10 00000400:00000200:3.0:1734258270.651960:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258270.651962:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:2.0:1734258270.651964:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000400:00000200:3.0:1734258270.651964:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [583:583:256:4294967295] 192.168.202.108@tcp LPNI seq info [582:582:8:4294967295] 00000100:00000200:2.0:1734258270.651965:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098237056, offset 0 00000400:00000200:2.0:1734258270.651968:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258270.652101:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258270.652106:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258270.652109:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258270.652114:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258270.652121:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258270.652124:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258270.652245:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258270.652248:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734258270.652257:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258270.652261:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258270.652265:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:0.0:1734258270.652266:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734258270.652272:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098236928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258286 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734258270.652277:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258270.652279:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258270.652281:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258270.652283:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258270.652284:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258270.652286:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [584:584:255:4294967295] 192.168.202.108@tcp LPNI seq info [583:583:7:4294967295] 00000400:00000200:2.0:1734258270.652292:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258270.652295:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258270.652298:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258270.652301:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258270.652304:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258270.652306:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258270.652333:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258270.652335:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258270.652338:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258270.652341:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258270.652343:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734258270.652344:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734258270.652347:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098237056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258270.656507:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258270.656526:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612200 00000400:00000200:0.0:1734258270.656535:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1329 [1] + 224 00000400:00000200:0.0:1734258270.656546:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258270.656550:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258270.656728:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098236928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258286 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258270.656764:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258270.656768:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612280 00000400:00000200:0.0:1734258270.656774:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1331 [1] + 0 00000400:00000200:0.0:1734258270.656791:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258270.656794:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258270.656799:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098237056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258280 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258270.657011:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258270.657016:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258270.657018:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000400:00000010:3.0:1734258270.657023:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000100:00000200:2.0:1734258270.657024:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098237056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734258270.657027:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258270.657029:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258270.657034:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098236928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258286 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258270.657040:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098236928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258286 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258270.657044:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098237056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258280 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258270.657063:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258270.657068:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 02000000:00000010:2.0:1734258270.657070:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734258270.657071:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 02000000:00000010:2.0:1734258270.657075:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258270.657077:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734258275.659708:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258275.659741:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 02000000:00000010:1.0:1734258275.660199:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000100:00000010:0.0:1734258275.660205:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 00000400:00000010:1.0:1734258275.660207:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 02000000:00000010:0.0:1734258275.660211:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 00000400:00000010:1.0:1734258275.660213:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258275.660219:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098237184, portal 25 00000400:00000010:1.0:1734258275.660223:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734258275.660225:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098237184, offset 0 00000400:00000200:1.0:1734258275.660233:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258275.660243:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258275.660248:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258275.660251:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258275.660254:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258275.660256:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258275.660258:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [585:585:256:4294967295] 192.168.202.108@tcp LPNI seq info [584:584:8:4294967295] 00000400:00000200:1.0:1734258275.660265:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258275.660269:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258275.660273:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 02000000:00000010:3.0:1734258275.660277:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000800:00000200:1.0:1734258275.660278:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:3.0:1734258275.660282:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000800:00000200:1.0:1734258275.660284:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:3.0:1734258275.660285:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000800:00000200:1.0:1734258275.660287:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:3.0:1734258275.660287:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098237312, portal 10 00000400:00000010:3.0:1734258275.660291:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734258275.660292:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098237312, offset 0 00000400:00000200:3.0:1734258275.660296:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258275.660301:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258275.660303:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258275.660305:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258275.660306:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258275.660308:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258275.660310:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [586:586:255:4294967295] 192.168.202.108@tcp LPNI seq info [585:585:7:4294967295] 00000400:00000200:3.0:1734258275.660315:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258275.660323:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258275.660325:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734258275.660328:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258275.660343:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258275.660345:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258275.660542:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258275.660544:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734258275.660548:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258275.660552:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258275.660556:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:0.0:1734258275.660557:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:0.0:1734258275.660565:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098237184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258291 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258275.660647:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258275.660649:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734258275.660651:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258275.660654:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258275.660656:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:0.0:1734258275.660657:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734258275.660660:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098237312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258285 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258275.663738:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258275.663760:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612380 00000400:00000200:0.0:1734258275.663770:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1341 [1] + 0 00000400:00000200:0.0:1734258275.663782:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258275.663786:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258275.663797:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098237312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258285 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258275.663833:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258275.663837:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612300 00000400:00000200:0.0:1734258275.663842:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1339 [1] + 224 00000400:00000200:0.0:1734258275.663856:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258275.663862:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258275.663867:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098237184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258291 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258275.663987:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258275.663999:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258275.664001:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258275.664012:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098237184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258291 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258275.664021:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098237184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258291 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258275.664073:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258275.664079:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734258275.664083:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:3.0:1734258275.664425:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258275.664430:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258275.664431:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258275.664436:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098237312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258285 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258275.664443:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098237312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258285 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258275.664460:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258275.664463:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258275.664467:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258280.667999:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258280.668024:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258280.668146:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258280.668154:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258280.668228:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258280.668241:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258280.668256:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258280.668262:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098237440, portal 25 00000400:00000010:1.0:1734258280.668266:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734258280.668268:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098237440, offset 0 00000400:00000200:1.0:1734258280.668276:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258280.668288:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258280.668304:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258280.668307:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258280.668310:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258280.668311:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258280.668314:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [587:587:256:4294967295] 192.168.202.108@tcp LPNI seq info [586:586:8:4294967295] 00000400:00000200:1.0:1734258280.668321:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258280.668326:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258280.668330:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734258280.668335:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258280.668343:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258280.668346:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258280.668442:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258280.668447:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258280.668450:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258280.668452:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098237568, portal 10 00000400:00000010:3.0:1734258280.668457:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734258280.668458:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098237568, offset 0 00000400:00000200:3.0:1734258280.668463:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258280.668467:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258280.668469:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258280.668471:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258280.668472:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258280.668474:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258280.668476:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [588:588:255:4294967295] 192.168.202.108@tcp LPNI seq info [587:587:7:4294967295] 00000400:00000200:3.0:1734258280.668482:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258280.668485:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258280.668499:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734258280.668503:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258280.668506:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258280.668508:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258280.668777:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258280.668780:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734258280.668785:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258280.668789:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258280.668793:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734258280.668794:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734258280.668805:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098237440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258296 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258280.668984:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258280.668986:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734258280.668988:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258280.668991:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258280.668993:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:0.0:1734258280.668994:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:0.0:1734258280.668997:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098237568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258290 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258280.674221:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258280.674242:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612400 00000400:00000200:0.0:1734258280.674252:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1349 [1] + 224 00000400:00000200:0.0:1734258280.674265:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258280.674269:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258280.674281:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098237440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258296 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258280.675254:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258280.675274:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612480 00000400:00000200:0.0:1734258280.675279:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1351 [1] + 0 00000400:00000200:0.0:1734258280.675306:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258280.675310:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258280.675317:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098237568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258290 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258280.675949:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:1.0:1734258280.675960:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:1.0:1734258280.675962:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258280.675967:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098237440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258296 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258280.675974:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098237440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258296 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258280.675995:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258280.676000:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734258280.676004:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:3.0:1734258280.677912:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258280.677920:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258280.677922:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258280.677932:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098237568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258290 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258280.677941:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098237568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258290 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258280.677963:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258280.677967:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734258280.677971:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258285.677015:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258285.677040:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 02000000:00000010:3.0:1734258285.677732:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258285.677742:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258285.677750:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258285.677759:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098237696, portal 25 00000400:00000010:3.0:1734258285.677765:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734258285.677767:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098237696, offset 0 00000400:00000200:3.0:1734258285.677780:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258285.677796:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258285.677803:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258285.677807:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258285.677810:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258285.677812:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258285.677816:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [589:589:256:4294967295] 192.168.202.108@tcp LPNI seq info [588:588:8:4294967295] 00000400:00000200:3.0:1734258285.677826:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258285.677832:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258285.677838:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734258285.677861:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258285.677872:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258285.677876:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258285.678060:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258285.678064:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734258285.678067:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258285.678072:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258285.678076:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:1.0:1734258285.678078:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:1.0:1734258285.678087:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098237696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258301 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258285.679039:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258285.679054:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734258285.679497:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258285.679502:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258285.679508:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258285.679513:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098237824, portal 10 00000400:00000010:3.0:1734258285.679519:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734258285.679521:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098237824, offset 0 00000400:00000200:3.0:1734258285.679526:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258285.679534:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258285.679538:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258285.679541:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258285.679544:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258285.679546:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258285.679548:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [590:590:256:4294967295] 192.168.202.108@tcp LPNI seq info [589:589:8:4294967295] 00000400:00000200:3.0:1734258285.679555:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258285.679559:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258285.679562:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734258285.679567:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258285.679587:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258285.679590:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734258285.681414:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258285.681433:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612500 00000400:00000200:0.0:1734258285.681440:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1359 [1] + 224 00000400:00000200:0.0:1734258285.681462:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258285.681467:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258285.681476:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098237696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258301 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258285.682082:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258285.682086:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:2.0:1734258285.682090:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258285.682093:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258285.682098:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:2.0:1734258285.682100:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:2.0:1734258285.682108:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098237824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258295 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258285.684451:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258285.684462:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:3.0:1734258285.684464:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258285.684477:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098237696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258301 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258285.684486:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098237696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258301 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258285.684511:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258285.684532:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734258285.684537:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734258285.685390:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258285.685406:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612580 00000400:00000200:0.0:1734258285.685413:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1361 [1] + 0 00000400:00000200:0.0:1734258285.685432:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258285.685436:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258285.685443:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098237824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258295 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258285.685561:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258285.685566:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258285.685567:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258285.685589:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098237824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258295 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258285.685595:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098237824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258295 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258285.685613:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258285.685618:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258285.685622:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258290.683692:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258290.683774:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258290.683983:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258290.683990:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258290.684104:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258290.684111:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258290.684116:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258290.684122:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098237952, portal 25 00000400:00000010:3.0:1734258290.684125:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258290.684126:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098237952, offset 0 00000400:00000200:3.0:1734258290.684181:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258290.684192:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258290.684197:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258290.684200:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258290.684203:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258290.684205:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258290.684207:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [591:591:256:4294967295] 192.168.202.108@tcp LPNI seq info [590:590:8:4294967295] 00000400:00000200:3.0:1734258290.684435:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258290.684441:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258290.684444:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258290.684449:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258290.684456:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258290.684465:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258290.684520:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258290.684524:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258290.684527:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258290.684530:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098238080, portal 10 00000400:00000010:2.0:1734258290.684534:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734258290.684536:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098238080, offset 0 00000400:00000200:2.0:1734258290.684540:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258290.684545:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258290.684547:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258290.684549:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258290.684550:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258290.684552:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258290.684554:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [592:592:255:4294967295] 192.168.202.108@tcp LPNI seq info [591:591:7:4294967295] 00000400:00000200:2.0:1734258290.684560:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258290.684563:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258290.684566:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258290.684596:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258290.684599:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258290.684601:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258290.684890:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258290.684893:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734258290.684897:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258290.684902:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258290.684906:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734258290.684907:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734258290.684914:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098237952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258306 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258290.684977:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258290.684979:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258290.684981:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258290.684984:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258290.684986:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734258290.684987:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734258290.684990:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098238080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258300 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258290.687480:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258290.687497:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612600 00000400:00000200:0.0:1734258290.687504:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1369 [1] + 224 00000400:00000200:0.0:1734258290.687525:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258290.687528:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258290.687538:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098237952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258306 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258290.687932:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258290.687938:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258290.687939:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258290.687946:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098237952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258306 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258290.687953:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098237952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258306 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258290.687977:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258290.687983:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734258290.687986:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734258290.688248:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258290.688255:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612680 00000400:00000200:0.0:1734258290.688260:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1371 [1] + 0 00000400:00000200:0.0:1734258290.688463:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258290.688467:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258290.688473:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098238080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258300 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258290.688673:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258290.688682:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258290.688683:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258290.688688:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098238080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258300 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258290.688695:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098238080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258300 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258290.688711:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258290.688715:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258290.688717:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258295.691735:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258295.691762:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258295.691833:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258295.691840:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258295.691881:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734258295.691890:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258295.691898:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258295.691905:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098238208, portal 25 00000400:00000010:2.0:1734258295.691910:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734258295.691917:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098238208, offset 0 00000400:00000200:2.0:1734258295.691926:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258295.691944:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258295.691951:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258295.691955:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258295.691958:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258295.691961:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258295.691964:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [593:593:256:4294967295] 192.168.202.108@tcp LPNI seq info [592:592:8:4294967295] 00000400:00000200:2.0:1734258295.691972:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258295.691978:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258295.691983:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258295.691989:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258295.692014:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258295.692018:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258295.692096:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258295.692102:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258295.692106:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258295.692109:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098238336, portal 10 00000400:00000010:3.0:1734258295.692115:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258295.692117:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098238336, offset 0 00000400:00000200:3.0:1734258295.692121:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258295.692126:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258295.692129:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258295.692131:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258295.692132:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258295.692134:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258295.692136:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [594:594:255:4294967295] 192.168.202.108@tcp LPNI seq info [593:593:7:4294967295] 00000400:00000200:3.0:1734258295.692143:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258295.692146:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258295.692150:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734258295.692153:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258295.692156:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258295.692158:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258295.692949:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258295.692953:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258295.692959:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258295.692964:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258295.692968:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734258295.692970:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734258295.692977:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098238208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258311 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258295.693057:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258295.693058:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734258295.693060:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258295.693063:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258295.693065:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734258295.693066:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734258295.693070:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098238336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258305 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258295.702702:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258295.702720:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612780 00000400:00000200:0.0:1734258295.702728:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1381 [1] + 0 00000400:00000200:0.0:1734258295.702741:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258295.702746:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258295.702757:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098238336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258305 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258295.702805:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258295.702810:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612700 00000400:00000200:0.0:1734258295.702827:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1379 [1] + 224 00000400:00000200:0.0:1734258295.702841:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258295.702844:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258295.702849:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098238208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258311 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258295.702963:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258295.702968:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258295.702970:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258295.702975:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098238336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258305 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258295.702981:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098238336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258305 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258295.703012:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258295.703016:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258295.703021:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:2.0:1734258295.703142:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258295.703147:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258295.703148:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258295.703153:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098238208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258311 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258295.703159:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098238208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258311 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258295.703184:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734258295.703187:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:2.0:1734258295.703189:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258300.700402:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258300.700435:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258300.700519:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258300.700528:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258300.700670:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734258300.700679:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258300.700687:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258300.700697:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098238464, portal 25 00000400:00000010:2.0:1734258300.700703:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734258300.700705:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098238464, offset 0 00000400:00000200:2.0:1734258300.700715:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258300.700731:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258300.700737:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258300.700741:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258300.700745:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258300.700747:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258300.700750:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [595:595:256:4294967295] 192.168.202.108@tcp LPNI seq info [594:594:8:4294967295] 00000400:00000200:2.0:1734258300.700760:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258300.700766:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258300.700770:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258300.700777:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258300.700786:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258300.700818:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258300.700972:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258300.700977:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258300.700981:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258300.700984:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098238592, portal 10 00000400:00000010:3.0:1734258300.700989:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734258300.700991:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098238592, offset 0 00000400:00000200:3.0:1734258300.700995:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258300.700999:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258300.701002:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258300.701004:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258300.701005:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258300.701007:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258300.701009:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [596:596:255:4294967295] 192.168.202.108@tcp LPNI seq info [595:595:7:4294967295] 00000400:00000200:3.0:1734258300.701015:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258300.701018:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258300.701021:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734258300.701024:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258300.701028:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258300.701030:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258300.701260:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258300.701263:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258300.701269:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258300.701274:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258300.701279:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734258300.701280:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734258300.701290:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098238464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258316 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258300.702838:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258300.702845:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734258300.702851:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258300.702856:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258300.702860:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:0.0:1734258300.702861:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:0.0:1734258300.702869:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098238592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258310 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258300.704277:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258300.704296:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612800 00000400:00000200:0.0:1734258300.704305:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1389 [1] + 224 00000400:00000200:0.0:1734258300.704315:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258300.704318:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258300.704340:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098238464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258316 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258300.704379:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258300.704383:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612880 00000400:00000200:0.0:1734258300.704388:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1391 [1] + 0 00000400:00000200:0.0:1734258300.704400:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258300.704403:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258300.704408:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098238592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258300.704612:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258300.704623:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258300.704624:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258300.704629:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098238592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258310 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258300.704635:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098238592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258310 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258300.704667:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258300.704671:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734258300.704677:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:2.0:1734258300.704744:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258300.704750:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258300.704751:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258300.704756:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098238464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258316 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258300.704761:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098238464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258316 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258300.704773:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734258300.704777:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734258300.704778:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258305.707800:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258305.707830:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258305.707990:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258305.708000:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258305.708056:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258305.708068:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1318. 00000400:00000010:1.0:1734258305.708076:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258305.708084:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098238720, portal 25 00000400:00000010:1.0:1734258305.708088:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258305.708090:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098238720, offset 0 00000400:00000200:1.0:1734258305.708111:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258305.708125:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258305.708131:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258305.708136:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258305.708139:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258305.708141:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258305.708144:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [597:597:256:4294967295] 192.168.202.108@tcp LPNI seq info [596:596:8:4294967295] 00000400:00000200:1.0:1734258305.708152:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258305.708173:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258305.708177:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734258305.708183:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258305.708190:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258305.708194:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258305.708535:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258305.708539:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:1.0:1734258305.708543:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258305.708547:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258305.708550:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258305.708552:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258305.708626:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098238720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258321 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258305.708642:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258305.708650:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258305.708655:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258305.708660:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098238848, portal 10 00000400:00000010:2.0:1734258305.708667:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734258305.708669:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098238848, offset 0 00000400:00000200:2.0:1734258305.708675:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258305.708685:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258305.708689:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258305.708693:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258305.708695:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258305.708697:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258305.708700:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [598:598:256:4294967295] 192.168.202.108@tcp LPNI seq info [597:597:8:4294967295] 00000400:00000200:2.0:1734258305.708707:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258305.708712:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258305.708715:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258305.708720:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258305.708726:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258305.708729:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258305.710109:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258305.710117:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258305.710123:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258305.710669:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258305.710688:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612900 00000400:00000200:0.0:1734258305.710698:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1399 [1] + 224 00000400:00000200:0.0:1734258305.710719:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258305.710724:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258305.710734:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098238720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258321 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:0.0:1734258305.710792:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1318. 00000400:00000200:0.0:1734258305.710797:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:0.0:1734258305.710799:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:0.0:1734258305.710804:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098238720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258321 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734258305.710810:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098238720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258321 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:0.0:1734258305.710835:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:0.0:1734258305.710839:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258305.710852:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:1.0:1734258305.711866:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258305.711873:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:1.0:1734258305.711876:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:1.0:1734258305.711890:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098238848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258315 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258305.713692:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258305.713712:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612980 00000400:00000200:0.0:1734258305.713720:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x13a1 [1] + 0 00000400:00000200:0.0:1734258305.713740:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258305.713744:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258305.713755:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098238848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258315 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258305.714200:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258305.714205:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258305.714207:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258305.714212:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098238848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258315 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258305.714219:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098238848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258315 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734258305.714236:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:2.0:1734258305.720323:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258305.720336:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258305.720341:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258310.715684:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258310.715703:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258310.716355:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258310.716364:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258310.716430:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258310.716436:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258310.716442:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258310.716448:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098238976, portal 25 00000400:00000010:3.0:1734258310.716452:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734258310.716453:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098238976, offset 0 00000400:00000200:3.0:1734258310.716461:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258310.716473:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258310.716478:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258310.716482:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258310.716485:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258310.716487:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258310.716489:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [599:599:256:4294967295] 192.168.202.108@tcp LPNI seq info [598:598:8:4294967295] 00000400:00000200:3.0:1734258310.716496:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258310.716500:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258310.716503:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734258310.716509:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258310.716515:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258310.716519:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258310.717212:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258310.717215:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734258310.717218:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258310.717223:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258310.717226:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:1.0:1734258310.717228:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:1.0:1734258310.717234:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098238976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258326 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258310.717429:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258310.717433:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258310.717436:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258310.717439:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098239104, portal 10 00000400:00000010:2.0:1734258310.717443:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258310.717445:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098239104, offset 0 00000400:00000200:2.0:1734258310.717449:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258310.717454:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258310.717457:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258310.717459:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258310.717461:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258310.717463:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258310.717465:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [600:600:256:4294967295] 192.168.202.108@tcp LPNI seq info [599:599:8:4294967295] 00000400:00000200:2.0:1734258310.717470:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258310.717474:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258310.717476:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258310.717479:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258310.717483:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258310.717484:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258310.717824:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258310.717826:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734258310.717833:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258310.717836:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258310.717838:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:1.0:1734258310.717839:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:1.0:1734258310.717843:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098239104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258320 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258310.719163:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258310.719177:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612a00 00000400:00000200:0.0:1734258310.719184:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x13a9 [1] + 224 00000400:00000200:0.0:1734258310.719202:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258310.719205:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258310.719211:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098238976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258326 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258310.719535:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258310.719539:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258310.719547:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258310.719552:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098238976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258326 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258310.719559:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098238976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258326 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258310.719679:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258310.719685:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734258310.719689:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734258310.720349:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258310.720358:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612a80 00000400:00000200:0.0:1734258310.720364:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x13b1 [1] + 0 00000400:00000200:0.0:1734258310.720377:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258310.720380:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258310.720385:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098239104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258320 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258310.720468:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258310.720472:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258310.720473:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258310.720477:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098239104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258320 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258310.720483:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098239104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258320 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258310.720500:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258310.720504:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258310.720507:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258315.723689:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258315.723710:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 02000000:00000010:1.0:1734258315.724979:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734258315.724993:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258315.725003:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258315.725013:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098239232, portal 25 00000400:00000010:1.0:1734258315.725051:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258315.725055:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098239232, offset 0 00000400:00000200:1.0:1734258315.725068:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258315.725085:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258315.725093:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258315.725098:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258315.725102:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258315.725105:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258315.725108:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [601:601:256:4294967295] 192.168.202.108@tcp LPNI seq info [600:600:8:4294967295] 00000400:00000200:1.0:1734258315.725117:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258315.725122:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258315.725126:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734258315.725132:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258315.725140:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258315.725144:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258315.725259:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258315.725262:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:1.0:1734258315.725264:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258315.725269:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258315.725272:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258315.725274:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258315.725297:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098239232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258331 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258315.725414:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258315.725426:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258315.725553:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258315.725558:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258315.725561:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258315.725563:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098239360, portal 10 00000400:00000010:2.0:1734258315.725580:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734258315.725582:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098239360, offset 0 00000400:00000200:2.0:1734258315.725586:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258315.725590:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258315.725592:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258315.725594:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258315.725596:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258315.725597:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258315.725599:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [602:602:256:4294967295] 192.168.202.108@tcp LPNI seq info [601:601:8:4294967295] 00000400:00000200:2.0:1734258315.725604:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258315.725607:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258315.725609:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258315.725611:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258315.725615:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258315.725616:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258315.725697:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258315.725699:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258315.725702:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258315.725705:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258315.725707:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734258315.725708:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734258315.725711:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098239360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258325 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258315.729158:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258315.729176:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612b00 00000400:00000200:0.0:1734258315.729185:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x13b9 [1] + 224 00000400:00000200:0.0:1734258315.729197:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258315.729201:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258315.729213:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098239232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258331 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258315.729692:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258315.729698:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612b80 00000400:00000200:0.0:1734258315.729703:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x13c1 [1] + 0 00000400:00000200:0.0:1734258315.729719:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258315.729722:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258315.729727:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098239360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258325 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258315.729874:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734258315.729885:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:2.0:1734258315.729886:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258315.729891:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098239360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258325 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258315.729897:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098239360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258325 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258315.729923:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258315.729928:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258315.729932:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:1.0:1734258315.730361:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258315.730366:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258315.730368:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258315.730373:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098239232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258331 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258315.730381:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098239232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258331 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258315.730394:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734258315.730397:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734258315.730400:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258320.731817:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258320.731834:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258320.731892:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258320.731899:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734258320.731931:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734258320.731938:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258320.731944:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258320.731950:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098239488, portal 25 00000400:00000010:1.0:1734258320.731953:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258320.731955:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098239488, offset 0 00000400:00000200:1.0:1734258320.731962:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258320.731974:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258320.731978:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258320.732013:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258320.732015:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258320.732018:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258320.732020:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [603:603:256:4294967295] 192.168.202.108@tcp LPNI seq info [602:602:8:4294967295] 00000400:00000200:1.0:1734258320.732027:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258320.732032:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258320.732036:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734258320.732040:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258320.732047:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258320.732059:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258320.732179:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258320.732185:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734258320.732187:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258320.732190:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258320.732193:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:0.0:1734258320.732194:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:0.0:1734258320.732199:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098239488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258336 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258320.732803:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258320.732809:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258320.732812:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258320.732815:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098239616, portal 10 00000400:00000010:3.0:1734258320.732819:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734258320.732820:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098239616, offset 0 00000400:00000200:3.0:1734258320.732824:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258320.732829:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258320.732832:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258320.732834:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258320.732835:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258320.732837:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258320.732839:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [604:604:256:4294967295] 192.168.202.108@tcp LPNI seq info [603:603:8:4294967295] 00000400:00000200:3.0:1734258320.732845:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258320.732849:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258320.732851:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734258320.732854:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258320.732858:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258320.732860:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258320.732915:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258320.732917:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734258320.732920:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258320.732923:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258320.732926:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:0.0:1734258320.732927:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:0.0:1734258320.732931:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098239616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258330 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258320.738657:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258320.738675:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612c80 00000400:00000200:0.0:1734258320.738683:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x13d1 [1] + 0 00000400:00000200:0.0:1734258320.738693:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258320.738696:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258320.738704:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098239616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258330 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258320.738741:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258320.738745:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612c00 00000400:00000200:0.0:1734258320.738750:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x13c9 [1] + 224 00000400:00000200:0.0:1734258320.738763:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258320.738766:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258320.738771:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098239488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258336 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258320.738837:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258320.738841:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258320.738843:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258320.738848:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098239488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258336 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258320.738859:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098239488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258336 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258320.738878:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734258320.738882:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734258320.738885:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:3.0:1734258320.739070:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258320.739074:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258320.739075:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258320.739079:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098239616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258330 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258320.739092:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098239616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258330 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258320.739117:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258320.739121:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258320.739123:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258325.739718:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258325.739755:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258325.739819:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258325.739826:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734258325.739881:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734258325.739888:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50948. 00000400:00000010:0.0:1734258325.739895:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734258325.739903:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098239872, portal 10 00000400:00000010:0.0:1734258325.739910:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000100:00000200:0.0:1734258325.739912:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098239872, offset 0 00000400:00000200:0.0:1734258325.739921:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258325.739938:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258325.739971:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258325.739975:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258325.739977:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258325.739980:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258325.739982:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [605:605:256:4294967295] 192.168.202.108@tcp LPNI seq info [604:604:8:4294967295] 00000400:00000200:0.0:1734258325.739994:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258325.739999:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258325.740002:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000800:00000200:0.0:1734258325.740008:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258325.740016:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258325.740019:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734258325.740038:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734258325.740043:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734258325.740046:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258325.740049:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098239744, portal 25 00000400:00000010:2.0:1734258325.740052:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734258325.740054:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098239744, offset 0 00000400:00000200:2.0:1734258325.740059:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258325.740063:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258325.740066:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258325.740068:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258325.740069:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258325.740071:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258325.740073:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [606:606:255:4294967295] 192.168.202.108@tcp LPNI seq info [605:605:7:4294967295] 00000400:00000200:2.0:1734258325.740079:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258325.740082:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258325.740084:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258325.740087:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258325.740090:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258325.740092:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258325.740246:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258325.740250:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734258325.740255:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258325.740259:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258325.740263:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:1.0:1734258325.740264:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:1.0:1734258325.740273:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098239872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258335 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258325.740335:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258325.740337:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734258325.740340:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258325.740343:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258325.740345:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:1.0:1734258325.740346:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:1.0:1734258325.740350:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098239744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258341 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258325.745341:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258325.745358:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612d80 00000400:00000200:0.0:1734258325.745366:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x13d9 [1] + 0 00000400:00000200:0.0:1734258325.745376:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258325.745378:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258325.745387:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098239872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258335 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258325.745685:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258325.745691:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612d00 00000400:00000200:0.0:1734258325.745695:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x13e1 [1] + 224 00000400:00000200:0.0:1734258325.745707:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258325.745710:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258325.745714:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098239744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258341 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258325.745804:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:3.0:1734258325.745808:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:3.0:1734258325.745810:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:3.0:1734258325.745815:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098239744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258341 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258325.745820:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098239744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258341 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258325.745839:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:3.0:1734258325.745842:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734258325.745845:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:2.0:1734258325.746248:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50948. 00000400:00000200:2.0:1734258325.746253:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:2.0:1734258325.746259:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:2.0:1734258325.746264:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098239872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258335 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258325.746269:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098239872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258335 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258325.746285:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258325.746287:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258325.746290:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258330.747688:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258330.747706:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258330.747753:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258330.747759:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734258330.747801:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734258330.747806:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509a0. 00000400:00000010:0.0:1734258330.747810:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734258330.747816:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098240128, portal 10 00000400:00000010:0.0:1734258330.747820:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000100:00000200:0.0:1734258330.747822:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098240128, offset 0 00000400:00000200:0.0:1734258330.747829:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258330.747839:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258330.747843:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258330.747846:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258330.747849:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258330.747850:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258330.747853:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [607:607:256:4294967295] 192.168.202.108@tcp LPNI seq info [606:606:8:4294967295] 00000400:00000200:0.0:1734258330.747859:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258330.747863:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258330.747865:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734258330.747870:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258330.747886:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258330.747889:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734258330.747991:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734258330.747995:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258330.747998:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258330.748000:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098240000, portal 25 00000400:00000010:2.0:1734258330.748002:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258330.748003:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098240000, offset 0 00000400:00000200:2.0:1734258330.748006:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258330.748010:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258330.748012:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258330.748014:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258330.748016:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258330.748017:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258330.748019:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [608:608:255:4294967295] 192.168.202.108@tcp LPNI seq info [607:607:7:4294967295] 00000400:00000200:2.0:1734258330.748024:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258330.748026:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258330.748028:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258330.748031:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258330.748033:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258330.748035:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258330.748271:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258330.748274:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734258330.748277:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258330.748281:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258330.748284:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:1.0:1734258330.748289:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:1.0:1734258330.748295:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098240128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258340 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258330.748349:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258330.748351:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734258330.748353:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258330.748355:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258330.748357:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:1.0:1734258330.748358:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:1.0:1734258330.748361:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098240000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258346 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258330.751808:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258330.751829:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612e00 00000400:00000200:0.0:1734258330.751838:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x13f1 [1] + 224 00000400:00000200:0.0:1734258330.751861:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258330.751865:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258330.751878:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098240000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258346 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258330.751989:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258330.751994:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258330.751996:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258330.752002:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098240000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258346 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258330.752017:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098240000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258346 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258330.752039:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258330.752043:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734258330.752047:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734258330.752228:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258330.752235:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612e80 00000400:00000200:0.0:1734258330.752240:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x13e9 [1] + 0 00000400:00000200:0.0:1734258330.752250:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258330.752253:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258330.752257:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098240128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258340 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258330.752387:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509a0. 00000400:00000200:2.0:1734258330.752390:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:2.0:1734258330.752392:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:2.0:1734258330.752396:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098240128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258340 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258330.752401:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098240128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258340 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258330.752417:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258330.752421:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258330.752423:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258335.755766:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258335.755790:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 02000000:00000010:1.0:1734258335.756063:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734258335.756075:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258335.756084:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258335.756092:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098240256, portal 25 00000400:00000010:1.0:1734258335.756096:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734258335.756098:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098240256, offset 0 00000400:00000200:1.0:1734258335.756106:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258335.756117:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258335.756122:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258335.756126:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258335.756128:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258335.756130:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258335.756133:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [609:609:256:4294967295] 192.168.202.108@tcp LPNI seq info [608:608:8:4294967295] 00000400:00000200:1.0:1734258335.756140:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258335.756144:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258335.756148:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734258335.756152:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258335.756159:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258335.756163:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258335.756280:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258335.756291:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:1.0:1734258335.756294:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258335.756298:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258335.756301:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734258335.756303:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734258335.756308:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098240256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258335.759687:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258335.759711:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 00000400:00000200:1.0:1734258335.760187:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734258335.760206:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c612f00 00000400:00000200:1.0:1734258335.760215:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x13f9 [1] + 224 00000400:00000200:1.0:1734258335.760243:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258335.760247:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:1.0:1734258335.760256:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098240256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258351 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258335.760295:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258335.760299:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258335.760301:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258335.760306:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098240256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258335.760313:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098240256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258351 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258335.760341:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258335.760358:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734258335.760361:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 02000000:00000010:2.0:1734258335.760604:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258335.760610:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258335.760616:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258335.760621:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098240384, portal 10 00000400:00000010:2.0:1734258335.760628:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258335.760630:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098240384, offset 0 00000400:00000200:2.0:1734258335.760635:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258335.760645:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258335.760711:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258335.760715:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258335.760718:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258335.760720:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258335.760723:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [610:610:256:4294967295] 192.168.202.108@tcp LPNI seq info [609:609:8:4294967295] 00000400:00000200:2.0:1734258335.760731:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258335.760752:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258335.760755:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258335.760760:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258335.760767:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258335.760770:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258335.762287:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258335.762294:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258335.762302:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258335.762309:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258335.762313:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734258335.762315:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734258335.762324:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098240384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258345 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258335.763425:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258335.763452:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c612f80 00000400:00000200:0.0:1734258335.763459:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1401 [1] + 0 00000400:00000200:0.0:1734258335.763480:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258335.763483:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258335.763491:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098240384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258345 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258335.763608:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258335.763614:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258335.763615:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258335.763621:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098240384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258345 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258335.763628:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098240384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258345 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258335.763664:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258335.763671:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258335.763677:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258340.763689:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258340.763710:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258340.763770:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258340.763775:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258340.764143:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734258340.764151:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258340.764157:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258340.764163:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098240512, portal 25 00000400:00000010:2.0:1734258340.764168:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734258340.764169:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098240512, offset 0 00000400:00000200:2.0:1734258340.764178:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258340.764189:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258340.764195:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258340.764199:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258340.764202:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258340.764204:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258340.764206:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [611:611:256:4294967295] 192.168.202.108@tcp LPNI seq info [610:610:8:4294967295] 00000400:00000200:2.0:1734258340.764213:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258340.764218:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258340.764232:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258340.764237:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258340.764243:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258340.764246:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258340.765741:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258340.765749:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258340.765755:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258340.765760:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098240640, portal 10 00000400:00000010:3.0:1734258340.765765:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734258340.765767:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098240640, offset 0 00000400:00000200:3.0:1734258340.765773:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258340.765781:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258340.765785:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258340.765787:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258340.765790:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258340.765792:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258340.765794:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [612:612:255:4294967295] 192.168.202.108@tcp LPNI seq info [611:611:7:4294967295] 00000400:00000200:3.0:1734258340.765802:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258340.765817:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258340.765820:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734258340.765853:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258340.765860:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258340.765863:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258340.766333:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258340.766336:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258340.766341:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258340.766345:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258340.766349:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734258340.766351:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734258340.766360:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098240512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258356 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258340.766422:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258340.766424:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734258340.766426:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258340.766429:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258340.766431:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:0.0:1734258340.766432:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734258340.766435:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098240640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258350 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258340.769889:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258340.769905:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613000 00000400:00000200:0.0:1734258340.769913:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1409 [1] + 224 00000400:00000200:0.0:1734258340.769924:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258340.769939:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258340.769950:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098240512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258356 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258340.769986:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258340.769991:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613080 00000400:00000200:0.0:1734258340.769996:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1411 [1] + 0 00000400:00000200:0.0:1734258340.770007:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258340.770010:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258340.770015:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098240640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258350 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258340.770240:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258340.770245:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258340.770247:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258340.770252:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098240512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258356 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258340.770260:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098240512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258356 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258340.770284:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258340.770287:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734258340.770290:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:3.0:1734258340.775545:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258340.775555:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258340.775556:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258340.775566:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098240640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258350 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258340.775587:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098240640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258350 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258340.775613:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258340.775618:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734258340.775622:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258345.771677:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258345.771696:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258345.771748:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258345.771755:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258345.771794:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258345.771801:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 02000000:00000010:0.0:1734258345.771802:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734258345.771805:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509f8. 00000400:00000010:3.0:1734258345.771805:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000400:00000010:0.0:1734258345.771808:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000100:00000200:0.0:1734258345.771811:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098240896, portal 10 00000100:00000200:3.0:1734258345.771811:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098240768, portal 25 00000400:00000010:0.0:1734258345.771814:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000400:00000010:3.0:1734258345.771814:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734258345.771816:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098240896, offset 0 00000100:00000200:3.0:1734258345.771816:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098240768, offset 0 00000400:00000200:0.0:1734258345.771822:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258345.771840:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258345.771844:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258345.771847:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258345.771850:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258345.771852:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258345.771854:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [613:613:256:4294967295] 192.168.202.108@tcp LPNI seq info [612:612:8:4294967295] 00000400:00000200:0.0:1734258345.771861:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258345.771866:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258345.771878:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734258345.771884:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258345.771890:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258345.771893:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258345.772000:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258345.772003:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:1.0:1734258345.772005:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258345.772009:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258345.772127:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258345.772131:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258345.772133:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258345.772135:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258345.772137:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258345.772138:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258345.772140:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [614:614:255:4294967295] 192.168.202.108@tcp LPNI seq info [613:613:7:4294967295] 00000400:00000200:3.0:1734258345.772145:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258345.772148:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258345.772160:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734258345.772163:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258345.772166:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258345.772168:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734258345.772235:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:1.0:1734258345.772237:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:1.0:1734258345.772243:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098240896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258355 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258345.772284:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258345.772285:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:1.0:1734258345.772287:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258345.772290:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258345.772292:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:1.0:1734258345.772293:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:1.0:1734258345.772296:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098240768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258361 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258345.775371:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258345.775388:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613180 00000400:00000200:0.0:1734258345.775395:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x141d [1] + 0 00000400:00000200:0.0:1734258345.775405:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258345.775408:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258345.775417:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098240896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258355 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258345.775457:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258345.775462:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613100 00000400:00000200:0.0:1734258345.775466:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1419 [1] + 224 00000400:00000200:0.0:1734258345.775478:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258345.775481:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258345.775485:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098240768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258361 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258345.775597:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509f8. 00000400:00000200:2.0:1734258345.775601:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:2.0:1734258345.775603:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:2.0:1734258345.775608:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098240896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258355 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258345.775614:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098240896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258355 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258345.775637:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258345.775640:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258345.775643:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:3.0:1734258345.775925:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258345.775928:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258345.775930:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258345.775934:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098240768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258361 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258345.775940:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098240768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258361 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258345.775950:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258345.775953:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734258345.775955:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258350.779724:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258350.779743:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258350.780065:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258350.780072:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258350.780118:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258350.780126:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258350.780132:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258350.780142:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098241024, portal 25 00000400:00000010:3.0:1734258350.780147:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734258350.780148:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098241024, offset 0 00000400:00000200:3.0:1734258350.780160:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258350.780172:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258350.780178:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258350.780181:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258350.780184:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258350.780189:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258350.780192:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [615:615:256:4294967295] 192.168.202.108@tcp LPNI seq info [614:614:8:4294967295] 00000400:00000200:3.0:1734258350.780199:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258350.780204:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258350.780207:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734258350.780223:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258350.780231:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258350.780234:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258350.780240:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258350.780244:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258350.780248:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258350.780250:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098241152, portal 10 00000400:00000010:2.0:1734258350.780254:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258350.780255:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098241152, offset 0 00000400:00000200:2.0:1734258350.780259:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258350.780268:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258350.780271:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258350.780273:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258350.780274:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258350.780276:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258350.780278:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [616:616:255:4294967295] 192.168.202.108@tcp LPNI seq info [615:615:7:4294967295] 00000400:00000200:2.0:1734258350.780288:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258350.780291:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258350.780294:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258350.780296:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258350.780299:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258350.780301:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258350.780326:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258350.780328:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734258350.780332:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258350.780335:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258350.780338:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734258350.780340:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734258350.780346:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098241024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258366 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258350.780412:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258350.780415:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258350.780417:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258350.780420:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258350.780421:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734258350.780422:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734258350.780425:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098241152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258360 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258350.784443:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258350.784462:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613200 00000400:00000200:0.0:1734258350.784468:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1429 [1] + 224 00000400:00000200:0.0:1734258350.784488:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258350.784492:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258350.784502:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098241024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258366 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258350.784680:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258350.784685:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258350.784687:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258350.784691:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098241024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258366 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258350.784699:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098241024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258366 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258350.784719:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258350.784723:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734258350.784726:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734258350.786790:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258350.786811:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613280 00000400:00000200:0.0:1734258350.786820:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1431 [1] + 0 00000400:00000200:0.0:1734258350.786845:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258350.786849:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258350.786861:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098241152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258360 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258350.786980:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258350.786985:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258350.786988:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258350.786993:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098241152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258360 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258350.786999:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098241152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258360 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258350.787032:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258350.787038:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258350.787043:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258355.788334:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258355.788355:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258355.788409:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258355.788414:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258355.788510:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 02000000:00000010:3.0:1734258355.788511:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:1.0:1734258355.788519:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:3.0:1734258355.788523:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:1.0:1734258355.788526:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000400:00000010:3.0:1734258355.788529:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:1.0:1734258355.788533:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098241280, portal 25 00000100:00000200:3.0:1734258355.788535:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098241408, portal 10 00000400:00000010:1.0:1734258355.788538:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734258355.788540:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098241280, offset 0 00000400:00000010:3.0:1734258355.788541:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734258355.788543:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098241408, offset 0 00000400:00000200:1.0:1734258355.788550:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258355.788562:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258355.788620:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258355.788625:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258355.788629:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258355.788631:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258355.788634:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258355.788636:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [617:617:256:4294967295] 192.168.202.108@tcp LPNI seq info [616:616:8:4294967295] 00000400:00000200:3.0:1734258355.788644:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258355.788649:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258355.788653:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734258355.788658:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258355.788674:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258355.788677:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734258355.788760:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258355.788764:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258355.788767:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258355.788769:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258355.788771:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258355.788774:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [618:618:255:4294967295] 192.168.202.108@tcp LPNI seq info [617:617:7:4294967295] 00000400:00000200:1.0:1734258355.788781:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258355.788785:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258355.788789:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734258355.788793:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258355.788799:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258355.788802:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258355.788869:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258355.788873:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734258355.788882:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258355.789081:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258355.789085:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:0.0:1734258355.789087:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734258355.789095:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098241408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258365 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258355.789152:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258355.789154:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734258355.789157:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258355.789159:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258355.789161:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:0.0:1734258355.789162:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:0.0:1734258355.789166:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098241280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258371 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258355.794543:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258355.794563:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613380 00000400:00000200:0.0:1734258355.794597:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x143d [1] + 0 00000400:00000200:0.0:1734258355.794609:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258355.794613:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258355.794623:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098241408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258365 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258355.794661:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258355.794666:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613300 00000400:00000200:0.0:1734258355.794671:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1439 [1] + 224 00000400:00000200:0.0:1734258355.794686:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258355.794689:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258355.794693:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098241280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258371 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258355.794793:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258355.794798:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258355.794800:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258355.794812:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098241280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258371 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258355.794817:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098241280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258371 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258355.794841:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734258355.794846:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734258355.794850:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:3.0:1734258355.794919:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258355.794923:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258355.794924:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258355.794929:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098241408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258365 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258355.794934:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098241408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258365 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258355.794949:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258355.794952:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258355.794955:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258360.795738:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258360.795778:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 02000000:00000010:2.0:1734258360.795826:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000100:00000010:0.0:1734258360.795834:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 00000400:00000010:2.0:1734258360.795834:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258360.795841:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 02000000:00000010:0.0:1734258360.795843:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 00000100:00000200:2.0:1734258360.795848:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098241536, portal 25 00000400:00000010:2.0:1734258360.795852:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258360.795854:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098241536, offset 0 00000400:00000200:2.0:1734258360.795862:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258360.795874:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:0.0:1734258360.795876:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734258360.795880:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d505d8. 00000400:00000010:0.0:1734258360.795883:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000400:00000200:2.0:1734258360.795885:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:0.0:1734258360.795886:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098241664, portal 10 00000400:00000010:0.0:1734258360.795889:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000400:00000200:2.0:1734258360.795889:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:0.0:1734258360.795891:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098241664, offset 0 00000400:00000200:2.0:1734258360.795892:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258360.795894:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258360.795895:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258360.795897:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [619:619:256:4294967295] 192.168.202.108@tcp LPNI seq info [618:618:8:4294967295] 00000400:00000200:2.0:1734258360.795905:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258360.795911:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258360.795914:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258360.795919:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258360.795926:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258360.795930:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258360.796030:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258360.796033:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734258360.796037:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258360.796041:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258360.796045:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:1.0:1734258360.796046:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:1.0:1734258360.796054:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098241536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258376 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258360.796290:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258360.796293:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258360.796295:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258360.796297:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258360.796298:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258360.796300:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [620:620:255:4294967295] 192.168.202.108@tcp LPNI seq info [619:619:7:4294967295] 00000400:00000200:0.0:1734258360.796306:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258360.796309:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258360.796311:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734258360.796313:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258360.796318:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258360.796319:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258360.796375:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258360.796377:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734258360.796379:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258360.796383:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258360.796384:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:1.0:1734258360.796386:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:1.0:1734258360.796389:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098241664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258370 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258360.799211:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258360.799231:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613400 00000400:00000200:0.0:1734258360.799239:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1449 [1] + 224 00000400:00000200:0.0:1734258360.799260:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258360.799264:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258360.799275:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098241536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258376 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258360.799357:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258360.799362:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258360.799364:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258360.799369:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098241536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258376 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258360.799376:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098241536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258376 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258360.799399:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258360.799404:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734258360.799407:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734258360.799679:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258360.799693:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613480 00000400:00000200:0.0:1734258360.799699:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1451 [1] + 0 00000400:00000200:0.0:1734258360.799710:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258360.799713:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258360.799718:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098241664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258370 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258360.799863:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d505d8. 00000400:00000200:2.0:1734258360.799867:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:2.0:1734258360.799868:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:2.0:1734258360.799937:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098241664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258370 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258360.799943:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098241664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258370 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258360.799960:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734258360.799962:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258360.799970:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258365.803722:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258365.803742:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258365.803795:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258365.803803:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258365.803877:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258365.803889:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258365.803896:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258365.803903:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098241792, portal 25 00000400:00000010:3.0:1734258365.803907:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734258365.803909:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098241792, offset 0 00000400:00000200:3.0:1734258365.803920:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258365.803933:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258365.803938:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258365.803942:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258365.803945:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258365.803947:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258365.803949:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [621:621:256:4294967295] 192.168.202.108@tcp LPNI seq info [620:620:8:4294967295] 00000400:00000200:3.0:1734258365.803960:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258365.803965:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258365.803968:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734258365.803974:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258365.803981:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 02000000:00000010:0.0:1734258365.803996:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000800:00000200:3.0:1734258365.803996:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:0.0:1734258365.804002:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50580. 00000400:00000010:0.0:1734258365.804009:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734258365.804014:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098241920, portal 10 00000400:00000010:0.0:1734258365.804021:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000100:00000200:0.0:1734258365.804023:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098241920, offset 0 00000400:00000200:0.0:1734258365.804032:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258365.804043:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258365.804048:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258365.804051:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258365.804053:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258365.804055:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258365.804058:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [622:622:255:4294967295] 192.168.202.108@tcp LPNI seq info [621:621:7:4294967295] 00000400:00000200:0.0:1734258365.804066:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258365.804071:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258365.804074:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734258365.804079:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258365.804086:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258365.804089:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258365.806769:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258365.806778:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734258365.806786:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258365.806795:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258365.806802:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:1.0:1734258365.806804:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:1.0:1734258365.806816:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098241792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258365.806902:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258365.806916:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734258365.806919:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258365.806922:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258365.806925:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:1.0:1734258365.806926:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:1.0:1734258365.806931:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098241920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258375 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258365.810603:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258365.810625:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613500 00000400:00000200:0.0:1734258365.810646:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1459 [1] + 224 00000400:00000200:0.0:1734258365.810668:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258365.810671:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258365.810681:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098241792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258365.812684:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258365.812694:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613580 00000400:00000200:0.0:1734258365.812702:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1461 [1] + 0 00000400:00000200:0.0:1734258365.812718:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258365.812721:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258365.812729:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098241920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258375 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258365.813277:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258365.813284:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258365.813286:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258365.813292:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098241792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258365.813299:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098241792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258381 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258365.813325:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258365.813331:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734258365.813335:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:1.0:1734258365.815231:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50580. 00000400:00000200:1.0:1734258365.815243:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:1.0:1734258365.815245:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:1.0:1734258365.815258:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098241920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258375 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258365.815266:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098241920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258375 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258365.815293:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:1.0:1734258365.815298:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734258365.815303:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258370.811735:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258370.811757:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 02000000:00000010:3.0:1734258370.812130:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258370.812137:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258370.812143:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258370.812149:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098242048, portal 25 00000400:00000010:3.0:1734258370.812153:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734258370.812154:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098242048, offset 0 00000400:00000200:3.0:1734258370.812162:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258370.812173:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258370.812177:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258370.812181:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258370.812183:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258370.812185:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258370.812187:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [623:623:256:4294967295] 192.168.202.108@tcp LPNI seq info [622:622:8:4294967295] 00000400:00000200:3.0:1734258370.812319:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258370.812325:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258370.812329:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734258370.812333:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258370.812340:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258370.812343:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258370.812666:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258370.812670:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:1.0:1734258370.812673:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258370.812677:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258370.812681:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:1.0:1734258370.812682:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:1.0:1734258370.812688:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098242048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258370.812757:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258370.812767:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258370.812974:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734258370.812980:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258370.812985:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258370.812988:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098242176, portal 10 00000400:00000010:1.0:1734258370.812993:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734258370.812996:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098242176, offset 0 00000400:00000200:1.0:1734258370.813001:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258370.813021:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258370.813025:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258370.813027:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258370.813030:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258370.813032:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258370.813034:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [624:624:256:4294967295] 192.168.202.108@tcp LPNI seq info [623:623:8:4294967295] 00000400:00000200:1.0:1734258370.813041:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258370.813045:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258370.813048:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734258370.813052:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258370.813057:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258370.813060:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258370.813463:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258370.813468:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:2.0:1734258370.813471:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258370.813475:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258370.813478:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:2.0:1734258370.813479:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:2.0:1734258370.813484:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098242176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258380 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258370.814460:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258370.814474:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613600 00000400:00000200:0.0:1734258370.814481:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1469 [1] + 224 00000400:00000200:0.0:1734258370.814503:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258370.814508:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258370.814515:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098242048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258370.814909:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258370.814916:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258370.814917:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258370.814924:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098242048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258370.814930:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098242048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258386 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258370.814951:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258370.814957:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734258370.814961:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734258370.816277:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258370.816290:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613680 00000400:00000200:0.0:1734258370.816306:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1471 [1] + 0 00000400:00000200:0.0:1734258370.816321:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258370.816324:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258370.816332:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098242176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258380 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258370.816455:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258370.816460:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258370.816461:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258370.816466:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098242176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258380 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258370.816472:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098242176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258380 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258370.816491:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734258370.816496:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734258370.816498:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258375.819785:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258375.819809:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 02000000:00000010:1.0:1734258375.820475:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734258375.820484:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258375.820491:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258375.820497:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098242304, portal 25 00000400:00000010:1.0:1734258375.820504:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734258375.820506:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098242304, offset 0 00000400:00000200:1.0:1734258375.820514:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258375.820530:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258375.820615:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258375.820619:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258375.820622:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258375.820624:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258375.820627:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [625:625:256:4294967295] 192.168.202.108@tcp LPNI seq info [624:624:8:4294967295] 00000400:00000200:1.0:1734258375.820636:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258375.820641:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258375.820645:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734258375.820649:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258375.820658:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258375.820661:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734258375.820733:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258375.820741:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734258375.820780:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734258375.820784:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50528. 00000400:00000010:0.0:1734258375.820787:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734258375.820789:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098242432, portal 10 00000400:00000010:0.0:1734258375.820793:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734258375.820794:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098242432, offset 0 00000400:00000200:0.0:1734258375.820798:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258375.820802:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258375.820804:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258375.820806:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258375.820808:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258375.820809:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258375.820811:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [626:626:255:4294967295] 192.168.202.108@tcp LPNI seq info [625:625:7:4294967295] 00000400:00000200:0.0:1734258375.820816:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258375.820818:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258375.820820:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734258375.820822:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258375.820826:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258375.820827:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258375.820962:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258375.820965:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:2.0:1734258375.820970:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258375.820975:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258375.820978:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:2.0:1734258375.820980:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:2.0:1734258375.820988:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098242304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258391 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258375.821061:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258375.821063:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:2.0:1734258375.821065:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258375.821068:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258375.821070:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:2.0:1734258375.821071:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:2.0:1734258375.821074:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098242432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258385 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258375.825070:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258375.825101:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613780 00000400:00000200:0.0:1734258375.825110:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1481 [1] + 0 00000400:00000200:0.0:1734258375.825123:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258375.825127:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258375.825137:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098242432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258385 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258375.825177:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258375.825182:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613700 00000400:00000200:0.0:1734258375.825186:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1479 [1] + 224 00000400:00000200:0.0:1734258375.825200:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258375.825203:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258375.825208:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098242304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258391 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258375.825383:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50528. 00000400:00000200:2.0:1734258375.825389:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:2.0:1734258375.825390:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:2.0:1734258375.825395:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098242432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258385 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258375.825401:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098242432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258385 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258375.825436:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258375.825440:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258375.825444:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:1.0:1734258375.827835:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258375.827846:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258375.827847:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258375.827857:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098242304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258391 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258375.827863:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098242304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258391 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258375.827882:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734258375.827886:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734258375.827889:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258380.829130:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258380.829163:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258380.829230:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258380.829237:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734258380.829372:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258380.829382:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258380.829390:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258380.829398:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098242688, portal 10 00000400:00000010:3.0:1734258380.829406:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734258380.829408:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098242688, offset 0 00000400:00000200:3.0:1734258380.829420:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258380.829438:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258380.829444:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258380.829448:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258380.829453:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258380.829455:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258380.829459:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [627:627:256:4294967295] 192.168.202.108@tcp LPNI seq info [626:626:8:4294967295] 00000400:00000200:3.0:1734258380.829467:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258380.829472:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258380.829476:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 02000000:00000010:1.0:1734258380.829482:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000800:00000200:3.0:1734258380.829482:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258380.829491:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258380.829495:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 616 niov 1 nkiov 1 00000400:00000010:1.0:1734258380.829497:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258380.829506:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258380.829524:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098242560, portal 25 00000400:00000010:1.0:1734258380.829531:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734258380.829533:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098242560, offset 0 00000400:00000200:1.0:1734258380.829542:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258380.829557:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258380.829562:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258380.829627:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258380.829630:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258380.829632:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258380.829635:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [628:628:255:4294967295] 192.168.202.108@tcp LPNI seq info [627:627:7:4294967295] 00000400:00000200:1.0:1734258380.829645:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258380.829650:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258380.829656:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734258380.829662:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258380.829670:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258380.829673:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258380.829818:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258380.829821:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734258380.829826:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258380.829831:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258380.829835:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734258380.829838:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734258380.829847:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098242688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258380.829939:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258380.829941:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734258380.829943:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258380.829946:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258380.829948:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:0.0:1734258380.829958:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:0.0:1734258380.829963:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098242560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258380.839052:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258380.839074:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613800 00000400:00000200:0.0:1734258380.839083:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1491 [1] + 224 00000400:00000200:0.0:1734258380.839098:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258380.839102:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258380.839115:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098242560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258396 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258380.839155:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258380.839159:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613880 00000400:00000200:0.0:1734258380.839165:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1489 [1] + 0 00000400:00000200:0.0:1734258380.839184:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258380.839187:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258380.839192:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098242688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258390 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258380.839235:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258380.840285:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258380.840288:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258380.840299:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098242560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258380.840308:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098242560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258396 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258380.840333:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734258380.840337:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734258380.840341:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:3.0:1734258380.840844:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258380.840865:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258380.840867:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258380.840875:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098242688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258380.840883:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098242688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258390 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258380.840913:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258380.840917:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258380.840922:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258385.835735:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258385.835762:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 02000000:00000010:2.0:1734258385.836239:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734258385.836248:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258385.836257:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258385.836267:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098242816, portal 25 00000400:00000010:2.0:1734258385.836273:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258385.836275:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098242816, offset 0 00000400:00000200:2.0:1734258385.836286:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258385.836302:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258385.836310:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258385.836313:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258385.836317:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258385.836319:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258385.836323:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [629:629:256:4294967295] 192.168.202.108@tcp LPNI seq info [628:628:8:4294967295] 00000400:00000200:2.0:1734258385.836333:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258385.836339:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258385.836344:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258385.836349:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258385.836358:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258385.836362:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734258385.836376:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258385.836385:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258385.836520:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258385.836526:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258385.836529:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258385.836532:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098242944, portal 10 00000400:00000010:3.0:1734258385.836537:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734258385.836538:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098242944, offset 0 00000400:00000200:3.0:1734258385.836543:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258385.836552:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258385.836554:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258385.836556:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258385.836558:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258385.836559:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258385.836561:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [630:630:255:4294967295] 192.168.202.108@tcp LPNI seq info [629:629:7:4294967295] 00000400:00000200:3.0:1734258385.836606:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258385.836610:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258385.836613:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734258385.836615:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258385.836616:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258385.836619:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000800:00000200:3.0:1734258385.836619:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258385.836621:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734258385.836622:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258385.836627:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258385.836630:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:1.0:1734258385.836632:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:1.0:1734258385.836640:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098242816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258401 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258385.836671:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258385.836672:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:1.0:1734258385.836675:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258385.836695:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258385.836697:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:1.0:1734258385.836698:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:1.0:1734258385.836701:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098242944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258395 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258385.840020:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258385.840042:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613980 00000400:00000200:0.0:1734258385.840053:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x14a1 [1] + 0 00000400:00000200:0.0:1734258385.840067:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258385.840071:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258385.840153:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098242944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258395 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258385.840278:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258385.840289:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258385.840302:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258385.840312:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098242944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258395 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258385.840322:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098242944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258395 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258385.840346:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258385.840351:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613900 00000400:00000200:0.0:1734258385.840357:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1499 [1] + 224 02000000:00000010:3.0:1734258385.840361:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258385.840367:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000400:00000200:0.0:1734258385.840372:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000010:3.0:1734258385.840374:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000200:0.0:1734258385.840376:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258385.840380:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098242816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258401 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258385.840516:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258385.840520:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258385.840522:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258385.840526:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098242816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258401 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258385.840532:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098242816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258401 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258385.840561:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734258385.840564:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734258385.840619:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258390.843797:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258390.843820:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258390.843994:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258390.844002:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258390.844056:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734258390.844063:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258390.844069:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258390.844075:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098243072, portal 25 00000400:00000010:2.0:1734258390.844079:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000100:00000200:2.0:1734258390.844080:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098243072, offset 0 00000400:00000200:2.0:1734258390.844088:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258390.844102:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258390.844107:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258390.844114:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258390.844118:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258390.844120:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258390.844123:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [631:631:256:4294967295] 192.168.202.108@tcp LPNI seq info [630:630:8:4294967295] 00000400:00000200:2.0:1734258390.844130:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258390.844135:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258390.844139:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258390.844144:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258390.844150:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258390.844153:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258390.844255:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258390.844259:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258390.844262:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258390.844265:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098243200, portal 10 00000400:00000010:3.0:1734258390.844268:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734258390.844269:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098243200, offset 0 00000400:00000200:3.0:1734258390.844273:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258390.844277:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258390.844280:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258390.844282:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258390.844283:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258390.844284:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258390.844287:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [632:632:255:4294967295] 192.168.202.108@tcp LPNI seq info [631:631:7:4294967295] 00000400:00000200:3.0:1734258390.844291:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258390.844294:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258390.844296:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734258390.844298:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258390.844301:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258390.844303:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258390.844332:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258390.844334:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258390.844337:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258390.844341:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258390.844344:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:1.0:1734258390.844346:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:1.0:1734258390.844351:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098243072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258406 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258390.844373:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258390.844375:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:1.0:1734258390.844377:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258390.844379:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258390.844381:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:1.0:1734258390.844382:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:1.0:1734258390.844385:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098243200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258400 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258390.847203:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258390.847222:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613a00 00000400:00000200:0.0:1734258390.847231:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x14a9 [1] + 224 00000400:00000200:0.0:1734258390.847243:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258390.847246:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258390.847257:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098243072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258406 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258390.847294:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258390.847297:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613a80 00000400:00000200:0.0:1734258390.847301:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x14b1 [1] + 0 00000400:00000200:0.0:1734258390.847316:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258390.847319:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258390.847324:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098243200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258400 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258390.847553:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258390.847559:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258390.847561:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258390.847565:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098243200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258400 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258390.847632:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098243200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258400 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258390.847660:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258390.847665:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258390.847671:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:2.0:1734258390.847765:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258390.847771:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258390.847772:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258390.847779:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098243072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258406 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258390.847785:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098243072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258406 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258390.847800:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734258390.847812:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734258390.847815:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258395.851851:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258395.851889:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258395.851955:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258395.851963:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258395.852220:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734258395.852233:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258395.852240:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258395.852246:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098243328, portal 25 00000400:00000010:2.0:1734258395.852251:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734258395.852252:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098243328, offset 0 00000400:00000200:2.0:1734258395.852260:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258395.852272:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258395.852276:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258395.852279:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258395.852282:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258395.852284:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258395.852287:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [633:633:256:4294967295] 192.168.202.108@tcp LPNI seq info [632:632:8:4294967295] 00000400:00000200:2.0:1734258395.852294:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258395.852298:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258395.852301:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258395.852305:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258395.852313:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258395.852316:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258395.852537:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258395.852540:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258395.852544:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258395.852547:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258395.852551:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734258395.852552:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734258395.852559:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098243328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258411 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258395.852623:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258395.852627:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258395.852631:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258395.852633:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098243456, portal 10 00000400:00000010:3.0:1734258395.852638:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258395.852639:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098243456, offset 0 00000400:00000200:3.0:1734258395.852643:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258395.852648:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258395.852651:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258395.852653:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258395.852655:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258395.852657:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258395.852659:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [634:634:256:4294967295] 192.168.202.108@tcp LPNI seq info [633:633:8:4294967295] 00000400:00000200:3.0:1734258395.852664:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258395.852667:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258395.852671:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734258395.852674:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258395.852678:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258395.852680:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258395.852871:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258395.852874:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:1.0:1734258395.852876:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258395.852879:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258395.852882:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:1.0:1734258395.852883:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:1.0:1734258395.852886:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098243456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258405 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258395.855620:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258395.855642:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613b80 00000400:00000200:0.0:1734258395.855967:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x14c1 [1] + 0 00000400:00000200:0.0:1734258395.855983:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258395.855986:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258395.855997:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098243456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258405 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258395.856035:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258395.856040:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613b00 00000400:00000200:0.0:1734258395.856050:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x14b9 [1] + 224 00000400:00000200:0.0:1734258395.856071:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258395.856073:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258395.856078:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098243328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258411 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258395.856094:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258395.856104:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258395.856106:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258395.856115:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098243456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258405 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258395.856139:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098243456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258405 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258395.856142:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258395.856147:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258395.856148:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258395.856153:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098243328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258411 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258395.856160:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098243328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258411 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258395.856165:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258395.856170:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258395.856173:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734258395.856176:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734258395.856179:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:3.0:1734258395.856179:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258400.859873:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258400.859906:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258400.859983:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258400.859990:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734258400.860141:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258400.860150:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258400.860158:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258400.860173:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098243584, portal 25 00000400:00000010:1.0:1734258400.860178:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258400.860180:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098243584, offset 0 00000400:00000200:1.0:1734258400.860190:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258400.860205:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258400.860211:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258400.860215:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258400.860218:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258400.860221:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258400.860223:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [635:635:256:4294967295] 192.168.202.108@tcp LPNI seq info [634:634:8:4294967295] 00000400:00000200:1.0:1734258400.860231:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258400.860238:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258400.860243:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734258400.860248:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258400.860257:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258400.860261:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258400.860301:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258400.860316:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258400.860714:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258400.860721:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098243712, portal 10 00000400:00000010:3.0:1734258400.860728:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734258400.860730:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098243712, offset 0 00000400:00000200:3.0:1734258400.860739:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258400.860750:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258400.860756:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258400.860759:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258400.860762:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258400.860764:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258400.860766:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [636:636:255:4294967295] 192.168.202.108@tcp LPNI seq info [635:635:7:4294967295] 00000400:00000200:3.0:1734258400.860774:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258400.860780:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258400.860784:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734258400.860789:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258400.860796:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258400.860799:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258400.861090:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258400.861093:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734258400.861099:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258400.861105:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258400.861109:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:0.0:1734258400.861111:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:0.0:1734258400.861119:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098243584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258416 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258400.861203:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258400.861205:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734258400.861208:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258400.861210:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258400.861212:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734258400.861213:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734258400.861218:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098243712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258410 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258400.864272:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258400.864295:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613c00 00000400:00000200:0.0:1734258400.864305:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x14c9 [1] + 224 00000400:00000200:0.0:1734258400.864319:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258400.864323:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258400.864335:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098243584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258416 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258400.864381:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258400.864386:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613c80 00000400:00000200:0.0:1734258400.864392:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x14d1 [1] + 0 00000400:00000200:0.0:1734258400.864411:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258400.864414:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258400.864420:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098243712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258410 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258400.865255:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258400.865266:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258400.865268:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258400.865280:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098243712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258410 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258400.865312:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098243712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258410 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258400.865345:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258400.865351:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258400.865367:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:1.0:1734258400.865475:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258400.865483:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258400.865485:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258400.865492:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098243584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258416 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258400.865499:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098243584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258416 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258400.865517:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258400.865522:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734258400.865525:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258405.867723:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258405.867746:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258405.867805:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258405.867811:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734258405.867859:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734258405.867868:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d504d0. 00000400:00000010:0.0:1734258405.867876:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734258405.867883:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098243968, portal 10 00000400:00000010:0.0:1734258405.867889:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000100:00000200:0.0:1734258405.867891:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098243968, offset 0 00000400:00000200:0.0:1734258405.867902:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258405.867918:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258405.867924:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258405.867927:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258405.867931:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258405.867933:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258405.867937:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [637:637:256:4294967295] 192.168.202.108@tcp LPNI seq info [636:636:8:4294967295] 00000400:00000200:0.0:1734258405.867945:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:3.0:1734258405.867946:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000800:00000200:0.0:1734258405.867951:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734258405.867952:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000800:00000010:0.0:1734258405.867954:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000400:00000010:3.0:1734258405.867955:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258405.867958:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098243840, portal 25 00000800:00000200:0.0:1734258405.867960:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:3.0:1734258405.867960:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000800:00000200:0.0:1734258405.867969:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:3.0:1734258405.867972:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098243840, offset 0 00000800:00000200:0.0:1734258405.867974:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734258405.867977:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258405.867982:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258405.867984:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258405.867987:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258405.867989:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258405.867990:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258405.867992:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [638:638:255:4294967295] 192.168.202.108@tcp LPNI seq info [637:637:7:4294967295] 00000400:00000200:3.0:1734258405.867998:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258405.868002:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258405.868005:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734258405.868007:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258405.868011:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258405.868013:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258405.868732:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258405.868736:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734258405.868741:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258405.868746:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258405.868750:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:1.0:1734258405.868765:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:1.0:1734258405.868773:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098243968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258415 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258405.868851:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258405.868854:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:1.0:1734258405.868856:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258405.868859:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258405.868861:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:1.0:1734258405.868863:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:1.0:1734258405.868866:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098243840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258421 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258405.871898:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258405.871923:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613d80 00000400:00000200:0.0:1734258405.871933:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x14d9 [1] + 0 00000400:00000200:0.0:1734258405.871946:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258405.871950:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258405.871972:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098243968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258415 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258405.872013:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258405.872018:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613d00 00000400:00000200:0.0:1734258405.872023:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x14e1 [1] + 224 00000400:00000200:0.0:1734258405.872039:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258405.872047:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258405.872052:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098243840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258421 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258405.872083:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d504d0. 00000400:00000200:2.0:1734258405.872097:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:2.0:1734258405.872099:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:2.0:1734258405.872111:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098243968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258415 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258405.872120:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098243968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258415 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258405.872131:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258405.872137:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258405.872139:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258405.872144:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098243840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258421 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258405.872161:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 00000100:00000200:3.0:1734258405.872162:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098243840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258421 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258405.872169:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258405.872173:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 02000000:00000010:3.0:1734258405.872181:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258405.872187:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734258405.872190:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258410.875724:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258410.875748:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258410.875821:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258410.875832:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734258410.875887:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734258410.875895:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50478. 00000400:00000010:0.0:1734258410.875902:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:0.0:1734258410.875912:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098244224, portal 10 00000400:00000010:0.0:1734258410.875919:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734258410.875921:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098244224, offset 0 00000400:00000200:0.0:1734258410.875936:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258410.875951:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258410.875958:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258410.875962:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258410.875965:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258410.875967:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258410.875970:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [639:639:256:4294967295] 192.168.202.108@tcp LPNI seq info [638:638:8:4294967295] 00000400:00000200:0.0:1734258410.875978:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258410.875984:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258410.875988:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734258410.876008:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258410.876017:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 02000000:00000010:3.0:1734258410.876020:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000800:00000200:0.0:1734258410.876022:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 616 niov 1 nkiov 1 00000400:00000010:3.0:1734258410.876025:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258410.876029:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258410.876032:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098244096, portal 25 00000400:00000010:3.0:1734258410.876035:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734258410.876037:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098244096, offset 0 00000400:00000200:3.0:1734258410.876041:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258410.876046:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258410.876049:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258410.876051:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258410.876053:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258410.876055:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258410.876057:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [640:640:255:4294967295] 192.168.202.108@tcp LPNI seq info [639:639:7:4294967295] 00000400:00000200:3.0:1734258410.876063:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258410.876067:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258410.876070:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734258410.876073:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258410.876077:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258410.876079:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258410.876205:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258410.876209:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734258410.876215:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258410.876219:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258410.876223:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:1.0:1734258410.876225:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:1.0:1734258410.876232:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098244224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258410.876335:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258410.876338:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:1.0:1734258410.876340:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258410.876343:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258410.876345:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:1.0:1734258410.876346:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:1.0:1734258410.876350:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098244096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258426 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258410.879740:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258410.879762:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613e80 00000400:00000200:0.0:1734258410.879772:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x14e9 [1] + 0 00000400:00000200:0.0:1734258410.879786:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258410.879789:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258410.879800:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098244224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258410.879845:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258410.879850:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613e00 00000400:00000200:0.0:1734258410.879855:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x14f1 [1] + 224 00000400:00000200:0.0:1734258410.879877:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258410.879880:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258410.879886:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098244096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258426 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258410.880110:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50478. 00000400:00000200:2.0:1734258410.880115:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:2.0:1734258410.880118:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:2.0:1734258410.880123:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098244224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258410.880129:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098244224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258420 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258410.880160:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258410.880167:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258410.880171:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:3.0:1734258410.881652:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258410.881659:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258410.881660:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258410.881666:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098244096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258426 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258410.881689:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098244096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258426 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258410.881703:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258410.881707:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734258410.881709:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258415.883717:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258415.883742:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258415.883805:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258415.883813:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258415.883863:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0000. 00000400:00000010:1.0:1734258415.883876:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258415.883882:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258415.883888:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098244352, portal 25 00000400:00000010:1.0:1734258415.883892:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 02000000:00000010:3.0:1734258415.883899:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000100:00000200:1.0:1734258415.883906:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098244352, offset 0 00000400:00000010:3.0:1734258415.883906:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258415.883912:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000400:00000200:1.0:1734258415.883915:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734258415.883925:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098244480, portal 10 00000400:00000200:1.0:1734258415.883927:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:3.0:1734258415.883931:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000400:00000200:1.0:1734258415.883932:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:3.0:1734258415.883933:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098244480, offset 0 00000400:00000200:1.0:1734258415.883936:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258415.883939:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258415.883940:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258415.883941:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258415.883944:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [641:641:256:4294967295] 192.168.202.108@tcp LPNI seq info [640:640:8:4294967295] 00000400:00000200:1.0:1734258415.883952:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258415.883958:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258415.883961:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000400:00000200:3.0:1734258415.883961:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258415.883965:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734258415.883966:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258415.883969:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258415.883972:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734258415.883974:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734258415.883974:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734258415.883977:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734258415.883977:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [642:642:255:4294967295] 192.168.202.108@tcp LPNI seq info [641:641:7:4294967295] 00000400:00000200:3.0:1734258415.883984:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258415.883989:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258415.883992:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734258415.883997:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258415.884003:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258415.884006:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258415.884197:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258415.884201:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734258415.884205:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258415.884209:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258415.884212:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734258415.884214:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734258415.884220:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098244352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258431 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258415.884325:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258415.884327:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734258415.884330:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258415.884333:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258415.884335:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734258415.884336:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734258415.884537:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098244480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258425 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258415.887035:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258415.887055:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c613f00 00000400:00000200:0.0:1734258415.887064:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x14f9 [1] + 224 00000400:00000200:0.0:1734258415.887086:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258415.887090:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258415.887099:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098244352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258431 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258415.888855:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258415.888867:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c613f80 00000400:00000200:0.0:1734258415.888874:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1501 [1] + 0 00000400:00000200:0.0:1734258415.888889:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258415.888892:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258415.888900:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098244480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258425 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258415.889042:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258415.889047:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258415.889049:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258415.889055:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098244352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258431 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258415.889062:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098244352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258431 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258415.889087:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0000. 02000000:00000010:1.0:1734258415.889092:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:1.0:1734258415.889096:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:3.0:1734258415.889358:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258415.889362:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258415.889363:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258415.889368:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098244480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258425 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258415.889385:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098244480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258425 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258415.889402:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258415.889405:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258415.889406:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734258420.891784:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258420.891801:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258420.891853:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258420.891859:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258420.891960:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734258420.891967:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258420.891972:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258420.891978:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098244608, portal 25 00000400:00000010:2.0:1734258420.891983:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734258420.891985:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098244608, offset 0 00000400:00000200:2.0:1734258420.891992:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258420.892003:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258420.892007:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258420.892011:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258420.892013:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258420.892026:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258420.892029:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [643:643:256:4294967295] 192.168.202.108@tcp LPNI seq info [642:642:8:4294967295] 00000400:00000200:2.0:1734258420.892036:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258420.892050:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258420.892054:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258420.892059:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258420.892066:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258420.892069:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258420.892151:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258420.892155:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258420.892158:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258420.892161:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098244736, portal 10 00000400:00000010:3.0:1734258420.892169:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734258420.892170:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098244736, offset 0 00000400:00000200:3.0:1734258420.892174:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258420.892178:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258420.892180:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258420.892182:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258420.892184:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258420.892185:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258420.892187:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [644:644:255:4294967295] 192.168.202.108@tcp LPNI seq info [643:643:7:4294967295] 00000400:00000200:3.0:1734258420.892192:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258420.892196:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258420.892198:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734258420.892230:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258420.892234:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258420.892235:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258420.892464:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258420.892467:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258420.892476:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258420.892480:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258420.892483:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734258420.892485:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734258420.892491:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098244608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258436 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258420.892675:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258420.892678:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734258420.892680:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258420.892684:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258420.892686:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734258420.892687:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734258420.892691:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098244736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258430 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258420.895121:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258420.895135:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614000 00000400:00000200:0.0:1734258420.895142:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1509 [1] + 224 00000400:00000200:0.0:1734258420.895160:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258420.895165:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258420.895173:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098244608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258436 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258420.895441:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258420.895446:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258420.895448:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258420.895453:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098244608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258436 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258420.895459:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098244608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258436 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258420.895479:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734258420.895482:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734258420.895485:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734258420.895917:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258420.895924:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614080 00000400:00000200:0.0:1734258420.895929:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1511 [1] + 0 00000400:00000200:0.0:1734258420.895940:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258420.895943:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258420.895949:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098244736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258430 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258420.896001:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258420.896005:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258420.896006:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258420.896010:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098244736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258430 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258420.896027:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098244736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258430 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258420.896042:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258420.896044:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258420.896047:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258425.899781:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258425.899839:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258425.900324:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258425.900336:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734258425.900411:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258425.900420:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734258425.900428:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:0.0:1734258425.900430:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50420. 00000400:00000010:0.0:1734258425.900437:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000400:00000010:2.0:1734258425.900437:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734258425.900450:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098244992, portal 10 00000400:00000010:0.0:1734258425.900457:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000100:00000200:2.0:1734258425.900608:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098244864, portal 25 00000100:00000200:0.0:1734258425.900609:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098244992, offset 0 00000400:00000010:2.0:1734258425.900613:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000400:00000200:0.0:1734258425.900626:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258425.900648:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258425.900657:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258425.900661:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258425.900664:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258425.900666:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258425.900670:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [645:645:256:4294967295] 192.168.202.108@tcp LPNI seq info [644:644:8:4294967295] 00000400:00000200:0.0:1734258425.900679:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258425.900685:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258425.900691:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734258425.900698:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258425.900707:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258425.900711:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:2.0:1734258425.900783:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098244864, offset 0 00000400:00000200:2.0:1734258425.900789:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258425.900794:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258425.900797:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258425.900799:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258425.900801:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258425.900802:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258425.900804:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [646:646:255:4294967295] 192.168.202.108@tcp LPNI seq info [645:645:7:4294967295] 00000400:00000200:2.0:1734258425.900818:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258425.900821:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258425.900824:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258425.900826:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258425.900829:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258425.900831:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258425.900868:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258425.900871:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:1.0:1734258425.900878:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258425.900884:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258425.900888:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:1.0:1734258425.900890:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:1.0:1734258425.900900:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098244992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258435 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258425.901003:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258425.901005:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734258425.901008:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258425.901012:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258425.901014:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:1.0:1734258425.901016:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:1.0:1734258425.901019:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098244864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258441 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258425.904416:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258425.904441:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614180 00000400:00000200:0.0:1734258425.904452:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1519 [1] + 0 00000400:00000200:0.0:1734258425.904481:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258425.904486:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258425.904498:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098244992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258435 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258425.905229:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50420. 00000400:00000200:2.0:1734258425.905235:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:2.0:1734258425.905238:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:2.0:1734258425.905245:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098244992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258435 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258425.905252:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098244992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258435 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258425.905289:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258425.905294:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258425.905301:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734258425.906934:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258425.906952:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614100 00000400:00000200:0.0:1734258425.906960:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x151d [1] + 224 00000400:00000200:0.0:1734258425.906985:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258425.906989:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258425.907000:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098244864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258441 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258425.907610:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258425.907616:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258425.907618:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258425.907625:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098244864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258441 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258425.907632:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098244864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258441 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258425.907651:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734258425.907656:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:2.0:1734258425.907661:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258430.907809:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258430.907835:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258430.907897:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258430.907906:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258430.907948:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 02000000:00000010:0.0:1734258430.907959:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:3.0:1734258430.907964:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:0.0:1734258430.907966:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d503c8. 00000400:00000010:0.0:1734258430.907972:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734258430.907980:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098245248, portal 10 00000400:00000010:3.0:1734258430.908246:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258430.908255:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098245120, portal 25 00000400:00000010:3.0:1734258430.908260:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734258430.908262:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098245120, offset 0 00000400:00000200:3.0:1734258430.908270:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258430.908282:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258430.908287:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258430.908291:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258430.908294:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258430.908296:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258430.908298:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [647:647:256:4294967295] 192.168.202.108@tcp LPNI seq info [646:646:8:4294967295] 00000400:00000200:3.0:1734258430.908316:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258430.908321:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258430.908325:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734258430.908330:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258430.908337:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258430.908341:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258430.908465:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258430.908468:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:1.0:1734258430.908470:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258430.908474:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258430.908476:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:1.0:1734258430.908477:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:1.0:1734258430.908483:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098245120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258446 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:0.0:1734258430.908545:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:0.0:1734258430.908549:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098245248, offset 0 00000400:00000200:0.0:1734258430.908557:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258430.908566:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258430.908592:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258430.908596:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258430.908598:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258430.908600:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258430.908603:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [648:648:256:4294967295] 192.168.202.108@tcp LPNI seq info [647:647:8:4294967295] 00000400:00000200:0.0:1734258430.908611:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258430.908616:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258430.908619:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734258430.908623:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258430.908643:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258430.908646:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258430.908773:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258430.908776:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:2.0:1734258430.908779:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258430.908783:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258430.908790:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:2.0:1734258430.908792:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:2.0:1734258430.908808:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098245248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258440 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258430.912712:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258430.912730:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614200 00000400:00000200:0.0:1734258430.912738:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x152d [1] + 224 00000400:00000200:0.0:1734258430.912750:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258430.912754:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258430.912766:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098245120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258446 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258430.912804:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258430.912807:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614280 00000400:00000200:0.0:1734258430.912811:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1529 [1] + 0 00000400:00000200:0.0:1734258430.912827:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258430.912830:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258430.912836:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098245248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258440 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258430.913221:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d503c8. 00000400:00000200:1.0:1734258430.913225:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:1.0:1734258430.913227:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:1.0:1734258430.913232:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098245248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258440 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258430.913238:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098245248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258440 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258430.913269:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258430.913275:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258430.913280:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:3.0:1734258430.913501:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258430.913505:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258430.913506:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258430.913512:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098245120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258446 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258430.913532:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098245120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258446 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258430.913543:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258430.913546:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:3.0:1734258430.913548:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258435.915899:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258435.915919:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 02000000:00000010:1.0:1734258435.916034:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734258435.916042:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258435.916048:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258435.916056:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098245376, portal 25 00000400:00000010:1.0:1734258435.916060:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734258435.916074:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098245376, offset 0 00000400:00000200:1.0:1734258435.916110:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258435.916122:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258435.916131:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258435.916136:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258435.916139:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258435.916141:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258435.916144:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [649:649:256:4294967295] 192.168.202.108@tcp LPNI seq info [648:648:8:4294967295] 00000400:00000200:1.0:1734258435.916152:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258435.916158:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258435.916161:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734258435.916166:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258435.916174:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258435.916177:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734258435.916190:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258435.916198:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734258435.916230:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734258435.916234:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50370. 00000400:00000010:0.0:1734258435.916237:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734258435.916240:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098245504, portal 10 00000400:00000010:0.0:1734258435.916244:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000100:00000200:0.0:1734258435.916245:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098245504, offset 0 00000400:00000200:0.0:1734258435.916250:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258435.916254:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258435.916257:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258435.916264:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258435.916266:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258435.916268:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258435.916269:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [650:650:255:4294967295] 192.168.202.108@tcp LPNI seq info [649:649:7:4294967295] 00000400:00000200:0.0:1734258435.916274:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258435.916278:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258435.916280:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734258435.916282:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258435.916285:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258435.916287:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258435.916293:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258435.916296:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:1.0:1734258435.916299:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258435.916302:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258435.916306:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:1.0:1734258435.916307:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734258435.916313:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098245376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258451 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258435.916339:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258435.916341:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734258435.916343:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258435.916346:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258435.916347:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:1.0:1734258435.916348:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:1.0:1734258435.916351:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098245504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258445 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258435.918721:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258435.918738:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614300 00000400:00000200:0.0:1734258435.918748:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1539 [1] + 224 00000400:00000200:0.0:1734258435.918770:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258435.918774:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258435.918786:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098245376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258451 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258435.918995:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258435.919006:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258435.919008:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258435.919013:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098245376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258451 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258435.919019:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098245376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258451 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258435.919038:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734258435.919043:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734258435.919046:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734258435.919248:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258435.919254:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614380 00000400:00000200:0.0:1734258435.919259:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1541 [1] + 0 00000400:00000200:0.0:1734258435.919269:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258435.919272:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258435.919277:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098245504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258445 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258435.919425:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50370. 00000400:00000200:2.0:1734258435.919429:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:2.0:1734258435.919430:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:2.0:1734258435.919434:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098245504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258445 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258435.919440:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098245504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258445 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258435.919455:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258435.919458:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258435.919460:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258440.923849:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258440.923870:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258440.923928:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258440.923935:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258440.924015:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258440.924023:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258440.924029:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258440.924034:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098245760, portal 10 00000400:00000010:3.0:1734258440.924039:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734258440.924040:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098245760, offset 0 00000400:00000200:3.0:1734258440.924060:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258440.924071:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258440.924076:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258440.924079:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258440.924082:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258440.924084:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258440.924086:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [651:651:256:4294967295] 192.168.202.108@tcp LPNI seq info [650:650:8:4294967295] 00000400:00000200:3.0:1734258440.924094:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258440.924098:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258440.924102:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734258440.924106:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258440.924112:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258440.924115:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734258440.924205:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734258440.924211:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258440.924214:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258440.924217:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098245632, portal 25 00000400:00000010:1.0:1734258440.924219:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734258440.924221:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098245632, offset 0 00000800:00000200:3.0:1734258440.924222:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258440.924224:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:1.0:1734258440.924226:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258440.924227:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258440.924230:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258440.924231:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258440.924233:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258440.924234:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000200:1.0:1734258440.924235:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258440.924236:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258440.924238:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258440.924240:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [652:652:255:4294967295] 192.168.202.108@tcp LPNI seq info [651:651:7:4294967295] 00000400:00000010:3.0:1734258440.924240:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000400:00000200:1.0:1734258440.924246:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:3.0:1734258440.924247:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098245760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258450 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258440.924249:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258440.924251:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734258440.924254:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258440.924258:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258440.924261:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258440.924299:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258440.924301:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:1.0:1734258440.924303:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258440.924311:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258440.924314:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:1.0:1734258440.924315:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734258440.924318:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098245632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258440.927744:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258440.927760:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614480 00000400:00000200:0.0:1734258440.927767:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1549 [1] + 0 00000400:00000200:0.0:1734258440.927783:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258440.927787:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258440.927795:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098245760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258440.928137:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258440.928141:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258440.928143:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258440.928148:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098245760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258450 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258440.928154:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098245760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258450 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258440.928180:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258440.928184:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258440.928189:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000200:0.0:1734258440.928462:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258440.928469:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614400 00000400:00000200:0.0:1734258440.928475:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1551 [1] + 224 00000400:00000200:0.0:1734258440.928485:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258440.928488:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258440.928493:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098245632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258456 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258440.928668:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258440.928672:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258440.928674:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258440.928679:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098245632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258440.928686:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098245632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258456 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258440.928697:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734258440.928700:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734258440.928702:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734258445.931690:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258445.931709:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 02000000:00000010:2.0:1734258445.935154:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734258445.935165:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258445.935171:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258445.935178:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098245888, portal 25 00000400:00000010:2.0:1734258445.935182:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258445.935183:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098245888, offset 0 00000400:00000200:2.0:1734258445.935191:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258445.935202:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258445.935208:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258445.935211:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258445.935214:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258445.935216:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258445.935218:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [653:653:256:4294967295] 192.168.202.108@tcp LPNI seq info [652:652:8:4294967295] 00000400:00000200:2.0:1734258445.935226:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258445.935230:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258445.935234:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258445.935249:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258445.935256:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258445.935260:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734258445.935373:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258445.935384:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258445.935485:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258445.935488:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cc08. 00000400:00000010:2.0:1734258445.935491:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258445.935493:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098246016, portal 10 00000400:00000010:2.0:1734258445.935497:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258445.935498:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098246016, offset 0 00000400:00000200:2.0:1734258445.935503:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258445.935507:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258445.935509:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258445.935511:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258445.935513:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258445.935515:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258445.935517:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [654:654:255:4294967295] 192.168.202.108@tcp LPNI seq info [653:653:7:4294967295] 00000400:00000200:2.0:1734258445.935523:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258445.935526:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258445.935528:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258445.935531:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258445.935534:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258445.935536:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258445.935619:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258445.935622:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734258445.935627:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258445.935630:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258445.935634:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:1.0:1734258445.935635:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:1.0:1734258445.935641:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098245888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258461 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258445.935696:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258445.935698:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734258445.935700:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258445.935703:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258445.935705:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:1.0:1734258445.935706:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:1.0:1734258445.935709:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098246016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258455 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258445.937910:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258445.937923:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614500 00000400:00000200:0.0:1734258445.937929:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1559 [1] + 224 00000400:00000200:0.0:1734258445.937946:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258445.937949:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258445.937956:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098245888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258461 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258445.938202:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258445.938206:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734258445.938207:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258445.938212:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098245888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258461 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258445.938219:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098245888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258461 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258445.938236:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258445.938246:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:2.0:1734258445.938249:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000200:0.0:1734258445.938597:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258445.938604:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614580 00000400:00000200:0.0:1734258445.938608:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1561 [1] + 0 00000400:00000200:0.0:1734258445.938622:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258445.938625:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258445.938629:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098246016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258455 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258445.938698:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cc08. 00000400:00000200:2.0:1734258445.938701:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258445.938702:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258445.938706:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098246016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258455 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258445.938712:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098246016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258455 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258445.938727:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258445.938731:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258445.938733:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258450.939721:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258450.939746:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258450.940963:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258450.940985:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258450.941071:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734258450.941080:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cc08. 00000400:00000010:2.0:1734258450.941086:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258450.941113:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098246144, portal 25 00000400:00000010:2.0:1734258450.941118:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258450.941120:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098246144, offset 0 00000400:00000200:2.0:1734258450.941130:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258450.941144:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258450.941149:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258450.941153:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258450.941156:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258450.941158:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258450.941160:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [655:655:256:4294967295] 192.168.202.108@tcp LPNI seq info [654:654:8:4294967295] 02000000:00000010:1.0:1734258450.941252:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734258450.941270:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258450.941273:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258450.941275:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098246272, portal 10 00000400:00000010:1.0:1734258450.941280:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734258450.941281:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098246272, offset 0 00000400:00000200:1.0:1734258450.941285:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258450.941299:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258450.941304:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258450.941307:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258450.941313:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258450.941322:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258450.941330:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734258450.941411:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258450.941413:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258450.941416:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258450.941417:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258450.941419:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258450.941421:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [656:656:255:4294967295] 192.168.202.108@tcp LPNI seq info [655:655:7:4294967295] 00000400:00000200:1.0:1734258450.941428:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258450.941431:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258450.941434:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734258450.941436:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258450.941440:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258450.941442:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258450.941538:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258450.941541:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258450.941546:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258450.941551:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258450.941555:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734258450.941557:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734258450.941582:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098246144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258466 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258450.942721:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258450.942726:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734258450.942730:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258450.942734:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258450.942737:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734258450.942738:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734258450.942743:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098246272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258460 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258450.943822:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258450.943834:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614600 00000400:00000200:0.0:1734258450.943841:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1569 [1] + 224 00000400:00000200:0.0:1734258450.943852:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258450.943855:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258450.943861:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098246144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258466 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258450.943903:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258450.943906:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614680 00000400:00000200:0.0:1734258450.943911:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1571 [1] + 0 00000400:00000200:0.0:1734258450.943922:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258450.943924:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258450.943928:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098246272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258460 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258450.944199:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258450.944204:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258450.944205:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258450.944210:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098246272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258460 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258450.944217:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098246272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258460 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258450.944247:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734258450.944253:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734258450.944258:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:2.0:1734258450.944468:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cc08. 00000400:00000200:2.0:1734258450.944473:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258450.944474:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258450.944478:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098246144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258466 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258450.944484:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098246144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258466 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258450.944494:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258450.944497:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:2.0:1734258450.944499:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258455.948159:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258455.948183:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258455.948793:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258455.948802:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734258455.948852:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734258455.948859:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50318. 00000400:00000010:0.0:1734258455.948867:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000100:00000200:0.0:1734258455.948874:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098246528, portal 10 00000400:00000010:0.0:1734258455.948881:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734258455.948883:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098246528, offset 0 02000000:00000010:2.0:1734258455.948889:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000200:0.0:1734258455.948893:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734258455.948900:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cc08. 00000400:00000010:2.0:1734258455.948906:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000400:00000200:0.0:1734258455.948908:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:2.0:1734258455.948912:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098246400, portal 25 00000400:00000200:0.0:1734258455.948915:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734258455.948915:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734258455.948917:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098246400, offset 0 00000400:00000200:0.0:1734258455.948918:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258455.948921:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258455.948923:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258455.948925:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258455.948936:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [657:657:256:4294967295] 192.168.202.108@tcp LPNI seq info [656:656:8:4294967295] 00000400:00000200:0.0:1734258455.948945:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:2.0:1734258455.948959:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258455.948964:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258455.948968:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258455.948971:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258455.948973:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258455.948976:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [658:658:255:4294967295] 192.168.202.108@tcp LPNI seq info [657:657:7:4294967295] 00000400:00000200:2.0:1734258455.948983:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258455.948988:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258455.948991:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258455.948996:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258455.949004:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258455.949008:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258455.949267:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258455.949275:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734258455.949279:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258455.949295:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258455.949298:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258455.949825:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258455.949829:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:2.0:1734258455.949833:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258455.949837:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258455.949842:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:2.0:1734258455.949843:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734258455.949850:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098246400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258471 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258455.950070:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258455.950072:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:2.0:1734258455.950076:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258455.950079:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258455.950081:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:2.0:1734258455.950082:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:2.0:1734258455.950086:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098246528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258465 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258455.951480:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258455.951496:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614780 00000400:00000200:0.0:1734258455.951504:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1579 [1] + 0 00000400:00000200:0.0:1734258455.951525:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258455.951529:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258455.951538:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098246528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258465 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258455.951661:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50318. 00000400:00000200:2.0:1734258455.951665:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:2.0:1734258455.951667:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:2.0:1734258455.951671:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098246528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258465 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258455.951677:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098246528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258465 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734258455.951695:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:2.0:1734258455.951707:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734258455.951712:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258455.951715:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000200:0.0:1734258455.952336:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258455.952344:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614700 00000400:00000200:0.0:1734258455.952349:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1581 [1] + 224 00000400:00000200:0.0:1734258455.952359:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258455.952362:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258455.952368:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098246400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258471 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258455.952465:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cc08. 00000400:00000200:2.0:1734258455.952468:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258455.952470:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258455.952474:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098246400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258471 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258455.952494:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098246400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258471 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258455.952508:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258455.952510:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734258455.952512:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:2.0:1734258460.955754:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734258460.955771:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734258460.955960:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734258460.955966:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734258460.956046:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734258460.956053:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258460.956068:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258460.956073:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098246656, portal 25 00000400:00000010:1.0:1734258460.956077:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734258460.956078:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098246656, offset 0 00000400:00000200:1.0:1734258460.956085:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258460.956095:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258460.956099:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258460.956102:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258460.956105:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258460.956107:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258460.956109:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [659:659:256:4294967295] 192.168.202.108@tcp LPNI seq info [658:658:8:4294967295] 00000400:00000200:1.0:1734258460.956116:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258460.956121:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258460.956124:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734258460.956129:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258460.956135:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258460.956138:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258460.957167:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258460.957175:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258460.957180:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258460.957184:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098246784, portal 10 00000400:00000010:3.0:1734258460.957188:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734258460.957190:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098246784, offset 0 00000400:00000200:3.0:1734258460.957195:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258460.957201:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258460.957206:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258460.957208:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258460.957210:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258460.957211:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258460.957213:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [660:660:255:4294967295] 192.168.202.108@tcp LPNI seq info [659:659:7:4294967295] 00000400:00000200:3.0:1734258460.957220:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258460.957223:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258460.957226:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734258460.957230:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258460.957235:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258460.957244:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258460.957365:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258460.957369:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:2.0:1734258460.957373:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258460.957377:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258460.957380:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:2.0:1734258460.957382:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:2.0:1734258460.957389:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098246656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258476 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258460.957452:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258460.957454:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:2.0:1734258460.957457:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258460.957460:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258460.957462:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:2.0:1734258460.957463:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:2.0:1734258460.957466:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098246784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258470 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258460.959879:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258460.959921:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614800 00000400:00000200:0.0:1734258460.959928:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1589 [1] + 224 00000400:00000200:0.0:1734258460.959946:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258460.959949:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258460.959958:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098246656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258476 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258460.960369:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258460.960373:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258460.960375:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258460.960379:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098246656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258476 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258460.960385:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098246656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258476 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258460.960404:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734258460.960408:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734258460.960411:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000200:0.0:1734258460.961131:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258460.961141:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614880 00000400:00000200:0.0:1734258460.961146:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1591 [1] + 0 00000400:00000200:0.0:1734258460.961159:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258460.961167:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258460.961173:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098246784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258470 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258460.961307:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258460.961311:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258460.961312:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258460.961317:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098246784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258470 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258460.961323:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098246784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258470 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258460.961339:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258460.961342:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734258460.961345:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000100:00000010:0.0:1734258465.964713:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258465.964731:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258465.964779:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258465.964786:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:0.0:1734258465.964818:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734258465.964823:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d502c0. 00000400:00000010:0.0:1734258465.964829:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000100:00000200:0.0:1734258465.964834:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098247040, portal 10 00000400:00000010:0.0:1734258465.964838:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734258465.964840:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098247040, offset 0 00000400:00000200:0.0:1734258465.964846:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258465.964881:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258465.964885:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258465.964888:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258465.964891:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258465.964893:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258465.964895:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [661:661:256:4294967295] 192.168.202.108@tcp LPNI seq info [660:660:8:4294967295] 00000400:00000200:0.0:1734258465.964904:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258465.964912:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258465.964915:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734258465.964919:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258465.964926:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258465.964929:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258465.965023:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258465.965025:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:0.0:1734258465.965028:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258465.965032:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258465.965044:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:0.0:1734258465.965046:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734258465.965051:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098247040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258475 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258465.965240:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000400:00000010:2.0:1734258465.965245:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cc08. 00000400:00000010:2.0:1734258465.965249:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258465.965251:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098246912, portal 25 00000400:00000010:2.0:1734258465.965253:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734258465.965260:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098246912, offset 0 00000400:00000200:2.0:1734258465.965264:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258465.965268:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258465.965270:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258465.965272:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258465.965273:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258465.965275:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258465.965277:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [662:662:256:4294967295] 192.168.202.108@tcp LPNI seq info [661:661:8:4294967295] 00000400:00000200:2.0:1734258465.965282:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258465.965286:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258465.965288:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258465.965290:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258465.965294:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258465.965296:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258465.965384:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258465.965386:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258465.965390:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258465.965392:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258465.965394:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734258465.965396:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734258465.965399:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098246912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258481 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258465.967172:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258465.967188:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614980 00000400:00000200:0.0:1734258465.967195:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1599 [1] + 0 00000400:00000200:0.0:1734258465.967205:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258465.967208:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258465.967216:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098247040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258475 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258465.967846:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d502c0. 00000400:00000200:2.0:1734258465.967863:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:2.0:1734258465.967864:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000400:00000200:0.0:1734258465.967867:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000100:00000200:2.0:1734258465.967869:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098247040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258475 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258465.967873:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614900 00000100:00000200:2.0:1734258465.967876:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098247040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258475 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258465.967877:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x15a1 [1] + 224 00000400:00000200:0.0:1734258465.967890:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258465.967893:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258465.967897:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098246912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258481 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258465.967900:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258465.967904:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258465.967907:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:3.0:1734258465.967979:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cc08. 00000400:00000200:3.0:1734258465.967983:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:3.0:1734258465.967984:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:3.0:1734258465.967988:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098246912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258481 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258465.967993:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098246912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258481 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258465.968004:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:3.0:1734258465.968006:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734258465.968008:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258470.972906:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258470.972929:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258470.972985:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258470.973005:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734258470.973046:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734258470.973053:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50268. 00000400:00000010:0.0:1734258470.973059:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734258470.973066:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098247296, portal 10 00000400:00000010:0.0:1734258470.973072:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1088. 00000100:00000200:0.0:1734258470.973075:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098247296, offset 0 00000400:00000200:0.0:1734258470.973083:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258470.973096:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258470.973102:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258470.973106:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258470.973109:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258470.973111:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258470.973114:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [663:663:256:4294967295] 192.168.202.108@tcp LPNI seq info [662:662:8:4294967295] 00000400:00000200:0.0:1734258470.973122:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258470.973127:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258470.973130:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734258470.973136:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258470.973144:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258470.973148:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258470.973280:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258470.973290:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258470.973296:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258470.973301:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098247168, portal 25 00000400:00000010:3.0:1734258470.973305:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734258470.973307:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098247168, offset 0 00000400:00000200:3.0:1734258470.973314:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258470.973323:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258470.973328:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258470.973330:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258470.973343:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258470.973345:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258470.973347:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [664:664:255:4294967295] 192.168.202.108@tcp LPNI seq info [663:663:7:4294967295] 00000400:00000200:3.0:1734258470.973354:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258470.973359:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258470.973362:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734258470.973367:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258470.973373:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258470.973376:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258470.973632:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258470.973634:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734258470.973639:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258470.973643:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258470.973650:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1088 00000400:00000010:1.0:1734258470.973652:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1088. 00000100:00000200:1.0:1734258470.973658:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098247296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258480 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258470.973715:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258470.973717:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:1.0:1734258470.973719:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258470.973722:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258470.973724:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:1.0:1734258470.973725:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:1.0:1734258470.973728:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098247168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258486 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258470.975558:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258470.975597:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614a80 00000400:00000200:0.0:1734258470.975605:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x15a9 [1] + 0 00000400:00000200:0.0:1734258470.975616:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258470.975619:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258470.975628:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098247296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258480 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258470.975658:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258470.975661:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614a00 00000400:00000200:0.0:1734258470.975676:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x15b1 [1] + 224 00000400:00000200:0.0:1734258470.975688:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258470.975691:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:2.0:1734258470.975694:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50268. 00000400:00000200:2.0:1734258470.975699:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:2.0:1734258470.975701:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734258470.975707:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098247168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258486 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258470.975708:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098247296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258480 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258470.975715:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098247296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258480 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258470.975754:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258470.975759:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258470.975764:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:3.0:1734258470.975784:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258470.975792:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258470.975794:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258470.975803:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098247168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258486 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258470.975824:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098247168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258486 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258470.975846:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258470.975852:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734258470.975856:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258475.979712:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258475.979732:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258475.979822:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258475.979829:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734258475.979928:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258475.979935:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258475.979942:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258475.979948:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098247552, portal 10 00000400:00000010:3.0:1734258475.979954:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734258475.979956:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098247552, offset 0 00000400:00000200:3.0:1734258475.979966:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258475.979977:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258475.979982:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258475.979985:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258475.979988:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258475.979990:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258475.980005:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [665:665:256:4294967295] 192.168.202.108@tcp LPNI seq info [664:664:8:4294967295] 00000400:00000200:3.0:1734258475.980012:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258475.980017:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258475.980020:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734258475.980026:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258475.980033:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258475.980036:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734258475.980115:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734258475.980120:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258475.980124:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258475.980126:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098247424, portal 25 00000400:00000010:2.0:1734258475.980128:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258475.980130:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098247424, offset 0 00000400:00000200:2.0:1734258475.980133:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258475.980137:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258475.980140:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258475.980141:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258475.980143:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258475.980144:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258475.980146:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [666:666:255:4294967295] 192.168.202.108@tcp LPNI seq info [665:665:7:4294967295] 00000400:00000200:2.0:1734258475.980151:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258475.980154:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258475.980157:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258475.980159:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258475.980162:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258475.980164:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258475.980835:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258475.980838:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734258475.980843:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258475.980847:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258475.980851:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734258475.980853:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734258475.980860:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098247552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258485 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258475.981262:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258475.981265:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258475.981269:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258475.981272:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258475.981274:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:0.0:1734258475.981275:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734258475.981279:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098247424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258491 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258475.985511:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258475.985528:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614b80 00000400:00000200:0.0:1734258475.985536:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x15b9 [1] + 0 00000400:00000200:0.0:1734258475.985555:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258475.985559:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258475.985600:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098247552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258485 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258475.985861:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258475.985869:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258475.985872:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258475.985992:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098247552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258485 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258475.986003:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098247552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258485 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258475.986036:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258475.986043:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258475.986050:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000200:0.0:1734258475.986457:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258475.986466:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614b00 00000400:00000200:0.0:1734258475.986471:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x15c1 [1] + 224 00000400:00000200:0.0:1734258475.986483:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258475.986486:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258475.986492:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098247424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258491 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258475.986655:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258475.986659:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258475.986660:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258475.986665:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098247424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258491 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258475.986671:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098247424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258491 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258475.986695:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258475.986698:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734258475.986700:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258480.987697:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258480.987716:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258480.987802:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258480.987808:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258480.987829:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734258480.987836:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258480.987841:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258480.987847:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098247680, portal 25 00000400:00000010:2.0:1734258480.987851:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258480.987853:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098247680, offset 0 00000400:00000200:2.0:1734258480.987860:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258480.987871:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258480.987876:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258480.987879:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258480.987881:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258480.987883:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258480.987886:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [667:667:256:4294967295] 192.168.202.108@tcp LPNI seq info [666:666:8:4294967295] 00000400:00000200:2.0:1734258480.987893:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258480.987898:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258480.987902:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258480.987907:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258480.987917:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258480.987921:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258480.987959:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258480.987965:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258480.987967:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258480.987970:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098247808, portal 10 00000400:00000010:3.0:1734258480.987974:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258480.987975:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098247808, offset 0 00000400:00000200:3.0:1734258480.987979:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258480.987983:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258480.987986:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258480.987987:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258480.987989:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258480.987990:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258480.987992:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [668:668:255:4294967295] 192.168.202.108@tcp LPNI seq info [667:667:7:4294967295] 00000400:00000200:3.0:1734258480.988009:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258480.988012:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258480.988014:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734258480.988017:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258480.988020:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258480.988022:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258480.988028:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258480.988031:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258480.988035:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258480.988040:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258480.988043:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734258480.988045:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734258480.988050:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098247680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258496 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258480.988074:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258480.988075:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734258480.988077:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258480.988080:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258480.988081:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:0.0:1734258480.988082:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:0.0:1734258480.988085:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098247808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258490 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258480.991472:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258480.991509:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614c00 00000400:00000200:0.0:1734258480.991521:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x15c9 [1] + 224 00000400:00000200:0.0:1734258480.991536:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258480.991541:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258480.991553:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098247680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258496 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258480.991625:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258480.991630:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614c80 00000400:00000200:0.0:1734258480.991635:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x15d1 [1] + 0 00000400:00000200:0.0:1734258480.991646:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258480.991648:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258480.991653:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098247808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258490 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258480.991870:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258480.991876:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258480.991878:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258480.991884:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098247808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258490 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258480.991891:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098247808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258490 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258480.991925:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258480.991930:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258480.991936:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:2.0:1734258480.992117:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258480.992122:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258480.992124:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258480.992129:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098247680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258496 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258480.992135:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098247680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258496 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258480.992149:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734258480.992159:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:2.0:1734258480.992162:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258485.995776:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258485.995802:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258485.995868:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258485.995875:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258485.995886:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734258485.995895:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258485.995901:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258485.995909:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098247936, portal 25 00000400:00000010:2.0:1734258485.995913:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734258485.995915:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098247936, offset 0 02000000:00000010:0.0:1734258485.995916:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734258485.995920:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50210. 00000400:00000200:2.0:1734258485.995924:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258485.995939:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258485.995944:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258485.995948:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258485.995951:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258485.995953:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258485.995956:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [669:669:256:4294967295] 192.168.202.108@tcp LPNI seq info [668:668:8:4294967295] 00000400:00000200:2.0:1734258485.995965:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258485.995970:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258485.995975:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258485.995982:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258485.995990:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258485.995994:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258485.997547:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258485.997556:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734258485.997561:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258485.997607:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:0.0:1734258485.997668:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1000. 00000100:00000200:0.0:1734258485.997676:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098248064, portal 10 00000400:00000200:1.0:1734258485.997683:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734258485.997684:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000400:00000010:1.0:1734258485.997686:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734258485.997691:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098248064, offset 0 00000100:00000200:1.0:1734258485.997703:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098247936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258501 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258485.997705:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258485.997716:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258485.997721:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258485.997724:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258485.997727:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258485.997729:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258485.997751:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [670:670:255:4294967295] 192.168.202.108@tcp LPNI seq info [669:669:7:4294967295] 00000400:00000200:0.0:1734258485.997758:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258485.997763:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258485.997767:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734258485.997771:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258485.997777:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258485.997780:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258485.999404:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258485.999412:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:2.0:1734258485.999418:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258485.999424:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258485.999430:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:2.0:1734258485.999431:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:2.0:1734258485.999439:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098248064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258495 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258486.013736:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258486.013755:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614d00 00000400:00000200:0.0:1734258486.013762:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x15d9 [1] + 224 00000400:00000200:0.0:1734258486.013774:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258486.013777:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258486.013787:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098247936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258501 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258486.013828:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258486.013832:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614d80 00000400:00000200:0.0:1734258486.013836:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x15e1 [1] + 0 00000400:00000200:0.0:1734258486.013847:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258486.013850:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258486.013855:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098248064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258495 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258486.014216:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258486.014221:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258486.014230:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258486.014235:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098247936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258501 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258486.014242:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098247936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258501 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258486.014262:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734258486.014265:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734258486.014268:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:1.0:1734258486.015204:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50210. 00000400:00000200:1.0:1734258486.015216:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1000 00000400:00000010:1.0:1734258486.015218:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1000. 00000100:00000200:1.0:1734258486.015228:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098248064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258495 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258486.015236:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098248064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258495 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258486.015262:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258486.015267:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258486.015271:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:2.0:1734258491.005751:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734258491.005774:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734258491.005844:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734258491.005851:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734258491.005948:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258491.005955:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258491.005961:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258491.005967:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098248192, portal 25 00000400:00000010:3.0:1734258491.005972:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734258491.005973:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098248192, offset 0 00000400:00000200:3.0:1734258491.005982:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258491.005992:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258491.005997:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258491.006000:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258491.006004:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258491.006006:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258491.006009:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [671:671:256:4294967295] 192.168.202.108@tcp LPNI seq info [670:670:8:4294967295] 00000400:00000200:3.0:1734258491.006017:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258491.006032:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258491.006035:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734258491.006040:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258491.006047:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258491.006050:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258491.006167:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258491.006170:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:3.0:1734258491.006173:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258491.006177:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258491.006180:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:3.0:1734258491.006182:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734258491.006188:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098248192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258507 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258491.006257:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734258491.006262:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258491.006270:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258491.006273:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098248320, portal 10 00000400:00000010:1.0:1734258491.006277:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734258491.006278:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098248320, offset 0 00000400:00000200:1.0:1734258491.006282:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258491.006286:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258491.006288:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258491.006291:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258491.006292:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258491.006294:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258491.006296:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [672:672:256:4294967295] 192.168.202.108@tcp LPNI seq info [671:671:8:4294967295] 00000400:00000200:1.0:1734258491.006301:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258491.006305:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258491.006308:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734258491.006310:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258491.006314:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258491.006316:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258491.006393:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258491.006395:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:2.0:1734258491.006397:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258491.006400:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258491.006402:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:2.0:1734258491.006404:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:2.0:1734258491.006407:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098248320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258501 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258491.012332:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258491.012350:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614e00 00000400:00000200:0.0:1734258491.012358:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x15e9 [1] + 224 00000400:00000200:0.0:1734258491.012368:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258491.012372:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258491.012382:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098248192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258507 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258491.012427:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258491.012431:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614e80 00000400:00000200:0.0:1734258491.012436:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x15f1 [1] + 0 00000400:00000200:0.0:1734258491.012450:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258491.012452:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258491.012457:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098248320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258501 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258491.012466:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258491.012471:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258491.012473:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258491.012478:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098248192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258507 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258491.012485:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098248192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258507 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258491.012506:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258491.012511:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734258491.012515:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000400:00000010:1.0:1734258491.012810:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258491.012814:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258491.012815:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258491.012819:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098248320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258501 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258491.012826:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098248320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258501 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258491.012841:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734258491.012845:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734258491.012849:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734258496.012755:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734258496.012774:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734258496.012829:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734258496.012836:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734258496.012873:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258496.012879:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258496.012885:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258496.012890:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098248576, portal 10 00000400:00000010:2.0:1734258496.012895:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734258496.012897:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098248576, offset 0 00000400:00000200:2.0:1734258496.012904:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258496.012923:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258496.012926:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258496.012930:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258496.012932:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258496.012934:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258496.012937:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [673:673:256:4294967295] 192.168.202.108@tcp LPNI seq info [672:672:8:4294967295] 00000400:00000200:2.0:1734258496.012944:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258496.012949:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258496.012952:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258496.012956:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258496.012962:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258496.012965:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734258496.013086:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258496.013089:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:3.0:1734258496.013093:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258496.013097:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258496.013099:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:3.0:1734258496.013101:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:3.0:1734258496.013107:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098248576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258506 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258496.013245:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0200. 00000400:00000010:1.0:1734258496.013250:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258496.013254:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258496.013262:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098248448, portal 25 00000400:00000010:1.0:1734258496.013264:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734258496.013266:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098248448, offset 0 00000400:00000200:1.0:1734258496.013270:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258496.013275:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258496.013277:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258496.013279:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258496.013281:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258496.013282:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258496.013284:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [674:674:256:4294967295] 192.168.202.108@tcp LPNI seq info [673:673:8:4294967295] 00000400:00000200:1.0:1734258496.013290:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258496.013294:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258496.013297:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734258496.013299:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258496.013303:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258496.013305:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258496.013447:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258496.013449:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:2.0:1734258496.013452:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258496.013455:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258496.013457:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:2.0:1734258496.013458:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:2.0:1734258496.013461:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098248448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258512 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258496.016399:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258496.016418:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c614f80 00000400:00000200:0.0:1734258496.016427:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x15f9 [1] + 0 00000400:00000200:0.0:1734258496.016438:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258496.016441:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258496.016450:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098248576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258506 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258496.016486:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258496.016490:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c614f00 00000400:00000200:0.0:1734258496.016494:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1601 [1] + 224 00000400:00000200:0.0:1734258496.016507:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258496.016509:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258496.016513:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098248448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258496.016681:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258496.016686:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258496.016688:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258496.016693:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098248576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258506 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258496.016699:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098248576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258506 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258496.016728:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258496.016732:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734258496.016736:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000400:00000010:1.0:1734258496.016762:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258496.016773:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258496.016775:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258496.016784:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098248448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258512 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258496.016793:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098248448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258512 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258496.016813:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0200. 02000000:00000010:1.0:1734258496.016818:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:1.0:1734258496.016822:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000100:00000010:0.0:1734258501.020700:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258501.020723:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258501.020783:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258501.020789:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258501.020951:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734258501.020960:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258501.020967:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258501.020976:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098248704, portal 25 00000400:00000010:2.0:1734258501.020980:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258501.020983:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098248704, offset 0 00000400:00000200:2.0:1734258501.020995:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258501.021012:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258501.021019:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258501.021023:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258501.021026:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258501.021029:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258501.021032:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [675:675:256:4294967295] 192.168.202.108@tcp LPNI seq info [674:674:8:4294967295] 00000400:00000200:2.0:1734258501.021041:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258501.021047:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258501.021051:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258501.021059:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258501.021068:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258501.021072:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258501.021455:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258501.021458:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:2.0:1734258501.021462:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258501.021466:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258501.021470:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734258501.021472:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258501.021480:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098248704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258517 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258501.023011:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258501.023023:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258501.023031:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258501.023039:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098248832, portal 10 00000400:00000010:3.0:1734258501.023047:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734258501.023048:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098248832, offset 0 00000400:00000200:3.0:1734258501.023057:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258501.023071:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258501.023077:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258501.023081:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258501.023085:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258501.023087:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258501.023090:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [676:676:256:4294967295] 192.168.202.108@tcp LPNI seq info [675:675:8:4294967295] 00000400:00000200:3.0:1734258501.023099:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258501.023105:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258501.023110:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734258501.023115:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258501.023122:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258501.023126:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258501.023417:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258501.023421:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:2.0:1734258501.023426:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258501.023430:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258501.023449:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:2.0:1734258501.023451:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:2.0:1734258501.023458:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098248832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258511 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258501.023519:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258501.023531:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615000 00000400:00000200:0.0:1734258501.023544:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1609 [1] + 224 00000400:00000200:0.0:1734258501.023563:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258501.023565:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258501.023619:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098248704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258517 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258501.023843:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258501.023847:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258501.023848:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258501.023853:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098248704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258517 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258501.023860:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098248704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258517 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258501.023889:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734258501.023894:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734258501.023898:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000200:0.0:1734258501.025038:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258501.025053:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615080 00000400:00000200:0.0:1734258501.025059:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1611 [1] + 0 00000400:00000200:0.0:1734258501.025075:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258501.025079:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258501.025086:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098248832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258501.025146:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258501.025150:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258501.025151:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258501.025155:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098248832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258511 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258501.025162:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098248832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258511 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258501.025182:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258501.025185:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258501.025188:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258506.030706:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258506.030739:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258506.030812:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258506.030821:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734258506.030890:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734258506.030901:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d501b8. 00000400:00000010:0.0:1734258506.030909:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1000. 00000100:00000200:0.0:1734258506.030918:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098249088, portal 10 00000400:00000010:0.0:1734258506.030926:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000100:00000200:0.0:1734258506.030928:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098249088, offset 0 00000400:00000200:0.0:1734258506.030939:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258506.030953:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258506.030959:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258506.030962:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258506.030965:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258506.030968:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258506.030972:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [677:677:256:4294967295] 192.168.202.108@tcp LPNI seq info [676:676:8:4294967295] 00000400:00000200:0.0:1734258506.030980:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258506.031002:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258506.031005:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734258506.031012:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258506.031019:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258506.031023:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258506.031153:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258506.031155:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:0.0:1734258506.031159:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258506.031163:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258506.031167:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:0.0:1734258506.031168:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:0.0:1734258506.031176:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098249088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258516 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258506.031648:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258506.031654:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258506.031658:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258506.031662:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098248960, portal 25 00000400:00000010:3.0:1734258506.031664:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734258506.031665:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098248960, offset 0 00000400:00000200:3.0:1734258506.031670:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258506.031676:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258506.031679:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258506.031681:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258506.031682:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258506.031684:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258506.031686:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [678:678:256:4294967295] 192.168.202.108@tcp LPNI seq info [677:677:8:4294967295] 00000400:00000200:3.0:1734258506.031692:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258506.031696:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258506.031699:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734258506.031702:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258506.031707:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258506.031710:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258506.032173:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258506.032176:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734258506.032179:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258506.032182:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258506.032185:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734258506.032186:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734258506.032189:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098248960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258522 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258506.035967:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258506.035987:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615100 00000400:00000200:0.0:1734258506.035996:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1621 [1] + 224 00000400:00000200:0.0:1734258506.036007:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258506.036011:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258506.036021:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098248960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258506.036058:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258506.036062:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615180 00000400:00000200:0.0:1734258506.036079:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1619 [1] + 0 00000400:00000200:0.0:1734258506.036092:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258506.036094:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258506.036099:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098249088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258516 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258506.036194:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258506.036199:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258506.036201:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000400:00000010:1.0:1734258506.036206:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d501b8. 00000100:00000200:3.0:1734258506.036206:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098248960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258522 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258506.036211:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098248960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258522 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734258506.036212:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1000 00000400:00000010:1.0:1734258506.036213:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1000. 00000100:00000200:1.0:1734258506.036219:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098249088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258516 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258506.036234:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 00000100:00000200:1.0:1734258506.036236:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098249088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258516 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258506.036239:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258506.036242:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 02000000:00000010:1.0:1734258506.036256:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258506.036261:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734258506.036263:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:2.0:1734258511.036118:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734258511.036142:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 02000000:00000010:2.0:1734258511.036215:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734258511.036221:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258511.036229:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258511.036236:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098249216, portal 25 00000400:00000010:2.0:1734258511.036240:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258511.036242:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098249216, offset 0 00000400:00000200:2.0:1734258511.036251:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258511.036266:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000010:3.0:1734258511.036665:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734258511.036699:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806400. 02000000:00000010:1.0:1734258511.036845:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734258511.036853:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258511.036860:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258511.036867:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098249344, portal 10 00000400:00000010:1.0:1734258511.036874:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734258511.036877:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098249344, offset 0 00000400:00000200:2.0:1734258511.037778:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258511.037893:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258511.037972:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258511.037977:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258511.037979:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258511.037983:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [679:679:256:4294967295] 192.168.202.108@tcp LPNI seq info [678:678:8:4294967295] 00000400:00000200:2.0:1734258511.037994:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258511.038000:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258511.038007:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258511.038012:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258511.038015:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258511.038018:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258511.038020:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258511.038022:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [680:680:255:4294967295] 192.168.202.108@tcp LPNI seq info [679:679:7:4294967295] 00000800:00000010:2.0:1734258511.038025:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258511.038029:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258511.038031:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258511.038034:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258511.038039:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:2.0:1734258511.038039:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258511.038042:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258511.038044:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258511.038050:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258511.038053:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258511.038175:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258511.038178:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258511.038184:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258511.038189:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258511.038193:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734258511.038195:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734258511.038204:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098249216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258527 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258511.038277:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258511.038279:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734258511.038282:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258511.038285:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258511.038287:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:0.0:1734258511.038289:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734258511.038293:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098249344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258521 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258511.044990:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258511.045011:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615200 00000400:00000200:0.0:1734258511.045021:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1629 [1] + 224 00000400:00000200:0.0:1734258511.045034:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258511.045037:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258511.045048:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098249216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258527 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258511.045451:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258511.045456:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615280 00000400:00000200:0.0:1734258511.045475:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1631 [1] + 0 00000400:00000200:0.0:1734258511.045489:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258511.045492:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258511.045508:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098249344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258521 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258511.045947:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258511.045952:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258511.045954:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258511.045960:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098249216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258527 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258511.045966:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098249216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258527 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258511.045992:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258511.045997:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734258511.046001:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000400:00000010:1.0:1734258511.046298:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258511.046302:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258511.046303:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258511.046309:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098249344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258521 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258511.046335:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098249344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258521 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258511.046355:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734258511.046359:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806400. 00000100:00000010:1.0:1734258511.046362:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:0.0:1734258516.045530:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258516.045552:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258516.045649:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258516.045656:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734258516.045706:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734258516.045713:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50160. 00000400:00000010:0.0:1734258516.045719:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000100:00000200:0.0:1734258516.045726:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098249600, portal 10 00000400:00000010:0.0:1734258516.045732:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734258516.045733:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098249600, offset 0 00000400:00000200:0.0:1734258516.045745:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258516.045759:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258516.045764:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258516.045767:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258516.045771:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258516.045773:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258516.045778:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [681:681:256:4294967295] 192.168.202.108@tcp LPNI seq info [680:680:8:4294967295] 00000400:00000200:0.0:1734258516.045786:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258516.045790:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258516.045794:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734258516.045799:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258516.045811:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258516.045815:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258516.045926:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258516.045939:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:0.0:1734258516.045942:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258516.045946:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258516.045950:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:0.0:1734258516.045951:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734258516.045957:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098249600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258526 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258516.046035:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734258516.046039:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258516.046043:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258516.046045:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098249472, portal 25 00000400:00000010:1.0:1734258516.046048:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734258516.046050:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098249472, offset 0 00000400:00000200:1.0:1734258516.046054:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258516.046058:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258516.046061:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258516.046063:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258516.046064:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258516.046066:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258516.046067:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [682:682:256:4294967295] 192.168.202.108@tcp LPNI seq info [681:681:8:4294967295] 00000400:00000200:1.0:1734258516.046072:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258516.046076:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258516.046078:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734258516.046080:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258516.046084:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258516.046086:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258516.046697:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258516.046701:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734258516.046705:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258516.046709:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258516.046712:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:0.0:1734258516.046713:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:0.0:1734258516.046717:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098249472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258532 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258516.049118:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258516.049135:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615380 00000400:00000200:0.0:1734258516.049142:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1639 [1] + 0 00000400:00000200:0.0:1734258516.049151:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258516.049154:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258516.049163:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098249600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258526 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258516.049201:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258516.049205:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615300 00000400:00000200:0.0:1734258516.049209:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1641 [1] + 224 00000400:00000200:0.0:1734258516.049222:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258516.049224:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258516.049228:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098249472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258532 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258516.049322:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50160. 00000400:00000200:2.0:1734258516.049327:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:2.0:1734258516.049329:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:2.0:1734258516.049333:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098249600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258526 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258516.049340:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098249600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258526 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258516.049366:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258516.049370:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258516.049375:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:1.0:1734258516.049441:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258516.049444:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258516.049445:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258516.049450:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098249472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258532 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258516.049479:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098249472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258532 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258516.049490:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258516.049493:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734258516.049495:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:2.0:1734258521.053450:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734258521.053478:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 02000000:00000010:3.0:1734258521.054096:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258521.054105:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258521.054112:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258521.054120:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098249728, portal 25 00000400:00000010:3.0:1734258521.054125:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258521.054127:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098249728, offset 0 00000400:00000200:3.0:1734258521.054137:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258521.054152:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258521.054158:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258521.054162:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258521.054165:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258521.054167:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258521.054171:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [683:683:256:4294967295] 192.168.202.108@tcp LPNI seq info [682:682:8:4294967295] 00000400:00000200:3.0:1734258521.054178:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258521.054184:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258521.054188:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258521.054194:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258521.054202:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258521.054206:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258521.054353:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258521.054356:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:3.0:1734258521.054359:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258521.054364:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258521.054368:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258521.054369:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258521.054376:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098249728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258537 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734258521.054543:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734258521.054552:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734258521.055278:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258521.055284:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258521.055287:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258521.055304:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098249856, portal 10 00000400:00000010:3.0:1734258521.055309:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734258521.055311:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098249856, offset 0 00000400:00000200:3.0:1734258521.055316:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258521.055323:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258521.055326:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258521.055329:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258521.055331:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258521.055333:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258521.055335:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [684:684:256:4294967295] 192.168.202.108@tcp LPNI seq info [683:683:8:4294967295] 00000400:00000200:3.0:1734258521.055341:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258521.055345:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258521.055348:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258521.055351:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258521.055357:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258521.055359:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734258521.058343:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:1.0:1734258521.058363:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615400 00000800:00000200:0.0:1734258521.058368:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:1.0:1734258521.058370:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1649 [1] + 224 00000800:00000010:0.0:1734258521.058382:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734258521.058386:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258521.058389:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258521.058392:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258521.058392:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258521.058396:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734258521.058399:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734258521.058408:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098249856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258531 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258521.058408:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098249728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258537 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258521.058487:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258521.058491:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:3.0:1734258521.058492:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258521.058498:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098249728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258537 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258521.058505:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098249728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258537 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258521.058531:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258521.058535:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734258521.058540:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000400:00000200:0.0:1734258521.061486:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258521.061503:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615480 00000400:00000200:0.0:1734258521.061511:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1651 [1] + 0 00000400:00000200:0.0:1734258521.061532:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258521.061536:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258521.061547:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098249856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258531 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258521.063906:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258521.063917:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258521.063919:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258521.063931:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098249856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258531 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258521.063957:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098249856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258531 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258521.063989:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258521.063994:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734258521.064001:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:0.0:1734258526.059787:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258526.059810:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258526.059871:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258526.059878:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:0.0:1734258526.059917:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258526.059917:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:0.0:1734258526.059924:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50108. 00000400:00000010:2.0:1734258526.059924:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:0.0:1734258526.059930:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000400:00000010:2.0:1734258526.059936:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734258526.059937:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098250112, portal 10 00000400:00000010:0.0:1734258526.059943:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1088. 00000100:00000200:0.0:1734258526.059944:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098250112, offset 0 00000400:00000200:0.0:1734258526.059953:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258526.059967:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258526.059973:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258526.059977:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258526.059980:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258526.059982:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258526.059985:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [685:685:256:4294967295] 192.168.202.108@tcp LPNI seq info [684:684:8:4294967295] 00000400:00000200:0.0:1734258526.060000:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258526.060006:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258526.060009:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734258526.060015:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258526.060023:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258526.060026:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:2.0:1734258526.060107:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098249984, portal 25 00000400:00000010:2.0:1734258526.060110:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734258526.060111:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098249984, offset 0 00000400:00000200:2.0:1734258526.060117:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258526.060121:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258526.060124:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258526.060126:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258526.060128:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258526.060130:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258526.060132:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [686:686:255:4294967295] 192.168.202.108@tcp LPNI seq info [685:685:7:4294967295] 00000400:00000200:2.0:1734258526.060138:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258526.060142:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258526.060145:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258526.060147:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258526.060151:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258526.060154:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258526.060330:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258526.060333:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734258526.060339:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258526.060343:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258526.060347:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1088 00000400:00000010:1.0:1734258526.060348:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1088. 00000100:00000200:1.0:1734258526.060355:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098250112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258536 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258526.060449:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258526.060451:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734258526.060454:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258526.060457:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258526.060459:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:1.0:1734258526.060460:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:1.0:1734258526.060463:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098249984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258542 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258526.062057:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258526.062072:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615500 00000400:00000200:0.0:1734258526.062079:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1661 [1] + 224 00000400:00000200:0.0:1734258526.062097:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258526.062100:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258526.062107:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098249984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258542 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258526.062173:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258526.062178:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258526.062180:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258526.062185:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098249984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258542 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258526.062192:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098249984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258542 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258526.062213:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258526.062217:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734258526.062221:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734258526.062649:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258526.062655:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615580 00000400:00000200:0.0:1734258526.062661:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1659 [1] + 0 00000400:00000200:0.0:1734258526.062671:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258526.062674:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258526.062685:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098250112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258536 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258526.063196:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50108. 00000400:00000200:2.0:1734258526.063200:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:2.0:1734258526.063202:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:2.0:1734258526.063208:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098250112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258536 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258526.063229:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098250112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258536 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258526.063252:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258526.063255:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258526.063257:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258531.067664:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258531.067683:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 02000000:00000010:3.0:1734258531.069087:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258531.069096:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258531.069103:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258531.069109:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098250240, portal 25 00000400:00000010:3.0:1734258531.069114:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734258531.069116:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098250240, offset 0 00000400:00000200:3.0:1734258531.069124:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258531.069137:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258531.069142:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258531.069146:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258531.069149:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258531.069151:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258531.069154:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [687:687:256:4294967295] 192.168.202.108@tcp LPNI seq info [686:686:8:4294967295] 00000400:00000200:3.0:1734258531.069162:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258531.069167:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258531.069171:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734258531.069175:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258531.069183:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258531.069186:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734258531.069224:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258531.069233:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258531.070472:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258531.070479:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258531.070483:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258531.070486:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098250368, portal 10 00000400:00000010:2.0:1734258531.070491:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734258531.070492:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098250368, offset 0 00000400:00000200:2.0:1734258531.070497:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258531.070502:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258531.070505:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258531.070508:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258531.070510:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258531.070511:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258531.070513:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [688:688:255:4294967295] 192.168.202.108@tcp LPNI seq info [687:687:7:4294967295] 00000400:00000200:2.0:1734258531.070519:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258531.070522:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258531.070525:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258531.070528:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258531.070532:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258531.070534:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258531.071706:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258531.071723:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:1.0:1734258531.071728:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258531.071734:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258531.071740:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:1.0:1734258531.071742:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:1.0:1734258531.071750:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098250240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258547 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258531.071823:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258531.071825:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734258531.071828:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258531.071831:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258531.071833:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:1.0:1734258531.071835:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:1.0:1734258531.071839:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098250368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258541 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734258531.073811:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:2.0:1734258531.073827:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615600 00000400:00000200:2.0:1734258531.073834:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1669 [1] + 224 00000400:00000200:2.0:1734258531.073847:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258531.073854:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:2.0:1734258531.073863:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098250240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258547 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258531.074928:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258531.074938:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615680 00000400:00000200:0.0:1734258531.074945:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1671 [1] + 0 00000400:00000200:0.0:1734258531.074961:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258531.074964:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258531.074970:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098250368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258541 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258531.075272:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258531.075277:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258531.075279:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258531.075285:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098250368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258541 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258531.075291:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098250368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258541 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258531.075317:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258531.075323:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258531.075326:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:3.0:1734258531.075397:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258531.075401:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258531.075402:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258531.075407:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098250240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258547 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258531.075421:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098250240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258547 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258531.075432:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258531.075435:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734258531.075437:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734258536.076436:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258536.076454:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258536.076498:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258536.076503:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258536.076592:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258536.076598:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258536.076603:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258536.076608:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098250624, portal 10 00000400:00000010:2.0:1734258536.076613:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734258536.076615:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098250624, offset 0 00000400:00000200:2.0:1734258536.076621:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258536.076632:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258536.076636:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258536.076640:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258536.076642:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258536.076644:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258536.076646:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [689:689:256:4294967295] 192.168.202.108@tcp LPNI seq info [688:688:8:4294967295] 00000400:00000200:2.0:1734258536.076653:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258536.076657:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258536.076660:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258536.076664:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258536.076679:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258536.076682:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258536.076751:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258536.076754:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258536.076757:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258536.076759:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098250496, portal 25 00000400:00000010:3.0:1734258536.076761:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734258536.076763:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098250496, offset 0 00000400:00000200:3.0:1734258536.076766:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258536.076769:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258536.076771:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258536.076773:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258536.076775:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258536.076776:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258536.076778:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [690:690:255:4294967295] 192.168.202.108@tcp LPNI seq info [689:689:7:4294967295] 00000400:00000200:3.0:1734258536.076783:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258536.076786:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258536.076788:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734258536.076790:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258536.076793:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258536.076795:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258536.078014:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258536.078018:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258536.078023:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258536.078028:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258536.078033:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734258536.078035:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734258536.078043:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098250624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258546 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258536.078226:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258536.078228:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734258536.078231:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258536.078234:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258536.078236:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734258536.078238:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734258536.078241:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098250496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258552 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258536.082293:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258536.082325:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615700 00000400:00000200:0.0:1734258536.082333:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1681 [1] + 224 00000400:00000200:0.0:1734258536.082355:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258536.082358:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258536.082369:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098250496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258552 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258536.083830:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258536.083840:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615780 00000400:00000200:0.0:1734258536.083847:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1679 [1] + 0 00000400:00000200:0.0:1734258536.083860:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258536.083863:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258536.083870:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098250624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258536.083931:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258536.083936:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258536.083938:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258536.083942:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098250624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258546 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258536.083949:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098250624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258546 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258536.083977:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258536.083986:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258536.083990:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:3.0:1734258536.084315:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258536.084319:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258536.084320:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258536.084325:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098250496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258552 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258536.084342:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098250496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258552 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258536.084354:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258536.084358:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734258536.084360:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258541.083677:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258541.083696:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258541.083747:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258541.083753:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734258541.083839:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258541.083846:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258541.083852:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258541.083858:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098250752, portal 25 00000400:00000010:3.0:1734258541.083862:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734258541.083864:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098250752, offset 0 00000400:00000200:3.0:1734258541.083871:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258541.083881:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258541.083886:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258541.083889:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258541.083891:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258541.083894:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258541.083896:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [691:691:256:4294967295] 192.168.202.108@tcp LPNI seq info [690:690:8:4294967295] 00000400:00000200:3.0:1734258541.083904:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258541.083908:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258541.083913:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734258541.083917:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258541.083924:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258541.083927:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258541.084004:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258541.084009:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258541.084012:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258541.084014:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098250880, portal 10 00000400:00000010:2.0:1734258541.084018:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734258541.084020:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098250880, offset 0 00000400:00000200:2.0:1734258541.084024:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258541.084027:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258541.084029:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258541.084032:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258541.084033:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258541.084035:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258541.084036:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [692:692:255:4294967295] 192.168.202.108@tcp LPNI seq info [691:691:7:4294967295] 00000400:00000200:2.0:1734258541.084041:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258541.084045:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258541.084047:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258541.084049:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258541.084053:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258541.084066:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258541.084175:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258541.084178:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734258541.084183:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258541.084186:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258541.084190:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:0.0:1734258541.084191:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:0.0:1734258541.084198:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098250752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258557 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258541.084258:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258541.084259:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258541.084262:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258541.084273:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258541.084275:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734258541.084276:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734258541.084279:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098250880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258551 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258541.088618:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258541.088633:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615800 00000400:00000200:0.0:1734258541.088643:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1689 [1] + 224 00000400:00000200:0.0:1734258541.088654:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258541.088657:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258541.088666:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098250752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258541.088700:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258541.088703:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615880 00000400:00000200:0.0:1734258541.088707:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1691 [1] + 0 00000400:00000200:0.0:1734258541.088719:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258541.088721:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258541.088726:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098250880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258551 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258541.088738:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258541.088743:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258541.088745:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258541.088755:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098250752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258557 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258541.088771:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098250752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258557 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258541.088795:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258541.088800:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258541.088803:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:2.0:1734258541.089135:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258541.089139:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258541.089141:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258541.089146:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098250880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258551 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258541.089152:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098250880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258551 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258541.089168:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258541.089172:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258541.089175:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734258546.091685:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258546.091703:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 02000000:00000010:2.0:1734258546.092029:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734258546.092036:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258546.092042:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258546.092047:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098251008, portal 25 00000400:00000010:2.0:1734258546.092050:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734258546.092052:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098251008, offset 0 00000400:00000200:2.0:1734258546.092059:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258546.092070:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258546.092075:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258546.092078:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258546.092081:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258546.092083:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258546.092085:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [693:693:256:4294967295] 192.168.202.108@tcp LPNI seq info [692:692:8:4294967295] 00000400:00000200:2.0:1734258546.092092:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258546.092096:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258546.092100:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258546.092104:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258546.092112:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258546.092115:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734258546.092209:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258546.092216:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 00000800:00000200:1.0:1734258546.092360:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258546.092363:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734258546.092366:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258546.092370:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258546.092374:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:1.0:1734258546.092375:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:1.0:1734258546.092380:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098251008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258562 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258546.092944:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258546.092950:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cc60. 00000400:00000010:2.0:1734258546.092953:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734258546.092957:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098251136, portal 10 00000400:00000010:2.0:1734258546.092961:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734258546.092963:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098251136, offset 0 00000400:00000200:2.0:1734258546.092967:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258546.092974:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258546.092978:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258546.092981:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258546.092983:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258546.092985:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258546.092987:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [694:694:256:4294967295] 192.168.202.108@tcp LPNI seq info [693:693:8:4294967295] 00000400:00000200:2.0:1734258546.092994:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258546.092998:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258546.093001:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258546.093004:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258546.093009:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258546.093012:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258546.093367:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258546.093369:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258546.093372:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258546.093375:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258546.093378:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734258546.093379:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734258546.093384:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098251136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258556 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258546.096473:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258546.096489:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615900 00000400:00000200:0.0:1734258546.096496:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1699 [1] + 224 00000400:00000200:0.0:1734258546.096506:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258546.096509:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258546.096528:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098251008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258562 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258546.097135:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258546.097141:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615980 00000400:00000200:0.0:1734258546.097146:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x16a1 [1] + 0 00000400:00000200:0.0:1734258546.097158:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258546.097161:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258546.097166:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098251136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258556 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258546.097891:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258546.097897:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258546.097899:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258546.097904:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098251008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258562 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258546.097911:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098251008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258562 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258546.097932:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734258546.097936:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:2.0:1734258546.097939:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:3.0:1734258546.098004:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cc60. 00000400:00000200:3.0:1734258546.098008:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:3.0:1734258546.098009:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:3.0:1734258546.098012:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098251136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258556 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258546.098019:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098251136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258556 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258546.098034:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734258546.098038:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258546.098040:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258551.099699:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258551.099724:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258551.100171:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258551.100180:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258551.100414:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734258551.100437:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258551.100445:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258551.100490:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098251264, portal 25 00000400:00000010:2.0:1734258551.100496:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258551.100498:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098251264, offset 0 00000400:00000200:2.0:1734258551.100508:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258551.100521:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258551.100527:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258551.100530:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258551.100533:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258551.100536:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258551.100538:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [695:695:256:4294967295] 192.168.202.108@tcp LPNI seq info [694:694:8:4294967295] 00000400:00000200:2.0:1734258551.100547:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258551.100553:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258551.100556:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258551.100562:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258551.100591:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258551.100595:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258551.100921:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258551.100925:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258551.100929:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258551.100933:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258551.100937:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:1.0:1734258551.100939:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:1.0:1734258551.100945:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098251264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258567 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258551.101056:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258551.101061:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258551.101065:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258551.101067:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098251392, portal 10 00000400:00000010:3.0:1734258551.101072:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734258551.101073:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098251392, offset 0 00000400:00000200:3.0:1734258551.101077:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258551.101082:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258551.101084:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258551.101086:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258551.101088:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258551.101090:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258551.101092:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [696:696:256:4294967295] 192.168.202.108@tcp LPNI seq info [695:695:8:4294967295] 00000400:00000200:3.0:1734258551.101098:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258551.101108:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258551.101110:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734258551.101113:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258551.101116:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258551.101118:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258551.101200:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258551.101202:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734258551.101205:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258551.101207:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258551.101210:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734258551.101211:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734258551.101214:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098251392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258561 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258551.103635:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258551.103654:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615a00 00000400:00000200:0.0:1734258551.103662:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x16a9 [1] + 224 00000400:00000200:0.0:1734258551.103675:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258551.103678:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258551.103687:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098251264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258551.103724:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258551.103739:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615a80 00000400:00000200:0.0:1734258551.103744:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x16b1 [1] + 0 00000400:00000200:0.0:1734258551.103755:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258551.103758:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258551.103762:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098251392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258561 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258551.104089:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258551.104094:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258551.104096:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258551.104101:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098251264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258567 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258551.104107:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098251264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258567 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258551.104131:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734258551.104136:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:2.0:1734258551.104140:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:3.0:1734258551.104419:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258551.104423:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258551.104424:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258551.104429:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098251392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258561 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258551.104434:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098251392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258561 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258551.104452:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258551.104455:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258551.104458:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258556.108187:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258556.108215:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258556.108286:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258556.108295:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258556.108398:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734258556.108407:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258556.108428:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258556.108436:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098251520, portal 25 00000400:00000010:1.0:1734258556.108442:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734258556.108444:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098251520, offset 0 00000400:00000200:1.0:1734258556.108454:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258556.108469:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258556.108476:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258556.108480:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258556.108484:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258556.108487:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258556.108490:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [697:697:256:4294967295] 192.168.202.108@tcp LPNI seq info [696:696:8:4294967295] 00000400:00000200:1.0:1734258556.108499:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258556.108505:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258556.108509:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734258556.108515:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258556.108524:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258556.108529:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258556.108702:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258556.108705:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:1.0:1734258556.108708:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258556.108713:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258556.108716:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:1.0:1734258556.108718:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734258556.108724:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098251520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258572 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258556.108912:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258556.108917:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258556.108926:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258556.108929:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098251648, portal 10 00000400:00000010:2.0:1734258556.108935:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734258556.108936:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098251648, offset 0 00000400:00000200:2.0:1734258556.108940:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258556.108945:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258556.108947:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258556.108949:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258556.108951:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258556.108953:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258556.108954:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [698:698:256:4294967295] 192.168.202.108@tcp LPNI seq info [697:697:8:4294967295] 00000400:00000200:2.0:1734258556.108960:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258556.108964:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258556.108966:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258556.108969:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258556.108973:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258556.108975:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258556.109055:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258556.109057:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258556.109060:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258556.109063:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258556.109065:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734258556.109066:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734258556.109070:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098251648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258566 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258556.111028:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258556.111045:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615b00 00000400:00000200:0.0:1734258556.111053:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x16b9 [1] + 224 00000400:00000200:0.0:1734258556.111074:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258556.111078:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258556.111088:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098251520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258572 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258556.111273:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258556.111278:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258556.111280:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258556.111285:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098251520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258572 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258556.111292:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098251520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258572 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258556.111327:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734258556.111332:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734258556.111337:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734258556.112827:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258556.112841:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615b80 00000400:00000200:0.0:1734258556.112848:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x16c1 [1] + 0 00000400:00000200:0.0:1734258556.112866:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258556.112875:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258556.112883:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098251648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258566 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258556.114365:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258556.114374:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258556.114376:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258556.114386:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098251648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258566 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258556.114394:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098251648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258566 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258556.114431:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258556.114440:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258556.114445:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258561.116259:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258561.116289:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258561.116362:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258561.116370:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734258561.116418:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258561.116431:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258561.116439:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258561.116447:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098251776, portal 25 00000400:00000010:3.0:1734258561.116453:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734258561.116455:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098251776, offset 0 00000400:00000200:3.0:1734258561.116465:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258561.116480:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258561.116486:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258561.116490:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258561.116493:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258561.116495:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258561.116498:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [699:699:256:4294967295] 192.168.202.108@tcp LPNI seq info [698:698:8:4294967295] 00000400:00000200:3.0:1734258561.116507:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258561.116513:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258561.116528:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258561.116533:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258561.116541:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258561.116545:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258561.116673:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258561.116678:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734258561.116681:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258561.116690:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098251904, portal 10 00000400:00000010:2.0:1734258561.116695:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734258561.116696:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098251904, offset 0 00000400:00000200:2.0:1734258561.116700:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258561.116704:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258561.116706:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258561.116708:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258561.116710:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258561.116711:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258561.116713:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [700:700:255:4294967295] 192.168.202.108@tcp LPNI seq info [699:699:7:4294967295] 00000400:00000200:2.0:1734258561.116718:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258561.116720:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258561.116723:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258561.116725:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258561.116728:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258561.116730:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258561.117915:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258561.117922:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734258561.117929:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258561.117937:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258561.117944:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734258561.117946:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734258561.117961:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098251776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258577 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258561.118206:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258561.118208:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258561.118212:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258561.118215:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258561.118219:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734258561.118220:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734258561.118225:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098251904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258571 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258561.121442:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258561.121464:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615c00 00000400:00000200:0.0:1734258561.121474:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x16c9 [1] + 224 00000400:00000200:0.0:1734258561.121503:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258561.121509:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258561.121522:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098251776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258577 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258561.122029:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258561.122036:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258561.122039:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258561.122048:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098251776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258577 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258561.122057:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098251776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258577 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258561.122091:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258561.122099:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258561.122105:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000200:0.0:1734258561.122885:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258561.122914:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615c80 00000400:00000200:0.0:1734258561.122924:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x16d1 [1] + 0 00000400:00000200:0.0:1734258561.122943:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258561.122947:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258561.122955:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098251904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258571 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258561.123136:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734258561.123142:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:2.0:1734258561.123144:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258561.123150:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098251904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258571 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258561.123157:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098251904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258571 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258561.123181:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258561.123188:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258561.123193:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258566.123668:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258566.123688:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258566.123736:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258566.123740:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:0.0:1734258566.123770:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258566.123770:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734258566.123776:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:0.0:1734258566.123777:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50108. 00000400:00000010:0.0:1734258566.123781:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000400:00000010:2.0:1734258566.123781:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734258566.123787:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098252160, portal 10 00000400:00000010:0.0:1734258566.123790:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000100:00000200:0.0:1734258566.124335:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098252160, offset 0 00000400:00000200:0.0:1734258566.124345:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258566.124356:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258566.124360:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258566.124363:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258566.124366:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258566.124368:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258566.124370:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [701:701:256:4294967295] 192.168.202.108@tcp LPNI seq info [700:700:8:4294967295] 00000400:00000200:0.0:1734258566.124378:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258566.124382:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258566.124385:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734258566.124390:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258566.124396:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258566.124399:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:2.0:1734258566.124475:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098252032, portal 25 00000400:00000010:2.0:1734258566.124483:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734258566.124485:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098252032, offset 0 00000400:00000200:2.0:1734258566.124488:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258566.124492:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258566.124494:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258566.124496:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258566.124498:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258566.124499:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258566.124501:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [702:702:255:4294967295] 192.168.202.108@tcp LPNI seq info [701:701:7:4294967295] 00000400:00000200:2.0:1734258566.124506:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258566.124510:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258566.124513:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258566.124515:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258566.124518:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258566.124520:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258566.126110:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258566.126115:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:1.0:1734258566.126121:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258566.126126:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258566.126131:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:1.0:1734258566.126132:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:1.0:1734258566.126139:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098252160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258576 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258566.127014:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258566.127018:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734258566.127023:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258566.127028:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258566.127032:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:1.0:1734258566.127033:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:1.0:1734258566.127039:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098252032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258582 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258566.128291:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258566.128309:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615d80 00000400:00000200:0.0:1734258566.128317:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x16d9 [1] + 0 00000400:00000200:0.0:1734258566.128328:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258566.128332:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258566.128340:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098252160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258576 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258566.128377:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258566.128381:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615d00 00000400:00000200:0.0:1734258566.128387:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x16dd [1] + 224 00000400:00000200:0.0:1734258566.128405:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258566.128408:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258566.128412:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098252032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258582 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258566.128593:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50108. 00000400:00000200:2.0:1734258566.128598:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:2.0:1734258566.128600:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000100:00000200:2.0:1734258566.128606:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098252160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258576 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258566.128612:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098252160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258576 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258566.128640:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258566.128645:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258566.128648:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:3.0:1734258566.128714:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:3.0:1734258566.128718:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:3.0:1734258566.128719:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:3.0:1734258566.128724:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098252032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258582 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258566.128730:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098252032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258582 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258566.128740:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:3.0:1734258566.128743:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734258566.128744:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258571.131682:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258571.131700:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258571.131756:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258571.131762:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734258571.131797:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734258571.131802:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50160. 00000400:00000010:0.0:1734258571.131808:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734258571.131814:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098252416, portal 10 00000400:00000010:0.0:1734258571.131819:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734258571.131821:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098252416, offset 0 00000400:00000200:0.0:1734258571.131828:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258571.131839:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258571.131844:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258571.131847:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258571.131849:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258571.131861:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258571.131864:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [703:703:256:4294967295] 192.168.202.108@tcp LPNI seq info [702:702:8:4294967295] 00000400:00000200:0.0:1734258571.131872:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258571.131876:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258571.131879:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734258571.131884:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258571.131891:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258571.131895:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258571.131991:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258571.131996:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258571.131998:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258571.132001:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098252288, portal 25 00000400:00000010:3.0:1734258571.132003:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734258571.132005:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098252288, offset 0 00000400:00000200:3.0:1734258571.132009:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258571.132025:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258571.132027:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258571.132029:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258571.132042:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258571.132044:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258571.132046:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [704:704:255:4294967295] 192.168.202.108@tcp LPNI seq info [703:703:7:4294967295] 00000400:00000200:3.0:1734258571.132051:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258571.132054:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258571.132056:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734258571.132059:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258571.132062:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258571.132064:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258571.132256:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258571.132259:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:1.0:1734258571.132263:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258571.132268:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258571.132271:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:1.0:1734258571.132272:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:1.0:1734258571.132278:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098252416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258581 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258571.132330:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258571.132332:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:1.0:1734258571.132334:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258571.132337:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258571.132343:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:1.0:1734258571.132344:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:1.0:1734258571.132347:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098252288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258587 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258571.137105:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258571.137123:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615e80 00000400:00000200:0.0:1734258571.137131:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x16e9 [1] + 0 00000400:00000200:0.0:1734258571.137141:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258571.137145:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258571.138910:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098252416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258581 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258571.138964:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258571.138971:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615e00 00000400:00000200:0.0:1734258571.138977:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x16f1 [1] + 224 00000400:00000200:0.0:1734258571.138997:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258571.139000:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258571.139005:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098252288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258587 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258571.139099:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50160. 00000400:00000200:2.0:1734258571.139103:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:2.0:1734258571.139104:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:2.0:1734258571.139108:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098252416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258581 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258571.139125:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098252416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258581 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258571.139148:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734258571.139152:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258571.139155:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:3.0:1734258571.139667:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258571.139671:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258571.139672:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258571.139677:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098252288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258587 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258571.139683:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098252288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258587 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258571.139694:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258571.139698:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734258571.139699:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734258576.139756:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258576.139775:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258576.139827:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258576.139833:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258576.139938:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258576.139945:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000400:00000010:2.0:1734258576.139951:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258576.139958:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098252672, portal 10 00000400:00000010:2.0:1734258576.139963:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734258576.139965:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098252672, offset 0 00000400:00000200:2.0:1734258576.139976:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258576.139986:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258576.140002:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258576.140006:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258576.140008:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258576.140010:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258576.140013:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [705:705:256:4294967295] 192.168.202.108@tcp LPNI seq info [704:704:8:4294967295] 00000400:00000200:2.0:1734258576.140020:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258576.140025:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258576.140029:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258576.140034:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258576.140040:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258576.140043:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258576.140227:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258576.140238:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258576.140243:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258576.140248:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098252544, portal 25 00000400:00000010:3.0:1734258576.140251:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734258576.140253:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098252544, offset 0 00000400:00000200:3.0:1734258576.140260:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258576.140270:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258576.140274:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258576.140289:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258576.140291:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258576.140293:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258576.140295:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [706:706:255:4294967295] 192.168.202.108@tcp LPNI seq info [705:705:7:4294967295] 00000400:00000200:3.0:1734258576.140302:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258576.140306:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258576.140309:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734258576.140313:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258576.140319:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258576.140322:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258576.140434:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258576.140437:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258576.140450:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258576.140455:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258576.140459:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734258576.140460:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734258576.140466:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098252672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258586 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258576.140495:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258576.140497:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734258576.140499:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258576.140501:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258576.140502:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:0.0:1734258576.140503:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:0.0:1734258576.140507:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098252544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258592 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258576.144098:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258576.144114:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c615f00 00000400:00000200:0.0:1734258576.144121:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1701 [1] + 224 00000400:00000200:0.0:1734258576.144144:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258576.144148:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258576.144157:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098252544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258592 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258576.144419:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258576.144424:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258576.144426:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258576.144431:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098252544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258592 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258576.144437:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098252544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258592 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258576.144459:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258576.144464:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734258576.144467:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734258576.145113:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258576.145122:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c615f80 00000400:00000200:0.0:1734258576.145128:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x16f9 [1] + 0 00000400:00000200:0.0:1734258576.145141:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258576.145144:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258576.145151:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098252672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258586 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258576.145349:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:2.0:1734258576.145353:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734258576.145355:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258576.145359:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098252672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258586 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258576.145376:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098252672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258586 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258576.145393:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258576.145397:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258576.145399:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258581.147677:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258581.147704:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258581.147893:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258581.147899:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258581.147979:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734258581.147979:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:2.0:1734258581.147985:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000400:00000010:3.0:1734258581.147985:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:2.0:1734258581.147990:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000400:00000010:3.0:1734258581.147990:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734258581.147997:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098252928, portal 10 00000100:00000200:3.0:1734258581.148001:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098252800, portal 25 00000400:00000010:2.0:1734258581.148002:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000400:00000010:3.0:1734258581.148003:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:2.0:1734258581.148004:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098252928, offset 0 00000100:00000200:3.0:1734258581.148005:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098252800, offset 0 00000400:00000200:2.0:1734258581.148011:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258581.148016:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258581.148022:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258581.148026:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258581.148029:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258581.148032:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258581.148033:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258581.148035:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [707:707:256:4294967295] 192.168.202.108@tcp LPNI seq info [706:706:8:4294967295] 00000400:00000200:2.0:1734258581.148043:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258581.148047:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258581.148048:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734258581.148051:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:3.0:1734258581.148051:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258581.148053:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258581.148054:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734258581.148055:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258581.148061:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734258581.148062:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734258581.148063:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [708:708:255:4294967295] 192.168.202.108@tcp LPNI seq info [707:707:7:4294967295] 00000800:00000200:2.0:1734258581.148066:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734258581.148069:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258581.148073:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258581.148075:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734258581.148078:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258581.148081:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258581.148083:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258581.149437:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258581.149443:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258581.149449:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258581.149460:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258581.149465:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734258581.149466:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734258581.149474:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098252928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258591 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258581.150091:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258581.150094:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734258581.150097:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258581.150101:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258581.150104:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734258581.150105:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734258581.150109:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098252800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258597 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258581.154591:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258581.154608:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616080 00000400:00000200:0.0:1734258581.154614:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1709 [1] + 0 00000400:00000200:0.0:1734258581.154624:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258581.154627:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258581.154635:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098252928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258591 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258581.154756:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258581.154760:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616000 00000400:00000200:0.0:1734258581.154764:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x170d [1] + 224 00000400:00000200:0.0:1734258581.154781:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258581.154790:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258581.154794:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098252800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258597 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258581.154854:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258581.154858:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258581.154860:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258581.154865:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098252800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258597 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258581.154872:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098252800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258597 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258581.154894:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258581.154899:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258581.154902:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:2.0:1734258581.155076:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:2.0:1734258581.155080:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734258581.155081:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258581.155086:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098252928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258591 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258581.155101:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098252928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258591 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258581.155117:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258581.155122:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258581.155124:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258586.157442:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258586.157466:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258586.157525:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258586.157532:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:0.0:1734258586.157587:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734258586.157594:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d501b8. 02000000:00000010:3.0:1734258586.157596:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:0.0:1734258586.157599:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000400:00000010:3.0:1734258586.157600:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000100:00000200:0.0:1734258586.157605:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098253184, portal 10 00000400:00000010:3.0:1734258586.157605:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258586.157608:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098253056, portal 25 00000400:00000010:0.0:1734258586.157610:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000400:00000010:3.0:1734258586.157610:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734258586.157613:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098253184, offset 0 00000100:00000200:3.0:1734258586.157613:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098253056, offset 0 00000400:00000200:0.0:1734258586.157621:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258586.157641:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258586.157645:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258586.157649:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258586.157652:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258586.157654:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258586.157659:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [709:709:256:4294967295] 192.168.202.108@tcp LPNI seq info [708:708:8:4294967295] 00000400:00000200:3.0:1734258586.157660:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258586.157671:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258586.157680:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258586.157681:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258586.157683:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734258586.157684:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000400:00000200:3.0:1734258586.157686:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258586.157687:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:0.0:1734258586.157688:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258586.157689:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258586.157691:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [710:710:255:4294967295] 192.168.202.108@tcp LPNI seq info [709:709:7:4294967295] 00000800:00000200:0.0:1734258586.157697:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258586.157701:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734258586.157711:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258586.157714:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258586.157740:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734258586.157743:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258586.157747:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258586.157750:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258586.157859:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258586.157862:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734258586.157866:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258586.157869:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258586.157872:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:1.0:1734258586.157873:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:1.0:1734258586.157879:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098253184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258596 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258586.158055:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258586.158058:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:1.0:1734258586.158060:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258586.158063:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258586.158065:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:1.0:1734258586.158066:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:1.0:1734258586.158069:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098253056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258602 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258586.162214:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258586.162241:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616100 00000400:00000200:0.0:1734258586.162249:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x171d [1] + 224 00000400:00000200:0.0:1734258586.162273:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258586.162286:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258586.162297:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098253056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258602 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258586.162372:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258586.162376:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258586.162378:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258586.162382:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098253056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258602 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258586.162388:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098253056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258602 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258586.162407:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258586.162411:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734258586.162415:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734258586.164598:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258586.164615:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616180 00000400:00000200:0.0:1734258586.164623:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1719 [1] + 0 00000400:00000200:0.0:1734258586.164645:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258586.164649:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258586.164659:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098253184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258596 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258586.164883:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d501b8. 00000400:00000200:2.0:1734258586.164887:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:2.0:1734258586.164889:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:2.0:1734258586.164894:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098253184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258596 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258586.164901:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098253184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258596 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258586.164935:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258586.164941:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258586.164944:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258591.163755:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258591.163784:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258591.163841:0:7808:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258591.163849:0:7808:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258591.163961:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734258591.163970:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000400:00000010:2.0:1734258591.163978:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258591.163988:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098253312, portal 25 00000400:00000010:2.0:1734258591.163994:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734258591.164001:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098253312, offset 0 00000400:00000200:2.0:1734258591.164012:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258591.164030:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258591.164038:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258591.164042:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258591.164045:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258591.164048:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258591.164052:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [711:711:256:4294967295] 192.168.202.108@tcp LPNI seq info [710:710:8:4294967295] 00000400:00000200:2.0:1734258591.164061:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258591.164083:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 02000000:00000010:0.0:1734258591.164087:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000800:00000010:2.0:1734258591.164088:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000010:0.0:1734258591.164092:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50210. 00000800:00000200:2.0:1734258591.164094:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:0.0:1734258591.164095:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:0.0:1734258591.164098:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098253440, portal 10 00000400:00000010:0.0:1734258591.164102:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000800:00000200:2.0:1734258591.164102:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:0.0:1734258591.164104:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098253440, offset 0 00000800:00000200:2.0:1734258591.164106:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734258591.164108:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258591.164114:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258591.164116:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258591.164119:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258591.164121:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258591.164122:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258591.164125:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [712:712:255:4294967295] 192.168.202.108@tcp LPNI seq info [711:711:7:4294967295] 00000400:00000200:0.0:1734258591.164130:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258591.164134:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258591.164142:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734258591.164145:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258591.164148:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258591.164151:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258591.165111:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258591.165116:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258591.165121:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258591.165126:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258591.165131:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:1.0:1734258591.165133:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:1.0:1734258591.165140:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098253312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258607 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258591.165167:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258591.165169:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734258591.165171:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258591.165173:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258591.165175:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:1.0:1734258591.165186:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:1.0:1734258591.165191:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098253440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258601 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258591.168943:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258591.168968:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616200 00000400:00000200:0.0:1734258591.168979:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1729 [1] + 224 00000400:00000200:0.0:1734258591.169005:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258591.169008:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258591.169020:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098253312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258607 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258591.169116:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:2.0:1734258591.169122:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734258591.169130:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258591.169136:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098253312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258607 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258591.169145:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098253312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258607 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258591.169175:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734258591.169180:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734258591.169185:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000200:0.0:1734258591.171796:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258591.171822:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616280 00000400:00000200:0.0:1734258591.171833:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1731 [1] + 0 00000400:00000200:0.0:1734258591.171863:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258591.171867:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258591.171891:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098253440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258601 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258591.172143:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50210. 00000400:00000200:2.0:1734258591.172149:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:2.0:1734258591.172151:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:2.0:1734258591.172157:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098253440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258601 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258591.172164:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098253440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258601 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258591.172198:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258591.172203:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258591.172208:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258596.171719:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258596.171744:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258596.171807:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258596.171814:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258596.172326:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258596.172335:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258596.172343:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258596.172350:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098253568, portal 25 00000400:00000010:3.0:1734258596.172355:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734258596.172356:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098253568, offset 0 00000400:00000200:3.0:1734258596.172366:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258596.172380:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258596.172385:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258596.172388:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258596.172391:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258596.172393:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258596.172396:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [713:713:256:4294967295] 192.168.202.108@tcp LPNI seq info [712:712:8:4294967295] 00000400:00000200:3.0:1734258596.172404:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258596.172422:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258596.172425:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734258596.172431:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258596.172438:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258596.172441:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258596.172514:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258596.172518:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000400:00000010:2.0:1734258596.172522:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258596.172524:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098253696, portal 10 00000400:00000010:2.0:1734258596.172528:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258596.172534:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098253696, offset 0 00000400:00000200:2.0:1734258596.172537:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258596.172541:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258596.172543:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258596.172545:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258596.172546:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258596.172548:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258596.172550:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [714:714:255:4294967295] 192.168.202.108@tcp LPNI seq info [713:713:7:4294967295] 00000400:00000200:2.0:1734258596.172555:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258596.172558:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258596.172560:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258596.172562:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258596.172565:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258596.172589:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258596.172878:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258596.172881:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734258596.172886:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258596.172891:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258596.172894:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734258596.172896:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734258596.172904:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098253568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258612 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258596.172985:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258596.172987:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258596.172990:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258596.172993:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258596.172995:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734258596.172996:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734258596.173000:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098253696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258606 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258596.177519:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258596.177540:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616300 00000400:00000200:0.0:1734258596.177550:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1739 [1] + 224 00000400:00000200:0.0:1734258596.177599:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258596.177604:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258596.177614:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098253568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258612 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258596.177969:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258596.177980:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258596.177983:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258596.177993:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098253568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258612 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258596.178001:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098253568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258612 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258596.178029:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258596.178035:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734258596.178039:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734258596.179478:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258596.179493:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616380 00000400:00000200:0.0:1734258596.179501:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1741 [1] + 0 00000400:00000200:0.0:1734258596.179524:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258596.179528:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258596.179537:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098253696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258606 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258596.180031:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:2.0:1734258596.180041:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734258596.180044:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258596.180052:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098253696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258606 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258596.180061:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098253696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258606 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258596.180092:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258596.180101:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258596.180106:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258601.179714:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258601.179732:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258601.179789:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258601.179796:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734258601.179920:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258601.179927:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258601.179932:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258601.179937:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098253824, portal 25 00000400:00000010:3.0:1734258601.179941:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734258601.179942:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098253824, offset 0 00000400:00000200:3.0:1734258601.179949:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258601.179960:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258601.179965:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258601.179968:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258601.179971:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258601.179973:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258601.179975:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [715:715:256:4294967295] 192.168.202.108@tcp LPNI seq info [714:714:8:4294967295] 00000400:00000200:3.0:1734258601.179982:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258601.179988:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258601.180000:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734258601.180005:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258601.180013:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258601.180017:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258601.180105:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258601.180109:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000400:00000010:2.0:1734258601.180113:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258601.180115:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098253952, portal 10 00000400:00000010:2.0:1734258601.180119:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734258601.180120:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098253952, offset 0 00000400:00000200:2.0:1734258601.180129:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258601.180133:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258601.180135:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258601.180137:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258601.180139:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258601.180140:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258601.180142:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [716:716:255:4294967295] 192.168.202.108@tcp LPNI seq info [715:715:7:4294967295] 00000400:00000200:2.0:1734258601.180147:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258601.180150:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258601.180152:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258601.180155:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258601.180158:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258601.180160:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258601.180236:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258601.180238:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734258601.180246:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258601.180249:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258601.180252:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734258601.180254:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734258601.180260:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098253824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258617 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258601.180316:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258601.180319:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258601.180321:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258601.180324:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258601.180326:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734258601.180327:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734258601.180330:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098253952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258611 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258601.184053:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258601.184073:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616400 00000400:00000200:0.0:1734258601.184079:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1749 [1] + 224 00000400:00000200:0.0:1734258601.184100:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258601.184104:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258601.184115:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098253824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258617 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258601.185112:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258601.185120:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258601.185121:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258601.185128:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098253824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258617 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258601.185137:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098253824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258617 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258601.185158:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258601.185163:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734258601.185166:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000200:0.0:1734258601.185383:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258601.185392:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616480 00000400:00000200:0.0:1734258601.185399:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1751 [1] + 0 00000400:00000200:0.0:1734258601.185413:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258601.185416:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258601.185422:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098253952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258611 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258601.185505:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:2.0:1734258601.185508:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734258601.185509:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258601.185513:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098253952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258611 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258601.185520:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098253952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258611 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258601.185536:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258601.185539:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258601.185542:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258606.187913:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258606.187941:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258606.187993:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258606.187999:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734258606.188036:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734258606.188042:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50268. 00000400:00000010:0.0:1734258606.188048:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000100:00000200:0.0:1734258606.188053:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098254208, portal 10 00000400:00000010:0.0:1734258606.188058:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:0.0:1734258606.188060:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098254208, offset 0 00000400:00000200:0.0:1734258606.188067:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258606.188077:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258606.188081:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258606.188086:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258606.188089:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258606.188091:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258606.188093:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [717:717:256:4294967295] 192.168.202.108@tcp LPNI seq info [716:716:8:4294967295] 00000400:00000200:0.0:1734258606.188100:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258606.188105:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258606.188108:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734258606.188113:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258606.188120:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258606.188123:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734258606.188213:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734258606.188217:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000400:00000010:2.0:1734258606.188220:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734258606.188222:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098254080, portal 25 00000400:00000010:2.0:1734258606.188226:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734258606.188227:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098254080, offset 0 00000400:00000200:2.0:1734258606.188231:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258606.188239:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258606.188242:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258606.188244:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258606.188245:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258606.188247:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258606.188249:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [718:718:255:4294967295] 192.168.202.108@tcp LPNI seq info [717:717:7:4294967295] 00000400:00000200:2.0:1734258606.188255:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258606.188258:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258606.188260:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258606.188263:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258606.188267:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258606.188268:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258606.188346:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258606.188349:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734258606.188353:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258606.188356:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258606.188360:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:1.0:1734258606.188362:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:1.0:1734258606.188368:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098254208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258616 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258606.188421:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258606.188422:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734258606.188425:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258606.188428:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258606.188429:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:1.0:1734258606.188431:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:1.0:1734258606.188434:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098254080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258622 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258606.194535:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258606.194556:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616580 00000400:00000200:0.0:1734258606.194565:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1759 [1] + 0 00000400:00000200:0.0:1734258606.194606:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258606.194610:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258606.194621:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098254208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258616 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258606.194679:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258606.194683:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616500 00000400:00000200:0.0:1734258606.194689:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1761 [1] + 224 00000400:00000200:0.0:1734258606.194704:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258606.194707:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258606.194711:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098254080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258622 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258606.194968:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50268. 00000400:00000200:2.0:1734258606.194974:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:2.0:1734258606.194976:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:2.0:1734258606.194982:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098254208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258616 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258606.194988:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098254208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258616 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734258606.195009:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 00000400:00000010:3.0:1734258606.195097:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:3.0:1734258606.195108:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:3.0:1734258606.195110:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:3.0:1734258606.195121:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098254080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258622 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258606.195131:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098254080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258622 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258606.195153:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:3.0:1734258606.195158:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734258606.195161:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 02000000:00000010:2.0:1734258606.204419:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258606.204434:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258606.204438:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258611.197425:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258611.197446:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258611.197511:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258611.197518:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734258611.197559:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734258611.197565:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d502c0. 00000400:00000010:0.0:1734258611.197586:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734258611.197593:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098254464, portal 10 00000400:00000010:0.0:1734258611.197599:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734258611.197601:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098254464, offset 0 00000400:00000200:0.0:1734258611.197610:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258611.197622:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258611.197627:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258611.197631:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258611.197633:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258611.197635:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258611.197638:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [719:719:256:4294967295] 192.168.202.108@tcp LPNI seq info [718:718:8:4294967295] 00000400:00000200:0.0:1734258611.197645:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258611.197649:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258611.197652:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734258611.197657:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258611.197677:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258611.197680:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258611.197823:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258611.197828:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258611.197831:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258611.197834:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098254336, portal 25 00000400:00000010:3.0:1734258611.197836:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734258611.197838:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098254336, offset 0 00000400:00000200:3.0:1734258611.197842:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258611.197850:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258611.197852:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258611.197854:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258611.197856:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258611.197857:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258611.197859:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [720:720:255:4294967295] 192.168.202.108@tcp LPNI seq info [719:719:7:4294967295] 00000400:00000200:3.0:1734258611.197864:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258611.197866:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258611.197869:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734258611.197872:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258611.197875:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258611.197877:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258611.197962:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258611.197965:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734258611.197969:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258611.197972:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258611.197975:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:1.0:1734258611.197977:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:1.0:1734258611.197983:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098254464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258621 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258611.198041:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258611.198043:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:1.0:1734258611.198045:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258611.198048:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258611.198049:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:1.0:1734258611.198055:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:1.0:1734258611.198059:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098254336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258627 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258611.199924:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258611.199939:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616680 00000400:00000200:0.0:1734258611.199946:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1769 [1] + 0 00000400:00000200:0.0:1734258611.199966:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258611.199970:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258611.199979:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098254464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258621 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258611.202248:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258611.202259:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616600 00000400:00000200:0.0:1734258611.202268:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1771 [1] + 224 00000400:00000200:0.0:1734258611.202286:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258611.202290:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258611.202299:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098254336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258627 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258611.202881:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d502c0. 00000400:00000200:2.0:1734258611.202887:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:2.0:1734258611.202888:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:2.0:1734258611.202894:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098254464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258621 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258611.202901:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098254464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258621 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258611.202947:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258611.202952:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258611.202955:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:3.0:1734258611.203132:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258611.203137:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258611.203138:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258611.203143:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098254336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258627 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258611.203148:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098254336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258627 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258611.203158:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258611.203162:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734258611.203164:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258616.204041:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258616.204068:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258616.204142:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258616.204148:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258616.204254:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734258616.204263:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258616.204270:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258616.204278:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098254592, portal 25 00000400:00000010:1.0:1734258616.204282:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734258616.204284:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098254592, offset 0 00000400:00000200:1.0:1734258616.204293:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258616.204308:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258616.204314:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258616.204318:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258616.204322:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258616.204324:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258616.204327:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [721:721:256:4294967295] 192.168.202.108@tcp LPNI seq info [720:720:8:4294967295] 00000400:00000200:1.0:1734258616.204335:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258616.204341:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258616.204344:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734258616.204350:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258616.204358:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258616.204362:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258616.204392:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258616.204405:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:2.0:1734258616.204411:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258616.204417:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098254720, portal 10 00000400:00000010:2.0:1734258616.204423:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734258616.204425:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098254720, offset 0 00000400:00000200:2.0:1734258616.204433:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258616.204444:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258616.204449:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258616.204452:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258616.204455:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258616.204456:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258616.204459:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [722:722:255:4294967295] 192.168.202.108@tcp LPNI seq info [721:721:7:4294967295] 00000400:00000200:2.0:1734258616.204466:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258616.204470:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258616.204473:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258616.204478:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258616.204484:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258616.204487:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258616.205330:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258616.205334:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734258616.205339:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258616.205344:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258616.205348:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734258616.205350:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734258616.205359:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098254592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258632 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258616.205434:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258616.205449:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258616.205452:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258616.205456:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258616.205458:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734258616.205459:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734258616.205463:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098254720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258626 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258616.209811:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258616.209831:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616700 00000400:00000200:0.0:1734258616.209840:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1779 [1] + 224 00000400:00000200:0.0:1734258616.209852:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258616.209857:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258616.209866:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098254592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258632 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258616.209906:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258616.209911:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616780 00000400:00000200:0.0:1734258616.209916:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1781 [1] + 0 00000400:00000200:0.0:1734258616.209932:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258616.209935:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258616.209939:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098254720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258626 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258616.210204:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:2.0:1734258616.210209:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:2.0:1734258616.210211:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258616.210215:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098254720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258626 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258616.210222:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098254720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258626 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258616.210258:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258616.210263:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258616.210266:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:1.0:1734258616.210526:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258616.210531:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258616.210532:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258616.210538:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098254592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258632 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258616.210544:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098254592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258632 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258616.210556:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734258616.210565:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:1.0:1734258616.210601:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258621.213596:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258621.213614:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258621.213696:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:3.0:1734258621.213700:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 02000000:00000010:0.0:1734258621.213702:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 00000400:00000010:3.0:1734258621.213708:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258621.213713:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258621.213719:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098254848, portal 25 00000400:00000010:3.0:1734258621.213723:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258621.213725:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098254848, offset 0 00000400:00000200:3.0:1734258621.213734:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258621.213746:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258621.213750:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258621.213764:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258621.213768:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258621.213769:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258621.213772:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [723:723:256:4294967295] 192.168.202.108@tcp LPNI seq info [722:722:8:4294967295] 00000400:00000200:3.0:1734258621.213780:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258621.213786:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258621.213789:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734258621.213795:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258621.213802:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258621.213805:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258621.214210:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258621.214215:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:2.0:1734258621.214219:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258621.214221:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098254976, portal 10 00000400:00000010:2.0:1734258621.214226:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734258621.214227:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098254976, offset 0 00000400:00000200:2.0:1734258621.214231:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258621.214235:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258621.214238:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258621.214240:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258621.214242:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258621.214244:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258621.214246:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [724:724:255:4294967295] 192.168.202.108@tcp LPNI seq info [723:723:7:4294967295] 00000400:00000200:2.0:1734258621.214252:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258621.214255:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258621.214258:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258621.214261:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258621.214265:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258621.214267:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258621.214445:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258621.214447:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734258621.214451:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258621.214455:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258621.214458:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734258621.214464:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734258621.214470:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098254848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258637 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258621.214535:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258621.214537:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258621.214539:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258621.214542:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258621.214544:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734258621.214545:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734258621.214548:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098254976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258631 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258621.217109:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258621.217127:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616880 00000400:00000200:0.0:1734258621.217134:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1791 [1] + 0 00000400:00000200:0.0:1734258621.217151:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258621.217155:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258621.217165:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098254976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258631 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258621.217271:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:2.0:1734258621.217275:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:2.0:1734258621.217277:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258621.217282:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098254976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258631 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258621.217288:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098254976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258631 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258621.217323:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258621.217328:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258621.217332:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734258621.217512:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258621.217518:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616800 00000400:00000200:0.0:1734258621.217524:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1789 [1] + 224 00000400:00000200:0.0:1734258621.217533:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258621.217535:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258621.217539:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098254848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258637 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258621.217613:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258621.217617:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258621.217618:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258621.217622:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098254848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258637 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258621.217627:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098254848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258637 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258621.217639:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258621.217643:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734258621.217645:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258626.219716:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258626.219737:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258626.219790:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258626.219796:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734258626.219824:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258626.219832:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258626.219837:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 02000000:00000010:0.0:1734258626.219839:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734258626.219842:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50318. 00000100:00000200:3.0:1734258626.219842:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098255104, portal 25 00000400:00000010:0.0:1734258626.219846:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000400:00000010:3.0:1734258626.219846:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734258626.219848:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098255232, portal 10 00000100:00000200:3.0:1734258626.219849:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098255104, offset 0 00000400:00000010:0.0:1734258626.219852:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000400:00000200:3.0:1734258626.219856:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258626.219866:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258626.219870:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258626.219873:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258626.219876:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258626.219883:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258626.219886:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [725:725:256:4294967295] 192.168.202.108@tcp LPNI seq info [724:724:8:4294967295] 00000400:00000200:3.0:1734258626.219894:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258626.219899:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258626.219901:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734258626.219906:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258626.219913:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258626.219915:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258626.220028:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258626.220031:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:1.0:1734258626.220033:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258626.220037:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258626.220066:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098255232, offset 0 00000400:00000200:0.0:1734258626.220073:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258626.220077:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258626.220080:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258626.220082:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258626.220084:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258626.220085:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258626.220087:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [726:726:255:4294967295] 192.168.202.108@tcp LPNI seq info [725:725:7:4294967295] 00000400:00000200:0.0:1734258626.220092:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258626.220095:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258626.220097:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734258626.220100:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258626.220103:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258626.220105:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734258626.221647:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:1.0:1734258626.221653:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:1.0:1734258626.221665:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098255104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258626.221847:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258626.221850:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:1.0:1734258626.221853:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258626.221857:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258626.221860:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:1.0:1734258626.221861:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:1.0:1734258626.221865:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098255232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258636 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258626.222479:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258626.222490:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616900 00000400:00000200:0.0:1734258626.222496:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1799 [1] + 224 00000400:00000200:0.0:1734258626.222514:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258626.222517:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258626.222523:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098255104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258642 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258626.224046:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258626.224055:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258626.224057:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258626.224064:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098255104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258626.224073:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098255104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258642 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258626.224094:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258626.224098:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258626.224106:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734258626.224256:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258626.224267:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616980 00000400:00000200:0.0:1734258626.224272:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x179d [1] + 0 00000400:00000200:0.0:1734258626.224294:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258626.224297:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258626.224303:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098255232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258636 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258626.225997:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50318. 00000400:00000200:2.0:1734258626.226006:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:2.0:1734258626.226008:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:2.0:1734258626.226016:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098255232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258636 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258626.226025:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098255232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258636 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258626.226048:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258626.226052:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258626.226056:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258631.227671:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258631.227689:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 02000000:00000010:3.0:1734258631.228440:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258631.228447:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258631.228452:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258631.228457:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098255360, portal 25 00000400:00000010:3.0:1734258631.228461:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734258631.228462:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098255360, offset 0 00000400:00000200:3.0:1734258631.228470:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258631.228480:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258631.228485:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258631.228488:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258631.228490:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258631.228492:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258631.228495:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [727:727:256:4294967295] 192.168.202.108@tcp LPNI seq info [726:726:8:4294967295] 00000400:00000200:3.0:1734258631.228513:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258631.228519:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258631.228522:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734258631.228527:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258631.228534:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258631.228537:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734258631.228709:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258631.228716:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 00000800:00000200:1.0:1734258631.228820:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258631.228823:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:1.0:1734258631.228826:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258631.228829:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258631.228832:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:1.0:1734258631.228833:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:1.0:1734258631.228839:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098255360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258631.229438:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258631.229441:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734258631.229444:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734258631.229447:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098255488, portal 10 00000400:00000010:3.0:1734258631.229450:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734258631.229452:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098255488, offset 0 00000400:00000200:3.0:1734258631.229455:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258631.229459:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258631.229462:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258631.229464:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258631.229465:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258631.229467:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258631.229469:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [728:728:256:4294967295] 192.168.202.108@tcp LPNI seq info [727:727:8:4294967295] 00000400:00000200:3.0:1734258631.229474:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258631.229477:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258631.229478:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734258631.229480:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258631.229484:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258631.229486:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258631.229890:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258631.229893:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734258631.229896:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258631.229899:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258631.229902:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734258631.229903:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734258631.229907:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098255488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258641 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258631.233487:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258631.233503:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616a80 00000400:00000200:0.0:1734258631.233510:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x17b1 [1] + 0 00000400:00000200:0.0:1734258631.233527:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258631.233531:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258631.233541:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098255488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258641 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258631.234257:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734258631.234262:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:3.0:1734258631.234264:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734258631.234269:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098255488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258641 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258631.234284:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098255488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258641 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258631.234311:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258631.234315:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258631.234318:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734258631.234396:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258631.234404:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616a00 00000400:00000200:0.0:1734258631.234409:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x17a9 [1] + 224 00000400:00000200:0.0:1734258631.234420:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258631.234423:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258631.234428:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098255360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258647 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258631.235451:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258631.235456:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258631.235458:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258631.235463:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098255360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258631.235470:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098255360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258647 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258631.235483:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258631.235487:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734258631.235489:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258636.235725:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258636.235751:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258636.235818:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258636.235825:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258636.236022:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734258636.236032:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258636.236038:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258636.236046:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098255616, portal 25 00000400:00000010:1.0:1734258636.236051:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 00000100:00000200:1.0:1734258636.236053:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098255616, offset 0 00000400:00000200:1.0:1734258636.236079:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258636.236094:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258636.236100:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258636.236104:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258636.236107:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258636.236109:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258636.236112:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [729:729:256:4294967295] 192.168.202.108@tcp LPNI seq info [728:728:8:4294967295] 00000400:00000200:1.0:1734258636.236120:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258636.236126:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258636.236130:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734258636.236135:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258636.236143:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258636.236147:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258636.236883:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258636.236888:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734258636.236894:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258636.236901:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258636.236905:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:0.0:1734258636.236908:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:0.0:1734258636.236916:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098255616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258652 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258636.237272:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258636.237279:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:2.0:1734258636.237283:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258636.237287:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098255744, portal 10 00000400:00000010:2.0:1734258636.237294:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734258636.237296:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098255744, offset 0 00000400:00000200:2.0:1734258636.237301:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258636.237308:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258636.237313:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258636.237316:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258636.237319:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258636.237321:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258636.237323:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [730:730:256:4294967295] 192.168.202.108@tcp LPNI seq info [729:729:8:4294967295] 00000400:00000200:2.0:1734258636.237330:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258636.237333:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258636.237336:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258636.237349:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258636.237356:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258636.237359:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258636.237504:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258636.237506:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258636.237510:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258636.237514:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258636.237516:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734258636.237517:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734258636.237521:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098255744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258646 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258636.240269:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258636.240292:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616b00 00000400:00000200:0.0:1734258636.240300:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x17b9 [1] + 224 00000400:00000200:0.0:1734258636.240322:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258636.240326:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258636.240336:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098255616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258652 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258636.241427:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258636.241438:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258636.241441:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258636.241451:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098255616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258652 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258636.241460:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098255616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258652 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258636.241487:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734258636.241493:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734258636.241496:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734258636.242490:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258636.242502:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616b80 00000400:00000200:0.0:1734258636.242519:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x17c1 [1] + 0 00000400:00000200:0.0:1734258636.242542:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258636.242546:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258636.242554:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098255744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258646 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258636.244304:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:2.0:1734258636.244313:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:2.0:1734258636.244315:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258636.244324:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098255744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258646 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258636.244332:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098255744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258646 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258636.244357:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258636.244362:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258636.244366:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734258641.243705:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258641.243724:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258641.243878:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258641.243886:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258641.243979:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258641.243987:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258641.243992:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258641.243999:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098255872, portal 25 00000400:00000010:3.0:1734258641.244003:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734258641.244005:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098255872, offset 0 00000400:00000200:3.0:1734258641.244013:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258641.244025:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258641.244029:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258641.244033:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258641.244036:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258641.244038:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258641.244041:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [731:731:256:4294967295] 192.168.202.108@tcp LPNI seq info [730:730:8:4294967295] 00000400:00000200:3.0:1734258641.244048:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258641.244066:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258641.244069:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734258641.244074:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258641.244080:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258641.244084:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734258641.244173:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258641.244178:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:2.0:1734258641.244185:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258641.244188:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098256000, portal 10 00000400:00000010:2.0:1734258641.244192:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734258641.244193:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098256000, offset 0 00000400:00000200:2.0:1734258641.244197:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258641.244201:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258641.244203:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258641.244205:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258641.244207:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258641.244209:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258641.244211:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [732:732:255:4294967295] 192.168.202.108@tcp LPNI seq info [731:731:7:4294967295] 00000400:00000200:2.0:1734258641.244216:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258641.244219:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258641.244222:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258641.244225:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258641.244234:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258641.244236:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258641.244354:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258641.244357:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734258641.244361:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258641.244364:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258641.244367:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734258641.244369:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734258641.244375:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098255872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258657 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258641.244434:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258641.244436:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258641.244439:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258641.244441:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258641.244443:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734258641.244444:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734258641.244447:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098256000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258651 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258641.246743:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258641.246762:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616c00 00000400:00000200:0.0:1734258641.246769:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x17c9 [1] + 224 00000400:00000200:0.0:1734258641.246790:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258641.246794:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258641.246810:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098255872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258657 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258641.246913:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258641.246918:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258641.246920:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258641.246925:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098255872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258657 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258641.246932:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098255872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258657 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258641.246966:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258641.246972:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734258641.246976:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734258641.247755:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258641.247764:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616c80 00000400:00000200:0.0:1734258641.247771:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x17d1 [1] + 0 00000400:00000200:0.0:1734258641.247783:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258641.247787:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258641.247793:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098256000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258651 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258641.249076:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:2.0:1734258641.249085:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:2.0:1734258641.249087:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258641.249094:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098256000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258651 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258641.249102:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098256000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258651 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258641.249125:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258641.249131:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258641.249134:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258646.252898:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258646.252917:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258646.252973:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258646.252980:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734258646.253020:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734258646.253025:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50370. 00000400:00000010:0.0:1734258646.253031:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734258646.253036:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098256256, portal 10 00000400:00000010:0.0:1734258646.253042:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734258646.253043:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098256256, offset 0 00000400:00000200:0.0:1734258646.253051:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258646.253063:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258646.253067:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258646.253071:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258646.253074:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258646.253075:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258646.253078:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [733:733:256:4294967295] 192.168.202.108@tcp LPNI seq info [732:732:8:4294967295] 00000400:00000200:0.0:1734258646.253084:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258646.253089:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258646.253092:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734258646.253107:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258646.253114:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258646.253119:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258646.253363:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258646.253366:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734258646.253369:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258646.253373:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258646.253376:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:1.0:1734258646.253378:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:1.0:1734258646.253384:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098256256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258656 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258646.253477:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734258646.253482:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:2.0:1734258646.253485:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258646.253487:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098256128, portal 25 00000400:00000010:2.0:1734258646.253490:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734258646.253492:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098256128, offset 0 00000400:00000200:2.0:1734258646.253496:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258646.253500:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258646.253503:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258646.253505:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258646.253507:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258646.253509:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258646.253511:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [734:734:256:4294967295] 192.168.202.108@tcp LPNI seq info [733:733:8:4294967295] 00000400:00000200:2.0:1734258646.253521:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258646.253525:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258646.253527:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258646.253530:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258646.253534:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258646.253540:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258646.253631:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258646.253633:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258646.253636:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258646.253639:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258646.253641:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:0.0:1734258646.253643:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734258646.253646:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098256128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258662 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258646.255366:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258646.255380:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616d00 00000400:00000200:0.0:1734258646.255387:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x17e1 [1] + 224 00000400:00000200:0.0:1734258646.255395:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258646.255398:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258646.255406:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098256128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258662 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258646.258169:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258646.258182:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616d80 00000400:00000200:0.0:1734258646.258189:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x17d9 [1] + 0 00000400:00000200:0.0:1734258646.258208:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258646.258211:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258646.258220:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098256256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258656 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258646.258772:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:2.0:1734258646.258777:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:2.0:1734258646.258778:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258646.258784:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098256128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258662 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258646.258790:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098256128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258662 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258646.258810:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734258646.258814:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:2.0:1734258646.258817:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:1.0:1734258646.260142:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50370. 00000400:00000200:1.0:1734258646.260151:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:1.0:1734258646.260152:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:1.0:1734258646.260158:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098256256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258656 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258646.260165:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098256256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258656 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258646.260182:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258646.260187:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734258646.260189:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734258651.259678:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258651.259697:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258651.259749:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258651.259754:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734258651.259830:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258651.259837:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258651.259842:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258651.259849:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098256512, portal 10 02000000:00000010:2.0:1734258651.259853:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:1.0:1734258651.259854:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734258651.259856:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098256512, offset 0 00000400:00000010:2.0:1734258651.259858:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000200:1.0:1734258651.259863:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734258651.259867:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258651.259870:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098256384, portal 25 00000400:00000200:1.0:1734258651.259873:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734258651.259873:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734258651.259874:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098256384, offset 0 00000400:00000200:1.0:1734258651.259878:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258651.259879:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258651.259881:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258651.259884:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258651.259886:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258651.259888:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [735:735:256:4294967295] 192.168.202.108@tcp LPNI seq info [734:734:8:4294967295] 00000400:00000200:1.0:1734258651.259895:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258651.259900:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258651.259904:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734258651.259908:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258651.259914:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258651.259917:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734258651.260075:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258651.260078:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258651.260080:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258651.260082:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258651.260083:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258651.260085:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [736:736:255:4294967295] 192.168.202.108@tcp LPNI seq info [735:735:7:4294967295] 00000400:00000200:2.0:1734258651.260091:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258651.260094:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258651.260097:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258651.260100:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258651.260104:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258651.260106:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258651.260515:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258651.260518:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734258651.260522:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258651.260525:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258651.260529:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:0.0:1734258651.260530:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:0.0:1734258651.260536:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098256512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258661 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258651.260607:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258651.260609:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258651.260611:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258651.260614:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258651.260615:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734258651.260616:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734258651.260619:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098256384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258667 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258651.265287:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258651.265304:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616e00 00000400:00000200:0.0:1734258651.265311:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x17f1 [1] + 224 00000400:00000200:0.0:1734258651.265330:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258651.265335:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258651.265345:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098256384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258667 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258651.265496:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:2.0:1734258651.265501:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:2.0:1734258651.265502:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258651.265507:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098256384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258667 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258651.265513:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098256384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258667 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258651.265533:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734258651.265537:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734258651.265540:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734258651.265960:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258651.265967:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616e80 00000400:00000200:0.0:1734258651.265972:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x17e9 [1] + 0 00000400:00000200:0.0:1734258651.265983:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258651.265986:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258651.265990:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098256512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258661 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258651.266606:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258651.266611:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258651.266612:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258651.266617:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098256512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258661 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258651.266624:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098256512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258661 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258651.266641:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258651.266645:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734258651.266648:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258656.267689:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258656.267706:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258656.267763:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258656.267769:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734258656.267799:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258656.267800:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0200. 00000400:00000010:0.0:1734258656.267805:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d503c8. 00000400:00000010:1.0:1734258656.267805:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:0.0:1734258656.267811:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000400:00000010:1.0:1734258656.267811:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258656.267816:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098256640, portal 25 00000400:00000010:1.0:1734258656.267820:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:0.0:1734258656.267994:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098256768, portal 10 00000100:00000200:1.0:1734258656.267996:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098256640, offset 0 00000400:00000010:0.0:1734258656.268000:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000400:00000200:1.0:1734258656.268005:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734258656.268009:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098256768, offset 0 00000400:00000200:0.0:1734258656.268014:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258656.268016:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258656.268021:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258656.268025:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258656.268027:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258656.268029:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258656.268031:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [737:737:256:4294967295] 192.168.202.108@tcp LPNI seq info [736:736:8:4294967295] 00000400:00000200:1.0:1734258656.268037:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258656.268041:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258656.268043:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258656.268045:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734258656.268046:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734258656.268047:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258656.268048:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258656.268050:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734258656.268050:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734258656.268052:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [738:738:255:4294967295] 192.168.202.108@tcp LPNI seq info [737:737:7:4294967295] 00000400:00000200:0.0:1734258656.268057:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258656.268057:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258656.268059:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258656.268061:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258656.268063:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000800:00000200:0.0:1734258656.268066:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258656.268069:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258656.268071:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258656.268858:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258656.268863:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:2.0:1734258656.268868:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258656.268873:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258656.268877:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:2.0:1734258656.268879:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:2.0:1734258656.268886:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098256640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258672 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258656.268948:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258656.268950:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:2.0:1734258656.268952:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258656.268955:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258656.268957:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:2.0:1734258656.268958:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:2.0:1734258656.268961:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098256768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258666 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258656.272639:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258656.272657:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c616f80 00000400:00000200:0.0:1734258656.272664:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x17fd [1] + 0 00000400:00000200:0.0:1734258656.272673:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258656.272677:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258656.272695:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098256768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258656.272736:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258656.272741:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c616f00 00000400:00000200:0.0:1734258656.272745:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x17f9 [1] + 224 00000400:00000200:0.0:1734258656.272759:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258656.272762:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258656.272766:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098256640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258672 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258656.272974:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258656.272983:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258656.272985:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258656.272990:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098256640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258672 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258656.272996:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098256640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258672 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258656.273016:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0200. 02000000:00000010:1.0:1734258656.273020:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734258656.273023:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:2.0:1734258656.273087:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d503c8. 00000400:00000200:2.0:1734258656.273091:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:2.0:1734258656.273092:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:2.0:1734258656.273096:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098256768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258666 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258656.273102:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098256768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258666 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258656.273123:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258656.273126:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258656.273128:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258661.275722:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258661.275740:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258661.276628:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258661.276639:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258661.276677:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0200. 00000400:00000010:1.0:1734258661.276684:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258661.276691:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258661.276697:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098256896, portal 25 00000400:00000010:1.0:1734258661.276701:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734258661.276702:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098256896, offset 0 00000400:00000200:1.0:1734258661.276709:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258661.276721:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258661.276725:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258661.276728:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258661.276731:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258661.276733:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258661.276736:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [739:739:256:4294967295] 192.168.202.108@tcp LPNI seq info [738:738:8:4294967295] 00000400:00000200:1.0:1734258661.276743:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258661.276748:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258661.276752:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734258661.276756:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258661.276763:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258661.276771:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258661.276826:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258661.276838:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258661.276844:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258661.276849:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098257024, portal 10 00000400:00000010:3.0:1734258661.276855:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734258661.276857:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098257024, offset 0 00000400:00000200:3.0:1734258661.276864:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258661.276874:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258661.276879:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258661.276882:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258661.276884:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258661.276886:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258661.276889:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [740:740:255:4294967295] 192.168.202.108@tcp LPNI seq info [739:739:7:4294967295] 00000400:00000200:3.0:1734258661.276897:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258661.276902:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734258661.276908:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258661.276911:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734258661.276914:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258661.276918:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258661.276922:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000800:00000010:3.0:1734258661.276922:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000400:00000010:0.0:1734258661.276923:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000800:00000200:3.0:1734258661.276927:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:0.0:1734258661.276929:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098256896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258677 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734258661.276934:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258661.276937:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258661.276952:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258661.276954:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734258661.276956:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258661.276959:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258661.276960:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734258661.276962:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734258661.276965:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098257024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258671 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258661.281270:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258661.281297:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617000 00000400:00000200:0.0:1734258661.281305:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1809 [1] + 224 00000400:00000200:0.0:1734258661.281322:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258661.281325:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258661.281334:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098256896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258677 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258661.283941:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258661.283953:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617080 00000400:00000200:0.0:1734258661.283960:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1811 [1] + 0 00000400:00000200:0.0:1734258661.283981:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258661.283985:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258661.283995:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098257024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258671 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258661.284294:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258661.284298:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258661.284301:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258661.284315:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098256896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258677 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258661.284321:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098256896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258677 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258661.284352:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 02000000:00000010:1.0:1734258661.284353:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0200. 00000400:00000200:3.0:1734258661.284357:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258661.284358:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 02000000:00000010:1.0:1734258661.284359:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734258661.284362:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000200:3.0:1734258661.284363:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098257024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258671 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258661.284370:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098257024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258671 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258661.284388:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258661.284391:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:3.0:1734258661.284395:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734258666.283698:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258666.283723:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258666.283782:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258666.283788:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734258666.283842:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734258666.283849:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50420. 00000400:00000010:0.0:1734258666.283856:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:0.0:1734258666.283863:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098257280, portal 10 00000400:00000010:0.0:1734258666.283868:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000100:00000200:0.0:1734258666.283870:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098257280, offset 0 00000400:00000200:0.0:1734258666.283878:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258666.283891:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258666.283895:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258666.283899:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258666.283902:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258666.283904:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258666.283924:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [741:741:256:4294967295] 192.168.202.108@tcp LPNI seq info [740:740:8:4294967295] 00000400:00000200:0.0:1734258666.283932:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258666.283938:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258666.283941:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734258666.283946:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258666.283954:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258666.283957:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258666.284068:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258666.284077:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258666.284080:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258666.284083:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098257152, portal 25 00000400:00000010:3.0:1734258666.284085:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734258666.284086:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098257152, offset 0 00000400:00000200:3.0:1734258666.284090:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258666.284094:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258666.284097:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258666.284098:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258666.284100:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258666.284102:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258666.284104:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [742:742:255:4294967295] 192.168.202.108@tcp LPNI seq info [741:741:7:4294967295] 00000400:00000200:3.0:1734258666.284109:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258666.284346:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258666.284349:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734258666.284357:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258666.284361:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258666.284363:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258666.284484:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258666.284487:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734258666.284491:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258666.284495:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258666.284499:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:1.0:1734258666.284501:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:1.0:1734258666.284507:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098257280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258676 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258666.284777:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258666.284779:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:1.0:1734258666.284781:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258666.284784:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258666.284786:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:1.0:1734258666.284788:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734258666.284791:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098257152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258682 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258666.288682:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258666.288709:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617100 00000400:00000200:0.0:1734258666.288719:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1821 [1] + 224 00000400:00000200:0.0:1734258666.288731:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258666.288734:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258666.288746:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098257152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258666.288783:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258666.288787:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617180 00000400:00000200:0.0:1734258666.288791:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1819 [1] + 0 00000400:00000200:0.0:1734258666.288815:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258666.288818:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258666.288823:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098257280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258676 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258666.289133:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50420. 00000400:00000200:1.0:1734258666.289143:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:1.0:1734258666.289145:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000400:00000010:3.0:1734258666.289151:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000100:00000200:1.0:1734258666.289156:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098257280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258676 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734258666.289157:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258666.289158:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258666.289164:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098257152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258682 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258666.289166:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098257280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258676 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258666.289170:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098257152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258682 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258666.289188:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:3.0:1734258666.289188:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258666.289193:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734258666.289197:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 02000000:00000010:1.0:1734258666.289202:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258666.289204:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258671.291848:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258671.291878:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258671.291954:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258671.291961:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258671.292085:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258671.292100:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258671.292108:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 02000000:00000010:3.0:1734258671.292108:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000100:00000200:1.0:1734258671.292115:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098257536, portal 10 00000400:00000010:3.0:1734258671.292115:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258671.292120:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000010:1.0:1734258671.292122:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:3.0:1734258671.292126:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098257408, portal 25 00000100:00000200:1.0:1734258671.292127:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098257536, offset 0 00000400:00000010:3.0:1734258671.292130:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000400:00000200:1.0:1734258671.292137:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258671.292153:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258671.292158:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258671.292162:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258671.292166:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258671.292168:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258671.292171:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [743:743:256:4294967295] 192.168.202.108@tcp LPNI seq info [742:742:8:4294967295] 00000400:00000200:1.0:1734258671.292180:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258671.292186:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258671.292190:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734258671.292195:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258671.292203:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258671.292207:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:3.0:1734258671.292217:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098257408, offset 0 00000400:00000200:3.0:1734258671.292225:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258671.292243:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258671.292248:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258671.292252:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258671.292255:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258671.292257:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258671.292259:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [744:744:255:4294967295] 192.168.202.108@tcp LPNI seq info [743:743:7:4294967295] 00000400:00000200:3.0:1734258671.292295:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258671.292300:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258671.292303:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734258671.292308:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258671.292313:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258671.292332:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258671.292947:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258671.292952:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734258671.292959:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258671.292972:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258671.292978:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:0.0:1734258671.292980:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:0.0:1734258671.292989:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098257536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258681 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258671.293075:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258671.293077:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734258671.293080:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258671.293083:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258671.293085:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734258671.293086:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734258671.293090:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098257408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258687 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258671.296621:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258671.296646:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617280 00000400:00000200:0.0:1734258671.296658:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1829 [1] + 0 00000400:00000200:0.0:1734258671.296689:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258671.296694:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258671.296707:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098257536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258681 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258671.297322:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258671.297328:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258671.297331:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258671.297336:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098257536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258681 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258671.297344:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098257536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258681 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258671.297379:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258671.297385:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734258671.297405:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734258671.297657:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258671.297667:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617200 00000400:00000200:0.0:1734258671.297674:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x182d [1] + 224 00000400:00000200:0.0:1734258671.297686:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258671.297690:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258671.297696:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098257408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258671.297884:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258671.297888:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258671.297889:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258671.297894:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098257408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258687 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258671.297900:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098257408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258687 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258671.297912:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258671.297917:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734258671.297919:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258676.299710:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258676.299735:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258676.299812:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258676.299819:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734258676.299870:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734258676.299876:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50478. 00000400:00000010:0.0:1734258676.299884:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734258676.299892:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098257792, portal 10 00000400:00000010:0.0:1734258676.299899:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734258676.299901:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098257792, offset 0 00000400:00000200:0.0:1734258676.299911:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258676.299925:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258676.299931:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258676.299934:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258676.299938:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258676.299940:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258676.299943:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [745:745:256:4294967295] 192.168.202.108@tcp LPNI seq info [744:744:8:4294967295] 00000400:00000200:0.0:1734258676.299952:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258676.299958:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258676.299961:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734258676.299967:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258676.299975:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258676.299979:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734258676.300042:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734258676.300047:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258676.300050:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258676.300053:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098257664, portal 25 00000400:00000010:1.0:1734258676.300055:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734258676.300056:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098257664, offset 0 00000400:00000200:1.0:1734258676.300059:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258676.300064:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258676.300066:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258676.300068:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258676.300069:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258676.300071:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258676.300073:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [746:746:255:4294967295] 192.168.202.108@tcp LPNI seq info [745:745:7:4294967295] 00000400:00000200:1.0:1734258676.300078:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258676.300081:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258676.300082:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734258676.300086:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258676.300089:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258676.300091:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258676.300101:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258676.300103:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:0.0:1734258676.300106:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258676.300110:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258676.300114:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:0.0:1734258676.300115:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734258676.300122:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098257792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258686 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258676.300150:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258676.300151:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734258676.300158:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258676.300161:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258676.300163:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:0.0:1734258676.300164:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:0.0:1734258676.300167:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098257664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258692 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258676.303624:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258676.303646:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617380 00000400:00000200:0.0:1734258676.303654:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1839 [1] + 0 00000400:00000200:0.0:1734258676.303667:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258676.303671:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258676.303681:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098257792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258686 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258676.303724:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258676.303729:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617300 00000400:00000200:0.0:1734258676.303733:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1841 [1] + 224 00000400:00000200:0.0:1734258676.303753:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258676.303756:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:2.0:1734258676.303760:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50478. 00000400:00000200:2.0:1734258676.303766:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:2.0:1734258676.303769:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734258676.303775:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098257664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258676.303775:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098257792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258686 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258676.303783:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098257792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258686 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258676.303813:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258676.303819:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258676.303823:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:1.0:1734258676.303901:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258676.303905:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258676.303906:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258676.303910:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098257664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258692 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258676.303917:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098257664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258692 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258676.303928:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258676.303931:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734258676.303933:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258681.307897:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258681.307917:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258681.307974:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258681.307980:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258681.308016:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734258681.308023:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258681.308028:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258681.308034:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098257920, portal 25 00000400:00000010:1.0:1734258681.308038:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000100:00000200:1.0:1734258681.308040:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098257920, offset 0 00000400:00000200:1.0:1734258681.308048:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258681.308058:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258681.308063:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258681.308066:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258681.308069:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258681.308071:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258681.308073:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [747:747:256:4294967295] 192.168.202.108@tcp LPNI seq info [746:746:8:4294967295] 00000400:00000200:1.0:1734258681.308080:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258681.308085:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258681.308089:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734258681.308093:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258681.308100:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258681.308103:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258681.308227:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258681.308230:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:1.0:1734258681.308233:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258681.308237:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258681.308240:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:1.0:1734258681.308242:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:1.0:1734258681.308247:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098257920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258697 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258681.308632:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258681.308637:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258681.308641:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258681.308644:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098258048, portal 10 00000400:00000010:3.0:1734258681.308648:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734258681.308650:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098258048, offset 0 00000400:00000200:3.0:1734258681.308654:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258681.308659:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258681.308662:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258681.308664:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258681.308666:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258681.308667:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258681.308669:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [748:748:256:4294967295] 192.168.202.108@tcp LPNI seq info [747:747:8:4294967295] 00000400:00000200:3.0:1734258681.308675:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258681.308678:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258681.308681:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734258681.308684:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258681.308688:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258681.308690:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258681.309027:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258681.309030:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734258681.309032:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258681.309035:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258681.309038:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:0.0:1734258681.309044:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734258681.309048:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098258048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258691 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258681.310872:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258681.310891:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617400 00000400:00000200:0.0:1734258681.310900:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1849 [1] + 224 00000400:00000200:0.0:1734258681.310919:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258681.310923:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258681.310933:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098257920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258697 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258681.311037:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258681.311042:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258681.311044:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258681.311049:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098257920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258697 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258681.311065:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098257920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258697 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258681.311089:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258681.311094:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734258681.311098:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734258681.311322:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258681.311328:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617480 00000400:00000200:0.0:1734258681.311334:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1851 [1] + 0 00000400:00000200:0.0:1734258681.311343:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258681.311346:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258681.311351:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098258048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258691 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258681.311437:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258681.311441:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258681.311442:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258681.311447:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098258048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258691 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258681.311453:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098258048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258691 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258681.311472:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258681.311475:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258681.311478:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258686.315678:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258686.315697:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258686.315752:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258686.315759:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734258686.315786:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 02000000:00000010:0.0:1734258686.315791:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734258686.315794:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d504d0. 00000400:00000010:3.0:1734258686.315794:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:0.0:1734258686.315799:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000400:00000010:3.0:1734258686.315799:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734258686.315805:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098258304, portal 10 00000100:00000200:3.0:1734258686.315813:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098258176, portal 25 00000400:00000010:0.0:1734258686.315816:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000400:00000010:3.0:1734258686.315816:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734258686.315818:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098258304, offset 0 00000100:00000200:3.0:1734258686.315818:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098258176, offset 0 00000400:00000200:3.0:1734258686.315825:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258686.315835:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258686.315840:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258686.315843:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258686.315846:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258686.315848:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258686.315850:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [749:749:256:4294967295] 192.168.202.108@tcp LPNI seq info [748:748:8:4294967295] 00000400:00000200:3.0:1734258686.315858:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258686.315862:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258686.315865:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734258686.315870:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258686.315877:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258686.315880:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734258686.315896:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258686.315901:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258686.315914:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258686.315916:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258686.315918:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258686.315920:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258686.315922:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [750:750:255:4294967295] 192.168.202.108@tcp LPNI seq info [749:749:7:4294967295] 00000400:00000200:0.0:1734258686.315928:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258686.315931:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258686.315934:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734258686.315937:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258686.315940:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258686.315943:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258686.316459:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258686.316463:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734258686.316467:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258686.316472:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258686.316475:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:1.0:1734258686.316477:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:1.0:1734258686.316483:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098258176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258702 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258686.316544:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258686.316546:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734258686.316548:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258686.316551:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258686.316553:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:1.0:1734258686.316555:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:1.0:1734258686.316558:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098258304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258696 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258686.323306:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258686.323323:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617500 00000400:00000200:0.0:1734258686.323330:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x185d [1] + 224 00000400:00000200:0.0:1734258686.323340:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258686.323344:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258686.323353:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098258176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258686.323392:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258686.323397:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617580 00000400:00000200:0.0:1734258686.323402:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1859 [1] + 0 00000400:00000200:0.0:1734258686.323415:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258686.323418:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258686.323423:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098258304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258696 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258686.323525:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d504d0. 00000400:00000200:1.0:1734258686.323529:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:1.0:1734258686.323531:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:1.0:1734258686.323535:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098258304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258696 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258686.323541:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098258304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258696 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258686.323564:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258686.323588:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734258686.323599:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:3.0:1734258686.323665:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258686.323673:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258686.323674:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258686.323678:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098258176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258702 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258686.323685:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098258176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258702 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258686.323696:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258686.323699:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734258686.323701:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258691.323840:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258691.323865:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258691.323927:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258691.323952:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258691.323979:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258691.323992:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258691.323999:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258691.324006:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098258432, portal 25 00000400:00000010:3.0:1734258691.324011:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734258691.324013:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098258432, offset 0 00000400:00000200:3.0:1734258691.324022:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258691.324035:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258691.324039:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258691.324043:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258691.324045:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258691.324048:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258691.324050:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [751:751:256:4294967295] 192.168.202.108@tcp LPNI seq info [750:750:8:4294967295] 00000400:00000200:3.0:1734258691.324058:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258691.324064:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258691.324067:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734258691.324072:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258691.324081:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258691.324084:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734258691.324235:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258691.324243:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258691.324248:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258691.324254:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098258560, portal 10 00000400:00000010:1.0:1734258691.324259:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000100:00000200:1.0:1734258691.324261:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098258560, offset 0 00000400:00000200:1.0:1734258691.324268:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258691.324277:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258691.324281:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258691.324284:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258691.324287:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258691.324289:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258691.324292:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [752:752:255:4294967295] 192.168.202.108@tcp LPNI seq info [751:751:7:4294967295] 00000400:00000200:1.0:1734258691.324299:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258691.324304:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258691.324307:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734258691.324311:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258691.324318:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258691.324321:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258691.325542:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258691.325549:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734258691.325556:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258691.325562:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258691.325599:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:0.0:1734258691.325602:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:0.0:1734258691.325614:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098258432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258707 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258691.325813:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258691.325815:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734258691.325818:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258691.325821:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258691.325824:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:0.0:1734258691.325825:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:0.0:1734258691.325829:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098258560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258701 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258691.328468:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258691.328490:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617600 00000400:00000200:0.0:1734258691.328501:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1869 [1] + 224 00000400:00000200:0.0:1734258691.328528:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258691.328533:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258691.328544:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098258432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258707 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258691.328820:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258691.328826:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258691.328828:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258691.328844:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098258432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258707 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258691.328850:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098258432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258707 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258691.328876:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258691.328883:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734258691.328888:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000200:0.0:1734258691.329212:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258691.329219:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617680 00000400:00000200:0.0:1734258691.329225:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1871 [1] + 0 00000400:00000200:0.0:1734258691.329235:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258691.329238:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258691.329244:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098258560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258701 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258691.329496:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258691.329501:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258691.329502:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258691.329507:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098258560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258701 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258691.329514:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098258560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258701 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258691.329541:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258691.329546:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258691.329548:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258696.331692:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258696.331712:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258696.331768:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258696.331775:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734258696.331814:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734258696.331820:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50528. 00000400:00000010:0.0:1734258696.331828:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 02000000:00000010:1.0:1734258696.331834:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000100:00000200:0.0:1734258696.331835:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098258816, portal 10 00000400:00000010:1.0:1734258696.331839:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:0.0:1734258696.331841:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000400:00000010:1.0:1734258696.331842:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734258696.331843:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098258816, offset 0 00000100:00000200:1.0:1734258696.331844:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098258688, portal 25 00000400:00000010:1.0:1734258696.331847:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000400:00000200:0.0:1734258696.331851:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:1.0:1734258696.331858:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098258688, offset 0 00000400:00000200:1.0:1734258696.331863:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258696.331873:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258696.331878:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258696.331882:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258696.331885:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258696.331887:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258696.331890:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [753:753:256:4294967295] 192.168.202.108@tcp LPNI seq info [752:752:8:4294967295] 00000400:00000200:1.0:1734258696.331897:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258696.331903:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258696.331907:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734258696.331912:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258696.331920:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258696.331923:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734258696.331994:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258696.331996:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258696.331998:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258696.332000:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258696.332002:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258696.332004:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [754:754:255:4294967295] 192.168.202.108@tcp LPNI seq info [753:753:7:4294967295] 00000400:00000200:0.0:1734258696.332009:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258696.332012:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258696.332014:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734258696.332017:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258696.332020:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258696.332022:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258696.332224:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258696.332228:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:2.0:1734258696.332233:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258696.332237:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258696.332245:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:2.0:1734258696.332247:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:2.0:1734258696.332254:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098258688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258712 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258696.332325:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258696.332327:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:2.0:1734258696.332329:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258696.332332:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258696.332334:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:2.0:1734258696.332335:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:2.0:1734258696.332339:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098258816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258706 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258696.334174:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258696.334193:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617780 00000400:00000200:0.0:1734258696.334200:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1879 [1] + 0 00000400:00000200:0.0:1734258696.334223:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258696.334226:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258696.334242:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098258816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258706 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258696.334344:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50528. 00000400:00000200:2.0:1734258696.334352:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:2.0:1734258696.334354:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:2.0:1734258696.334359:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098258816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258706 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258696.334366:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098258816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258706 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258696.334393:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734258696.334399:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258696.334403:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:0.0:1734258696.334601:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258696.334607:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617700 00000400:00000200:0.0:1734258696.334613:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1881 [1] + 224 00000400:00000200:0.0:1734258696.334623:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258696.334626:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258696.334631:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098258688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258712 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258696.334792:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258696.334795:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258696.334797:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258696.334800:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098258688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258712 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258696.334806:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098258688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258712 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258696.334816:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258696.334818:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734258696.334820:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734258701.339867:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258701.339888:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258701.339944:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258701.339951:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258701.340133:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258701.340140:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258701.340146:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258701.340151:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098259072, portal 10 00000400:00000010:3.0:1734258701.340155:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734258701.340157:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098259072, offset 0 00000400:00000200:3.0:1734258701.340164:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258701.340175:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:1.0:1734258701.340176:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000200:3.0:1734258701.340180:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258701.340183:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258701.340186:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258701.340188:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258701.340190:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [755:755:256:4294967295] 192.168.202.108@tcp LPNI seq info [754:754:8:4294967295] 00000400:00000010:1.0:1734258701.340192:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258701.340195:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258701.340198:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098258944, portal 25 00000400:00000200:3.0:1734258701.340198:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734258701.340201:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734258701.340202:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098258944, offset 0 00000800:00000200:3.0:1734258701.340203:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258701.340206:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258701.340207:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000400:00000200:1.0:1734258701.340211:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258701.340213:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258701.340215:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258701.340216:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258701.340218:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258701.340220:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [756:756:255:4294967295] 192.168.202.108@tcp LPNI seq info [755:755:7:4294967295] 00000400:00000200:1.0:1734258701.340226:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258701.340229:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258701.340232:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734258701.340235:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258701.340242:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258701.340245:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258701.340356:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258701.340359:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:2.0:1734258701.340362:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258701.340366:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258701.340370:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:2.0:1734258701.340371:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:2.0:1734258701.340378:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098258944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258717 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734258701.340418:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258701.340422:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258701.340424:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258701.340743:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258701.340746:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734258701.340748:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258701.340751:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258701.340754:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:0.0:1734258701.340755:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:0.0:1734258701.340760:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098259072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258711 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258701.342240:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258701.342254:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617800 00000400:00000200:0.0:1734258701.342260:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1891 [1] + 224 00000400:00000200:0.0:1734258701.342269:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258701.342272:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258701.342280:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098258944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258717 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258701.342308:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258701.342328:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617880 00000400:00000200:0.0:1734258701.342332:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1889 [1] + 0 00000400:00000010:1.0:1734258701.342343:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:0.0:1734258701.342344:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258701.342347:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258701.342348:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258701.342350:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258701.342355:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098258944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258717 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734258701.342358:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098259072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258711 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258701.342362:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098258944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258717 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258701.342381:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734258701.342384:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734258701.342387:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:3.0:1734258701.342501:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258701.342504:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258701.342505:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258701.342509:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098259072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258711 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258701.342523:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098259072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258711 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258701.342537:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258701.342540:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258701.342541:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258706.348053:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258706.348073:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258706.348130:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258706.348137:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734258706.348176:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734258706.348181:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50580. 00000400:00000010:0.0:1734258706.348188:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000100:00000200:0.0:1734258706.348194:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098259328, portal 10 00000400:00000010:0.0:1734258706.348200:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734258706.348202:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098259328, offset 0 00000400:00000200:0.0:1734258706.348210:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734258706.348234:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734258706.348238:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:2.0:1734258706.348241:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734258706.348244:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098259200, portal 25 00000400:00000010:2.0:1734258706.348246:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734258706.348247:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098259200, offset 0 00000400:00000200:2.0:1734258706.348251:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258706.348424:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258706.348429:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258706.348433:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258706.348436:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258706.348438:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258706.348440:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [757:757:256:4294967295] 192.168.202.108@tcp LPNI seq info [756:756:8:4294967295] 00000400:00000200:0.0:1734258706.348447:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258706.348452:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258706.348452:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258706.348454:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734258706.348455:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000400:00000200:2.0:1734258706.348456:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258706.348457:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258706.348458:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734258706.348460:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734258706.348460:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [758:758:255:4294967295] 192.168.202.108@tcp LPNI seq info [757:757:7:4294967295] 00000400:00000200:2.0:1734258706.348465:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258706.348466:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258706.348469:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258706.348478:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258706.348480:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258706.348483:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258706.348485:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258706.348487:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258706.348722:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258706.348725:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:3.0:1734258706.348730:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258706.348734:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258706.348737:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:3.0:1734258706.348739:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:3.0:1734258706.348745:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098259328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258716 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734258706.348909:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258706.348912:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:3.0:1734258706.348914:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258706.348917:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258706.348919:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:3.0:1734258706.348921:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:3.0:1734258706.348924:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098259200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258722 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258706.350756:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258706.350772:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617980 00000400:00000200:0.0:1734258706.350778:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1899 [1] + 0 00000400:00000200:0.0:1734258706.350787:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258706.350790:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258706.350798:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098259328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258716 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258706.350834:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258706.350838:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617900 00000400:00000200:0.0:1734258706.350842:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x18a1 [1] + 224 00000400:00000200:0.0:1734258706.350857:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258706.350859:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258706.350863:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098259200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258722 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258706.351084:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:3.0:1734258706.351088:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:3.0:1734258706.351089:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:3.0:1734258706.351094:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098259200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258722 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258706.351099:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098259200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258722 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258706.351116:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:3.0:1734258706.351120:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734258706.351130:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:2.0:1734258706.351290:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50580. 00000400:00000200:2.0:1734258706.351294:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:2.0:1734258706.351296:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:2.0:1734258706.351300:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098259328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258716 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258706.351305:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098259328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258716 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258706.351320:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258706.351323:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258706.351326:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258711.355916:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258711.355945:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258711.356042:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258711.356050:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258711.356088:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 02000000:00000010:0.0:1734258711.356094:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734258711.356097:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d505d8. 00000400:00000010:2.0:1734258711.356097:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd68. 00000400:00000010:0.0:1734258711.356104:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000400:00000010:2.0:1734258711.356104:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734258711.356113:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098259584, portal 10 00000400:00000010:0.0:1734258711.356122:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000100:00000200:2.0:1734258711.356311:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098259456, portal 25 00000400:00000010:2.0:1734258711.356330:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734258711.356335:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098259456, offset 0 00000400:00000200:2.0:1734258711.356347:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258711.356363:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258711.356370:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258711.356375:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258711.356378:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258711.356380:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258711.356383:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [759:759:256:4294967295] 192.168.202.108@tcp LPNI seq info [758:758:8:4294967295] 00000400:00000200:2.0:1734258711.356393:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:0.0:1734258711.356396:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098259584, offset 0 00000800:00000200:2.0:1734258711.356400:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258711.356407:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258711.356417:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258711.356422:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734258711.356422:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258711.356425:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258711.356428:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734258711.356428:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258711.356439:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734258711.356440:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258711.356443:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [760:760:255:4294967295] 192.168.202.108@tcp LPNI seq info [759:759:7:4294967295] 00000800:00000200:2.0:1734258711.356444:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734258711.356450:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258711.356455:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258711.356458:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734258711.356463:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258711.356469:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258711.356472:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258711.356867:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258711.356870:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734258711.356875:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258711.356884:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258711.356888:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:1.0:1734258711.356890:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:1.0:1734258711.356897:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098259456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258727 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258711.357268:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258711.357270:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734258711.357273:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258711.357277:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258711.357279:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:1.0:1734258711.357280:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:1.0:1734258711.357285:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098259584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258721 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258711.359659:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258711.359679:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617a00 00000400:00000200:0.0:1734258711.359687:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x18ad [1] + 224 00000400:00000200:0.0:1734258711.359697:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258711.359700:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258711.359709:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098259456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258727 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258711.359879:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258711.359884:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617a80 00000400:00000200:0.0:1734258711.359888:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x18a9 [1] + 0 00000400:00000200:0.0:1734258711.359905:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258711.359908:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258711.359912:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098259584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258721 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258711.360000:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd68. 00000400:00000200:2.0:1734258711.360005:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:2.0:1734258711.360006:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258711.360011:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098259456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258727 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258711.360017:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098259456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258727 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258711.360037:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258711.360041:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:2.0:1734258711.360044:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:1.0:1734258711.360152:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d505d8. 00000400:00000200:1.0:1734258711.360156:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:1.0:1734258711.360157:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:1.0:1734258711.360162:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098259584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258721 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258711.360168:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098259584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258721 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258711.360186:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258711.360189:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258711.360191:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258716.364177:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258716.364199:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258716.364986:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258716.364996:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258716.365022:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734258716.365031:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 02000000:00000010:0.0:1734258716.365036:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:1.0:1734258716.365038:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000400:00000010:0.0:1734258716.365040:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509f8. 00000100:00000200:1.0:1734258716.365046:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098259712, portal 25 00000400:00000010:1.0:1734258716.365050:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734258716.365052:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098259712, offset 0 00000400:00000010:0.0:1734258716.365057:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000400:00000200:1.0:1734258716.365061:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258716.365073:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258716.365078:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258716.365088:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258716.365091:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258716.365093:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258716.365095:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [761:761:256:4294967295] 192.168.202.108@tcp LPNI seq info [760:760:8:4294967295] 00000400:00000200:1.0:1734258716.365102:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258716.365108:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258716.365111:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734258716.365117:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258716.365123:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258716.365128:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:0.0:1734258716.365135:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098259840, portal 10 00000400:00000010:0.0:1734258716.365141:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734258716.365143:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098259840, offset 0 00000400:00000200:0.0:1734258716.365148:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258716.365156:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258716.365158:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258716.365161:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258716.365163:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258716.365165:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258716.365167:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [762:762:255:4294967295] 192.168.202.108@tcp LPNI seq info [761:761:7:4294967295] 00000400:00000200:0.0:1734258716.365174:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258716.365177:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258716.365179:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734258716.365182:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258716.365185:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258716.365188:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258716.365552:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258716.365556:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:2.0:1734258716.365561:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258716.365566:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258716.365593:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:2.0:1734258716.365595:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:2.0:1734258716.365603:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098259712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258732 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258716.365972:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258716.365974:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:2.0:1734258716.365978:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258716.365981:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258716.365983:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:2.0:1734258716.365984:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:2.0:1734258716.365988:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098259840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258726 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258716.367806:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258716.367821:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617b00 00000400:00000200:0.0:1734258716.367831:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x18b9 [1] + 224 00000400:00000200:0.0:1734258716.367857:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258716.367861:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258716.367870:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098259712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258732 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258716.368345:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258716.368350:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258716.368352:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258716.368358:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098259712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258732 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258716.368364:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098259712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258732 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258716.368385:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734258716.368389:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734258716.368392:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734258716.376057:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258716.376079:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617b80 00000400:00000200:0.0:1734258716.376087:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x18c1 [1] + 0 00000400:00000200:0.0:1734258716.376108:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258716.376112:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258716.376128:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098259840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258726 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258716.376241:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509f8. 00000400:00000200:2.0:1734258716.376245:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:2.0:1734258716.376251:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:2.0:1734258716.376256:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098259840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258726 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258716.376262:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098259840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258726 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258716.376289:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258716.376295:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258716.376298:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258721.371683:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258721.371702:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258721.371756:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258721.371762:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258721.371871:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734258721.371886:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258721.371892:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258721.371898:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098259968, portal 25 00000400:00000010:1.0:1734258721.371901:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734258721.371903:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098259968, offset 0 00000400:00000200:1.0:1734258721.371911:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258721.371923:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258721.371928:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258721.371931:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258721.371934:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258721.371947:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258721.371950:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [763:763:256:4294967295] 192.168.202.108@tcp LPNI seq info [762:762:8:4294967295] 00000400:00000200:1.0:1734258721.371958:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258721.371963:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258721.371966:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734258721.371972:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258721.371979:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258721.371987:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258721.372039:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258721.372044:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258721.372047:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258721.372049:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098260096, portal 10 00000400:00000010:3.0:1734258721.372052:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734258721.372054:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098260096, offset 0 00000400:00000200:3.0:1734258721.372058:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258721.372063:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258721.372065:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258721.372067:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258721.372069:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258721.372070:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258721.372072:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [764:764:255:4294967295] 192.168.202.108@tcp LPNI seq info [763:763:7:4294967295] 00000400:00000200:3.0:1734258721.372078:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258721.372081:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258721.372083:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734258721.372085:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258721.372088:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000200:3.0:1734258721.372089:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:1.0:1734258721.372091:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000800:00000200:3.0:1734258721.372091:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734258721.372094:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258721.372098:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258721.372101:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:1.0:1734258721.372102:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734258721.372108:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098259968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258737 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258721.372337:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258721.372339:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:1.0:1734258721.372341:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258721.372344:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258721.372347:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:1.0:1734258721.372348:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:1.0:1734258721.372352:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098260096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258731 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258721.376047:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258721.376073:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617c00 00000400:00000200:0.0:1734258721.376085:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x18c9 [1] + 224 00000400:00000200:0.0:1734258721.376111:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258721.376115:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258721.376127:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098259968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258737 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258721.376271:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258721.376276:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258721.376279:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258721.376284:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098259968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258737 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258721.376291:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098259968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258737 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258721.376338:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734258721.376344:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734258721.376350:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734258721.379504:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258721.379525:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617c80 00000400:00000200:0.0:1734258721.379535:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x18d1 [1] + 0 00000400:00000200:0.0:1734258721.379602:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258721.379607:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258721.379619:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098260096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258731 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258721.379910:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258721.379915:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258721.379916:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258721.379922:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098260096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258731 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258721.379929:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098260096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258731 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258721.379961:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258721.379965:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258721.379969:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258726.382392:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258726.382418:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258726.382482:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258726.382488:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258726.382509:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000400:00000010:2.0:1734258726.382519:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd68. 00000400:00000010:2.0:1734258726.382527:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 02000000:00000010:0.0:1734258726.382535:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000100:00000200:2.0:1734258726.382535:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098260224, portal 25 00000400:00000010:0.0:1734258726.382540:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509a0. 00000400:00000010:2.0:1734258726.382540:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734258726.382542:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098260224, offset 0 00000400:00000010:0.0:1734258726.382543:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:0.0:1734258726.382547:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098260352, portal 10 00000400:00000010:0.0:1734258726.382551:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000400:00000200:2.0:1734258726.382552:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734258726.382566:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098260352, offset 0 00000400:00000200:2.0:1734258726.382566:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258726.382587:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258726.382598:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258726.382602:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258726.382605:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258726.382607:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258726.382610:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [765:765:256:4294967295] 192.168.202.108@tcp LPNI seq info [764:764:8:4294967295] 00000400:00000200:2.0:1734258726.382619:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258726.382624:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258726.382625:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258726.382628:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734258726.382628:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258726.382630:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258726.382632:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258726.382634:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734258726.382634:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734258726.382636:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [766:766:255:4294967295] 192.168.202.108@tcp LPNI seq info [765:765:7:4294967295] 00000800:00000200:2.0:1734258726.382642:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734258726.382643:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258726.382646:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258726.382647:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258726.382650:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734258726.382653:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258726.382658:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258726.382660:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258726.382771:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258726.382774:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258726.382779:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258726.382783:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258726.382787:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:1.0:1734258726.382789:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:1.0:1734258726.382796:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098260224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258742 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258726.382893:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258726.382895:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:1.0:1734258726.382897:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258726.382900:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258726.382903:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:1.0:1734258726.382904:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:1.0:1734258726.382907:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098260352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258736 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258726.384912:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258726.384930:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617d00 00000400:00000200:0.0:1734258726.384940:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x18d9 [1] + 224 00000400:00000200:0.0:1734258726.384962:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258726.384966:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258726.384975:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098260224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258742 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258726.391460:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258726.391476:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617d80 00000400:00000200:0.0:1734258726.391484:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x18e1 [1] + 0 00000400:00000200:0.0:1734258726.391507:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258726.391511:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258726.391520:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098260352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258736 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258726.391601:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509a0. 00000400:00000200:1.0:1734258726.391607:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:1.0:1734258726.391609:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:1.0:1734258726.391615:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098260352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258736 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258726.391623:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098260352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258736 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258726.391652:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258726.391657:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258726.391661:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:2.0:1734258726.394332:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd68. 00000400:00000200:2.0:1734258726.394346:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:2.0:1734258726.394349:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258726.394362:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098260224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258742 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258726.394384:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098260224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258742 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258726.394410:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:2.0:1734258726.394416:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:2.0:1734258726.394419:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258731.387735:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258731.387761:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258731.387903:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258731.387911:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258731.387921:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000400:00000010:2.0:1734258731.387928:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd68. 00000400:00000010:2.0:1734258731.387935:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258731.387944:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098260480, portal 25 00000400:00000010:2.0:1734258731.387948:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734258731.387950:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098260480, offset 0 02000000:00000010:1.0:1734258731.387978:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258731.387997:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000200:2.0:1734258731.388021:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734258731.388027:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258731.388030:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098260608, portal 10 00000400:00000200:2.0:1734258731.388035:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734258731.388038:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734258731.388039:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098260608, offset 0 00000400:00000200:2.0:1734258731.388042:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258731.388044:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258731.388046:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258731.388049:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258731.388051:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258731.388054:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [767:767:256:4294967295] 192.168.202.108@tcp LPNI seq info [766:766:8:4294967295] 00000400:00000200:2.0:1734258731.388067:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734258731.388073:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734258731.388073:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258731.388076:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258731.388078:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000010:2.0:1734258731.388078:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258731.388080:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258731.388081:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258731.388084:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [768:768:255:4294967295] 192.168.202.108@tcp LPNI seq info [767:767:7:4294967295] 00000800:00000200:2.0:1734258731.388084:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734258731.388089:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258731.388091:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258731.388093:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258731.388096:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:2.0:1734258731.388096:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258731.388099:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258731.388103:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258731.388105:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258731.388221:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258731.388225:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258731.388230:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258731.388234:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258731.388238:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734258731.388240:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734258731.388248:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098260480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258747 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258731.388461:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258731.388463:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734258731.388466:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258731.388469:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258731.388472:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:0.0:1734258731.388473:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:0.0:1734258731.388476:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098260608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258741 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258731.393461:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258731.393479:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617e80 00000400:00000200:0.0:1734258731.393487:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x18f1 [1] + 0 00000400:00000200:0.0:1734258731.393507:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258731.393510:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258731.393520:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098260608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258741 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258731.393853:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258731.393857:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258731.393859:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258731.393864:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098260608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258741 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258731.393871:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098260608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258741 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258731.393895:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258731.393899:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734258731.393903:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734258731.396253:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258731.396264:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617e00 00000400:00000200:0.0:1734258731.396278:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x18e9 [1] + 224 00000400:00000200:0.0:1734258731.396291:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258731.396294:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258731.396301:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098260480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258747 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258731.396924:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd68. 00000400:00000200:2.0:1734258731.396929:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:2.0:1734258731.396930:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258731.396935:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098260480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258747 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258731.396949:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098260480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258747 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258731.396963:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:2.0:1734258731.396966:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734258731.396968:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258736.395730:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258736.395753:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258736.395851:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258736.395858:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258736.395881:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734258736.395890:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 02000000:00000010:0.0:1734258736.395897:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734258736.395901:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50948. 00000400:00000010:0.0:1734258736.395908:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000400:00000010:1.0:1734258736.395910:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734258736.395914:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098260864, portal 10 00000100:00000200:1.0:1734258736.395914:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098260736, portal 25 00000400:00000010:0.0:1734258736.395919:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000400:00000010:1.0:1734258736.395919:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:0.0:1734258736.395921:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098260864, offset 0 00000100:00000200:1.0:1734258736.395921:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098260736, offset 0 00000400:00000200:1.0:1734258736.395930:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258736.395935:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258736.395945:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258736.395950:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258736.395953:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258736.395962:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258736.395964:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258736.395967:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [769:769:256:4294967295] 192.168.202.108@tcp LPNI seq info [768:768:8:4294967295] 00000400:00000200:1.0:1734258736.395976:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258736.395982:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258736.395983:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258736.395986:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734258736.395986:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734258736.395988:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258736.395990:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258736.395992:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734258736.395992:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734258736.395994:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [770:770:255:4294967295] 192.168.202.108@tcp LPNI seq info [769:769:7:4294967295] 00000400:00000200:0.0:1734258736.395999:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258736.395999:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258736.396003:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734258736.396003:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:0.0:1734258736.396005:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734258736.396008:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258736.396012:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258736.396014:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258736.396277:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258736.396280:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:2.0:1734258736.396285:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258736.396290:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258736.396294:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:2.0:1734258736.396295:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:2.0:1734258736.396303:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098260736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258752 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258736.396376:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258736.396378:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:2.0:1734258736.396384:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258736.396387:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258736.396389:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:2.0:1734258736.396391:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:2.0:1734258736.396397:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098260864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258746 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258736.399970:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258736.399991:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c617f00 00000400:00000200:0.0:1734258736.400016:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x18fd [1] + 224 00000400:00000200:0.0:1734258736.400030:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258736.400034:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258736.400048:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098260736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258752 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258736.400087:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258736.400092:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c617f80 00000400:00000200:0.0:1734258736.400098:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x18f9 [1] + 0 00000400:00000200:0.0:1734258736.400114:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258736.400117:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258736.400122:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098260864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258746 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258736.400185:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258736.400191:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258736.400193:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258736.400199:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098260736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258752 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258736.400205:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098260736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258752 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258736.400229:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734258736.400234:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734258736.400237:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:2.0:1734258736.400335:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50948. 00000400:00000200:2.0:1734258736.400340:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:2.0:1734258736.400342:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:2.0:1734258736.400347:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098260864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258746 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258736.400354:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098260864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258746 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258736.400373:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258736.400377:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258736.400393:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734258741.403751:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258741.403781:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258741.403853:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258741.403861:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258741.403914:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734258741.403929:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd68. 00000400:00000010:2.0:1734258741.403935:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258741.403947:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098260992, portal 25 00000400:00000010:2.0:1734258741.403952:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734258741.403954:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098260992, offset 0 00000400:00000200:2.0:1734258741.403962:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258741.403977:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258741.403983:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:3.0:1734258741.403984:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000200:2.0:1734258741.403986:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258741.403989:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258741.403991:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:3.0:1734258741.403992:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:2.0:1734258741.403994:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [771:771:256:4294967295] 192.168.202.108@tcp LPNI seq info [770:770:8:4294967295] 00000400:00000200:2.0:1734258741.404002:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:3.0:1734258741.404002:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000800:00000200:2.0:1734258741.404007:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734258741.404008:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098261120, portal 10 00000800:00000010:2.0:1734258741.404011:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000010:3.0:1734258741.404014:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000800:00000200:2.0:1734258741.404016:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:3.0:1734258741.404016:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098261120, offset 0 00000400:00000200:3.0:1734258741.404023:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734258741.404026:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258741.404030:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734258741.404033:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258741.404037:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258741.404040:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258741.404043:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258741.404044:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258741.404046:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [772:772:255:4294967295] 192.168.202.108@tcp LPNI seq info [771:771:7:4294967295] 00000400:00000200:3.0:1734258741.404053:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258741.404057:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258741.404060:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734258741.404065:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258741.404071:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258741.404074:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258741.404127:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258741.404131:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258741.404137:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258741.404140:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258741.404145:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734258741.404147:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734258741.404155:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098260992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258757 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258741.404646:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258741.404649:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734258741.404651:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258741.404655:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258741.404765:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734258741.404768:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734258741.404788:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098261120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258751 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258741.409706:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258741.409742:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618000 00000400:00000200:0.0:1734258741.409750:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1909 [1] + 224 00000400:00000200:0.0:1734258741.409777:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258741.409781:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258741.409795:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098260992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258757 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258741.410009:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd68. 00000400:00000200:2.0:1734258741.410022:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:2.0:1734258741.410024:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258741.410037:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098260992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258757 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258741.410057:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098260992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258757 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258741.410085:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734258741.410091:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734258741.410095:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000200:0.0:1734258741.411139:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258741.411152:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618080 00000400:00000200:0.0:1734258741.411159:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1911 [1] + 0 00000400:00000200:0.0:1734258741.411173:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258741.411177:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258741.411186:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098261120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258751 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258741.411707:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258741.411713:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258741.411715:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258741.411722:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098261120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258751 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258741.411738:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098261120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258751 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258741.411769:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258741.411775:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258741.411780:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734258746.412851:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258746.413045:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258746.413102:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258746.413108:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734258746.413152:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734258746.413157:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d508f0. 00000400:00000010:0.0:1734258746.413163:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734258746.413169:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098261376, portal 10 00000400:00000010:0.0:1734258746.413175:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734258746.413177:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098261376, offset 0 00000400:00000200:0.0:1734258746.413186:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258746.413200:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258746.413204:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258746.413220:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258746.413223:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258746.413225:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258746.413227:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [773:773:256:4294967295] 192.168.202.108@tcp LPNI seq info [772:772:8:4294967295] 00000400:00000200:0.0:1734258746.413235:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258746.413240:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258746.413243:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734258746.413249:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258746.413256:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258746.413261:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734258746.414166:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734258746.414174:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd68. 00000400:00000010:2.0:1734258746.414178:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258746.414183:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098261248, portal 25 00000400:00000010:2.0:1734258746.414186:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734258746.414187:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098261248, offset 0 00000400:00000200:2.0:1734258746.414192:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258746.414198:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258746.414200:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258746.414203:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258746.414205:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258746.414206:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258746.414209:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [774:774:255:4294967295] 192.168.202.108@tcp LPNI seq info [773:773:7:4294967295] 00000400:00000200:2.0:1734258746.414216:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258746.414220:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258746.414223:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258746.414227:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258746.414233:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258746.414235:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258746.414341:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258746.414344:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734258746.414349:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258746.414353:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258746.414366:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:1.0:1734258746.414367:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:1.0:1734258746.414374:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098261376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258756 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258746.414442:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258746.414444:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734258746.414447:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258746.414449:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258746.414451:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:1.0:1734258746.414453:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:1.0:1734258746.414456:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098261248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258762 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258746.421010:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258746.421031:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618100 00000400:00000200:0.0:1734258746.421040:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1921 [1] + 224 00000400:00000200:0.0:1734258746.421051:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258746.421056:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258746.421066:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098261248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258762 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258746.421105:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258746.421108:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618180 00000400:00000200:0.0:1734258746.421112:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1919 [1] + 0 00000400:00000200:0.0:1734258746.421124:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258746.421126:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258746.421131:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098261376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258756 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258746.421136:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd68. 00000400:00000200:2.0:1734258746.421141:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:2.0:1734258746.421143:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258746.421148:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098261248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258762 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258746.421154:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098261248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258762 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258746.421173:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258746.421177:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734258746.421180:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:1.0:1734258746.421418:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d508f0. 00000400:00000200:1.0:1734258746.421422:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:1.0:1734258746.421423:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:1.0:1734258746.421429:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098261376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258756 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258746.421435:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098261376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258756 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258746.421451:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258746.421458:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734258746.421461:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258751.419757:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258751.419786:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258751.419855:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258751.419864:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258751.419937:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734258751.419963:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd68. 00000400:00000010:2.0:1734258751.419971:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258751.419979:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098261504, portal 25 00000400:00000010:2.0:1734258751.419983:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734258751.419986:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098261504, offset 0 00000400:00000200:2.0:1734258751.419996:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258751.420011:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258751.420016:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258751.420020:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258751.420023:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258751.420025:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258751.420028:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [775:775:256:4294967295] 192.168.202.108@tcp LPNI seq info [774:774:8:4294967295] 00000400:00000200:2.0:1734258751.420037:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258751.420042:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258751.420047:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258751.420052:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258751.420062:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258751.420067:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258751.420898:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258751.420902:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258751.420906:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258751.420912:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258751.420916:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734258751.420918:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734258751.420927:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098261504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258767 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258751.421738:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258751.421747:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258751.421753:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258751.421761:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098261632, portal 10 00000400:00000010:1.0:1734258751.421768:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734258751.421771:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098261632, offset 0 00000400:00000200:1.0:1734258751.421777:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258751.421789:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258751.421794:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258751.421812:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258751.421815:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258751.421817:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258751.421820:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [776:776:256:4294967295] 192.168.202.108@tcp LPNI seq info [775:775:8:4294967295] 00000400:00000200:1.0:1734258751.421829:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258751.421833:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258751.421838:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734258751.421843:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258751.421850:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258751.421852:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258751.422867:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258751.422871:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:2.0:1734258751.422874:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258751.422880:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258751.422883:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:2.0:1734258751.422885:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:2.0:1734258751.422892:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098261632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258761 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258751.424368:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258751.424386:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618200 00000400:00000200:0.0:1734258751.424397:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1929 [1] + 224 00000400:00000200:0.0:1734258751.424419:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258751.424423:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258751.424433:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098261504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258767 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258751.424773:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd68. 00000400:00000200:2.0:1734258751.424777:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:2.0:1734258751.424779:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734258751.424783:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098261504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258767 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258751.424802:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098261504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258767 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258751.424825:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734258751.424830:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:2.0:1734258751.424834:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000200:0.0:1734258751.424975:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258751.424981:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618280 00000400:00000200:0.0:1734258751.424986:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1931 [1] + 0 00000400:00000200:0.0:1734258751.424996:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258751.424999:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258751.425004:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098261632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258761 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258751.426753:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258751.426761:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258751.426763:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258751.426769:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098261632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258761 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258751.426776:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098261632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258761 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258751.426795:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258751.426799:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258751.426802:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258756.427722:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258756.427738:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258756.427786:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258756.427792:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:0.0:1734258756.427826:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734258756.427832:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50898. 00000400:00000010:0.0:1734258756.427837:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000100:00000200:0.0:1734258756.427858:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098261888, portal 10 00000400:00000010:0.0:1734258756.427864:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734258756.427866:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098261888, offset 0 00000400:00000200:0.0:1734258756.427873:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258756.427884:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258756.427888:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258756.427892:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258756.427895:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258756.427897:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:2.0:1734258756.427898:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000200:0.0:1734258756.427900:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [777:777:256:4294967295] 192.168.202.108@tcp LPNI seq info [776:776:8:4294967295] 00000400:00000010:2.0:1734258756.427903:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd68. 00000400:00000010:2.0:1734258756.427906:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000400:00000200:0.0:1734258756.427907:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:2.0:1734258756.427908:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098261760, portal 25 00000400:00000010:2.0:1734258756.427911:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000800:00000200:0.0:1734258756.427912:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734258756.427912:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098261760, offset 0 00000800:00000010:0.0:1734258756.427915:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000400:00000200:2.0:1734258756.427917:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734258756.427920:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734258756.427922:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258756.427924:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258756.427926:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258756.427929:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258756.427930:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734258756.427932:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734258756.427932:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [778:778:255:4294967295] 192.168.202.108@tcp LPNI seq info [777:777:7:4294967295] 00000800:00000200:0.0:1734258756.427935:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734258756.427939:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258756.427942:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258756.427945:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258756.427947:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258756.427951:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258756.427953:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258756.428291:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258756.428298:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:3.0:1734258756.428301:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258756.428305:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258756.428309:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:3.0:1734258756.428310:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:3.0:1734258756.428316:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098261888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258766 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734258756.428370:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258756.428372:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734258756.428375:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258756.428377:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258756.428379:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:3.0:1734258756.428380:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:3.0:1734258756.428383:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098261760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258772 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258756.430342:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258756.430357:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618380 00000400:00000200:0.0:1734258756.430363:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1939 [1] + 0 00000400:00000200:0.0:1734258756.430372:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258756.430375:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258756.430383:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098261888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258766 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258756.430421:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258756.430425:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618300 00000400:00000200:0.0:1734258756.430429:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1941 [1] + 224 00000400:00000200:0.0:1734258756.430442:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258756.430445:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258756.430454:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098261760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258772 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258756.430465:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50898. 00000400:00000200:2.0:1734258756.430470:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:2.0:1734258756.430471:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:2.0:1734258756.430476:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098261888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258766 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258756.430493:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098261888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258766 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734258756.430509:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:2.0:1734258756.430518:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734258756.430523:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258756.430526:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:3.0:1734258756.430552:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd68. 00000400:00000200:3.0:1734258756.430556:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:3.0:1734258756.430557:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:3.0:1734258756.430562:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098261760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258772 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258756.430598:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098261760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258772 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258756.430623:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:3.0:1734258756.430626:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734258756.430628:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258761.435734:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258761.435760:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258761.435835:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258761.435844:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258761.435926:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258761.435936:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000010:2.0:1734258761.435943:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258761.435951:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098262144, portal 10 00000400:00000010:2.0:1734258761.435962:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734258761.435964:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098262144, offset 0 00000400:00000200:2.0:1734258761.435975:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258761.435992:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258761.435999:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258761.436002:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258761.436006:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258761.436008:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258761.436011:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [779:779:256:4294967295] 192.168.202.108@tcp LPNI seq info [778:778:8:4294967295] 00000400:00000200:2.0:1734258761.436020:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258761.436026:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258761.436030:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258761.436036:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258761.436046:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258761.436050:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258761.436165:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734258761.436170:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258761.436173:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258761.436175:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098262016, portal 25 00000400:00000010:3.0:1734258761.436179:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734258761.436180:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098262016, offset 0 00000400:00000200:3.0:1734258761.436185:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258761.436202:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258761.436204:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258761.436206:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258761.436208:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258761.436210:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258761.436212:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [780:780:255:4294967295] 192.168.202.108@tcp LPNI seq info [779:779:7:4294967295] 00000400:00000200:3.0:1734258761.436217:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258761.436221:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258761.436224:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734258761.436226:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258761.436230:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258761.436232:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258761.437452:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258761.437458:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258761.437465:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258761.437471:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258761.437475:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734258761.437477:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734258761.437486:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098262144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258771 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258761.437627:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258761.437630:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734258761.437632:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258761.437635:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258761.437638:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734258761.437639:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734258761.437643:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098262016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258777 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258761.439413:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258761.439430:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618400 00000400:00000200:0.0:1734258761.439439:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1951 [1] + 224 00000400:00000200:0.0:1734258761.439465:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258761.439469:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258761.439479:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098262016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258777 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258761.440433:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258761.440442:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258761.440443:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258761.440453:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098262016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258777 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258761.440461:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098262016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258777 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258761.440467:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 02000000:00000010:3.0:1734258761.440492:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 00000400:00000200:0.0:1734258761.440499:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618480 02000000:00000010:3.0:1734258761.440502:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734258761.440507:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734258761.440509:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1949 [1] + 0 00000400:00000200:0.0:1734258761.440530:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258761.440534:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258761.440543:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098262144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258771 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258761.440718:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:2.0:1734258761.440723:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734258761.440725:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258761.440729:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098262144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258771 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258761.440740:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098262144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258771 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258761.440765:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258761.440771:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258761.440776:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258766.443700:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258766.443719:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258766.443780:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258766.443788:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734258766.443832:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734258766.443838:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50840. 00000400:00000010:0.0:1734258766.443845:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734258766.443852:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098262400, portal 10 00000400:00000010:0.0:1734258766.443858:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734258766.443860:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098262400, offset 0 00000400:00000200:0.0:1734258766.443868:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258766.443882:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258766.443888:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258766.443891:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258766.443894:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258766.443897:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258766.443900:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [781:781:256:4294967295] 192.168.202.108@tcp LPNI seq info [780:780:8:4294967295] 00000400:00000200:0.0:1734258766.443909:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258766.443919:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258766.443922:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734258766.443927:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258766.443936:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258766.443940:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258766.444110:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734258766.444115:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258766.444119:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258766.444121:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098262272, portal 25 00000400:00000010:3.0:1734258766.444123:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734258766.444125:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098262272, offset 0 00000400:00000200:3.0:1734258766.444129:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258766.444134:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258766.444136:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258766.444145:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258766.444147:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258766.444148:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258766.444151:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [782:782:255:4294967295] 192.168.202.108@tcp LPNI seq info [781:781:7:4294967295] 00000400:00000200:3.0:1734258766.444156:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258766.444159:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258766.444161:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734258766.444164:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258766.444168:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258766.444169:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258766.444256:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258766.444260:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734258766.444265:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258766.444270:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258766.444273:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:1.0:1734258766.444275:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:1.0:1734258766.444282:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098262272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258782 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258766.444347:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258766.444349:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734258766.444355:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258766.444362:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258766.444364:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:1.0:1734258766.444366:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:1.0:1734258766.444369:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098262400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258776 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258766.446002:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258766.446017:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618500 00000400:00000200:0.0:1734258766.446023:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1961 [1] + 224 00000400:00000200:0.0:1734258766.446037:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258766.446039:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258766.446046:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098262272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258782 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258766.446124:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258766.446129:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258766.446131:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258766.446137:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098262272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258782 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258766.446144:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098262272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258782 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258766.446165:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734258766.446171:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734258766.446175:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000200:0.0:1734258766.447389:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258766.447401:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618580 00000400:00000200:0.0:1734258766.447407:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1959 [1] + 0 00000400:00000200:0.0:1734258766.447420:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258766.447422:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258766.447430:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098262400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258776 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258766.447651:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50840. 00000400:00000200:2.0:1734258766.447657:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:2.0:1734258766.447659:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:2.0:1734258766.447664:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098262400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258776 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258766.447671:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098262400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258776 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258766.447723:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258766.447727:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258766.447731:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258771.453080:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258771.453100:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258771.453149:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258771.453154:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734258771.453180:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 02000000:00000010:0.0:1734258771.453185:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:3.0:1734258771.453187:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:0.0:1734258771.453188:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d507e8. 00000400:00000010:0.0:1734258771.453193:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000400:00000010:3.0:1734258771.453193:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258771.453198:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098262528, portal 25 00000400:00000010:3.0:1734258771.453202:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:0.0:1734258771.454786:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098262656, portal 10 00000100:00000200:3.0:1734258771.454787:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098262528, offset 0 00000400:00000010:0.0:1734258771.454798:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000400:00000200:3.0:1734258771.454802:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734258771.454806:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098262656, offset 0 00000400:00000200:0.0:1734258771.454810:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258771.454817:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258771.454823:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258771.454827:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258771.454830:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258771.454849:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258771.454852:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [783:783:256:4294967295] 192.168.202.108@tcp LPNI seq info [782:782:8:4294967295] 00000400:00000200:3.0:1734258771.454862:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:0.0:1734258771.454869:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734258771.454869:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258771.454872:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734258771.454873:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734258771.454874:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258771.454876:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734258771.454880:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734258771.454882:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258771.454885:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [784:784:255:4294967295] 192.168.202.108@tcp LPNI seq info [783:783:7:4294967295] 00000800:00000200:3.0:1734258771.454891:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734258771.454892:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258771.454896:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734258771.454896:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:0.0:1734258771.454899:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734258771.454901:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258771.454905:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258771.454907:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258771.455081:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258771.455085:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:1.0:1734258771.455090:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258771.455096:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258771.455100:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:1.0:1734258771.455102:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:1.0:1734258771.455111:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098262528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258787 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258771.455186:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258771.455189:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734258771.455192:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258771.455195:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258771.455197:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:1.0:1734258771.455199:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:1.0:1734258771.455204:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098262656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258781 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258771.459524:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258771.459545:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618680 00000400:00000200:0.0:1734258771.459555:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x196d [1] + 0 00000400:00000200:0.0:1734258771.459602:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258771.459606:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258771.459618:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098262656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258781 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258771.459662:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258771.459667:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618600 00000400:00000200:0.0:1734258771.459672:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1969 [1] + 224 00000400:00000200:0.0:1734258771.459690:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258771.459693:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258771.459699:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098262528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258787 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258771.459808:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d507e8. 00000400:00000200:2.0:1734258771.459813:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:2.0:1734258771.459815:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:2.0:1734258771.459820:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098262656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258781 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258771.459826:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098262656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258781 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258771.459859:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258771.459864:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258771.459869:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:3.0:1734258771.459945:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258771.459950:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258771.459951:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258771.459956:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098262528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258787 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258771.459962:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098262528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258787 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258771.459973:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734258771.459978:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734258771.459979:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258776.460487:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258776.460506:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258776.460565:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258776.460589:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258776.460620:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734258776.460627:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258776.460633:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258776.460638:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098262784, portal 25 00000400:00000010:1.0:1734258776.460641:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 00000100:00000200:1.0:1734258776.460643:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098262784, offset 0 00000400:00000200:1.0:1734258776.460649:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258776.460660:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258776.460665:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258776.460668:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258776.460671:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 02000000:00000010:2.0:1734258776.460677:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258776.460681:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:1.0:1734258776.460682:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258776.460684:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [785:785:256:4294967295] 192.168.202.108@tcp LPNI seq info [784:784:8:4294967295] 00000400:00000010:2.0:1734258776.460685:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258776.460687:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098262912, portal 10 00000400:00000200:1.0:1734258776.460692:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258776.460697:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734258776.460697:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734258776.460698:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098262912, offset 0 00000800:00000010:1.0:1734258776.460700:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000400:00000200:2.0:1734258776.460703:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734258776.460705:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734258776.460708:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258776.460711:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258776.460713:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258776.460714:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258776.460716:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258776.460718:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [786:786:255:4294967295] 192.168.202.108@tcp LPNI seq info [785:785:7:4294967295] 00000400:00000200:2.0:1734258776.460723:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258776.460726:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258776.460729:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258776.460731:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258776.460735:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258776.460738:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258776.460790:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258776.460792:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258776.461021:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258776.461023:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258776.461031:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258776.461035:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258776.461038:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734258776.461039:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734258776.461045:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098262912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258786 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258776.461102:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258776.461104:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734258776.461106:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258776.461109:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258776.461111:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:0.0:1734258776.461112:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:0.0:1734258776.461115:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098262784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258792 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258776.463167:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258776.463180:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618780 00000400:00000200:0.0:1734258776.463187:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1981 [1] + 0 00000400:00000200:0.0:1734258776.463204:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258776.463208:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258776.463216:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098262912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258786 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258776.463361:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:2.0:1734258776.463366:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734258776.463368:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258776.463372:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098262912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258786 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258776.463378:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098262912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258786 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258776.463402:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258776.463407:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258776.463411:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734258776.463978:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258776.463986:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618700 00000400:00000200:0.0:1734258776.463991:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1979 [1] + 224 00000400:00000200:0.0:1734258776.464003:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258776.464006:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258776.464011:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098262784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258792 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258776.464728:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258776.464734:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258776.464735:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258776.464741:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098262784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258792 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258776.464748:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098262784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258792 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258776.464762:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734258776.464766:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734258776.464768:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258781.467672:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258781.467699:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258781.467755:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258781.467761:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258781.467818:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258781.467824:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000010:2.0:1734258781.467829:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258781.467834:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098263168, portal 10 00000400:00000010:2.0:1734258781.467838:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258781.467843:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098263168, offset 0 00000400:00000200:2.0:1734258781.467850:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258781.467859:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258781.467862:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258781.467865:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258781.467867:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258781.467869:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258781.467870:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [787:787:256:4294967295] 192.168.202.108@tcp LPNI seq info [786:786:8:4294967295] 00000400:00000200:2.0:1734258781.467876:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258781.467879:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258781.467882:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258781.467886:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258781.467892:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258781.467894:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258781.467988:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734258781.467992:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258781.467995:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258781.467997:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098263040, portal 25 00000400:00000010:3.0:1734258781.467999:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734258781.468001:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098263040, offset 0 00000400:00000200:3.0:1734258781.468005:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258781.468009:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258781.468011:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258781.468013:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258781.468014:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258781.468016:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258781.468018:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [788:788:255:4294967295] 192.168.202.108@tcp LPNI seq info [787:787:7:4294967295] 00000400:00000200:3.0:1734258781.468027:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258781.468030:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258781.468032:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734258781.468035:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258781.468038:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258781.468040:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258781.468228:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258781.468231:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258781.468236:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258781.468239:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258781.468243:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734258781.468244:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734258781.468250:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098263168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258791 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258781.469170:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258781.469174:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734258781.469178:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258781.469181:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258781.469184:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:0.0:1734258781.469185:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:0.0:1734258781.469190:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098263040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258797 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258781.471470:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258781.471485:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618800 00000400:00000200:0.0:1734258781.471692:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1991 [1] + 224 00000400:00000200:0.0:1734258781.471713:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258781.471717:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258781.471725:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098263040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258797 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258781.471790:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258781.471794:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258781.471796:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258781.471801:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098263040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258797 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258781.471808:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098263040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258797 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258781.471829:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734258781.471834:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000400:00000200:0.0:1734258781.471835:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000100:00000010:3.0:1734258781.471837:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734258781.471841:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618880 00000400:00000200:0.0:1734258781.471845:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1989 [1] + 0 00000400:00000200:0.0:1734258781.472094:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258781.472105:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258781.472110:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098263168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258791 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258781.473664:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:2.0:1734258781.473672:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734258781.473673:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258781.473681:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098263168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258791 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258781.473687:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098263168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258791 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258781.473707:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258781.473712:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258781.473715:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258786.475684:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258786.475704:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258786.475766:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258786.475773:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734258786.475820:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734258786.475827:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50790. 00000400:00000010:0.0:1734258786.475833:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:0.0:1734258786.475841:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098263424, portal 10 00000400:00000010:0.0:1734258786.475846:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000100:00000200:0.0:1734258786.475848:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098263424, offset 0 00000400:00000200:0.0:1734258786.475855:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734258786.475864:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000200:0.0:1734258786.475869:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734258786.475869:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000010:2.0:1734258786.475872:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000400:00000200:0.0:1734258786.475874:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:2.0:1734258786.475874:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098263296, portal 25 00000400:00000200:0.0:1734258786.475877:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:2.0:1734258786.475877:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258786.475878:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098263296, offset 0 00000400:00000200:0.0:1734258786.475880:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258786.475882:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258786.475884:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [789:789:256:4294967295] 192.168.202.108@tcp LPNI seq info [788:788:8:4294967295] 00000400:00000200:2.0:1734258786.475893:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258786.475896:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:2.0:1734258786.475900:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:0.0:1734258786.475901:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258786.475902:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734258786.475904:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000400:00000200:2.0:1734258786.475904:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258786.475906:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258786.475907:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734258786.475909:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734258786.475909:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [790:790:255:4294967295] 192.168.202.108@tcp LPNI seq info [789:789:7:4294967295] 00000400:00000200:2.0:1734258786.475914:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258786.475916:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258786.475917:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734258786.475919:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 00000800:00000010:2.0:1734258786.475919:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258786.475922:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258786.475924:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258786.475926:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258786.476167:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258786.476170:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734258786.476174:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258786.476178:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258786.476182:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:1.0:1734258786.476184:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:1.0:1734258786.476190:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098263424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258796 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258786.476255:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258786.476257:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258786.476260:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258786.476262:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258786.476264:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:1.0:1734258786.476270:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:1.0:1734258786.476273:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098263296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258802 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258786.478323:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258786.478339:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618900 00000400:00000200:0.0:1734258786.478347:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x19a1 [1] + 224 00000400:00000200:0.0:1734258786.478367:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258786.478370:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258786.478392:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098263296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258802 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258786.478944:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258786.478950:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618980 00000400:00000200:0.0:1734258786.478954:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1999 [1] + 0 00000400:00000200:0.0:1734258786.478969:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258786.478971:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258786.478976:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098263424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258796 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258786.479314:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50790. 00000400:00000200:1.0:1734258786.479319:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:1.0:1734258786.479321:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:1.0:1734258786.479326:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098263424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258796 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258786.479331:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098263424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258796 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258786.479359:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258786.479363:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734258786.479369:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:2.0:1734258786.479454:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:2.0:1734258786.479458:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734258786.479459:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258786.479465:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098263296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258802 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258786.479471:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098263296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258802 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258786.479481:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734258786.479483:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734258786.479484:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258791.483688:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258791.484063:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258791.484120:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258791.484127:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734258791.484172:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734258791.484179:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000010:2.0:1734258791.484184:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 02000000:00000010:1.0:1734258791.484188:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000100:00000200:2.0:1734258791.484190:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098263552, portal 25 00000400:00000010:1.0:1734258791.484194:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:2.0:1734258791.484194:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258791.484196:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098263552, offset 0 00000400:00000010:1.0:1734258791.484198:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000400:00000200:2.0:1734258791.484203:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258791.484214:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258791.484227:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258791.484231:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258791.484233:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258791.484235:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258791.484238:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [791:791:256:4294967295] 192.168.202.108@tcp LPNI seq info [790:790:8:4294967295] 00000400:00000200:2.0:1734258791.484246:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258791.484250:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258791.484255:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258791.484259:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258791.484266:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258791.484269:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:1.0:1734258791.484331:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098263680, portal 10 00000400:00000010:1.0:1734258791.484336:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734258791.484338:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098263680, offset 0 00000400:00000200:1.0:1734258791.484369:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258791.484374:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258791.484376:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258791.484378:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258791.484380:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258791.484381:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258791.484383:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [792:792:255:4294967295] 192.168.202.108@tcp LPNI seq info [791:791:7:4294967295] 00000400:00000200:1.0:1734258791.484388:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258791.484392:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258791.484395:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734258791.484398:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258791.484401:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258791.484409:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258791.484507:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258791.484510:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258791.484515:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258791.484519:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258791.484522:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:0.0:1734258791.484524:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:0.0:1734258791.484531:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098263552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258807 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258791.485582:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258791.485587:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734258791.485593:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258791.485598:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258791.485602:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734258791.485604:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734258791.485611:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098263680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258801 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258791.490814:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258791.490831:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618a00 00000400:00000200:0.0:1734258791.490839:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x19a9 [1] + 224 00000400:00000200:0.0:1734258791.490850:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258791.490853:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258791.490864:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098263552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258807 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258791.490903:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258791.490908:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618a80 00000400:00000200:0.0:1734258791.490913:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x19b1 [1] + 0 00000400:00000200:0.0:1734258791.490930:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258791.490933:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258791.490938:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098263680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258801 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258791.491003:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258791.491008:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258791.491010:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258791.491016:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098263680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258801 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258791.491022:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098263680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258801 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258791.491049:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258791.491054:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734258791.491059:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:2.0:1734258791.492465:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:2.0:1734258791.492473:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734258791.492475:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258791.492484:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098263552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258807 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258791.492491:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098263552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258807 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258791.492506:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734258791.492510:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734258791.492513:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258796.491706:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258796.491724:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258796.491819:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:3.0:1734258796.491840:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734258796.491847:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258796.491854:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258796.491860:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098263808, portal 25 00000400:00000010:3.0:1734258796.491863:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734258796.491865:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098263808, offset 0 02000000:00000010:0.0:1734258796.491934:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734258796.491968:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734258796.491971:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50738. 00000400:00000200:3.0:1734258796.491974:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258796.491989:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258796.491993:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258796.491996:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258796.491999:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258796.492001:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258796.492003:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [793:793:256:4294967295] 192.168.202.108@tcp LPNI seq info [792:792:8:4294967295] 00000400:00000200:3.0:1734258796.492010:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258796.492025:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258796.492028:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258796.492033:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258796.492041:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258796.492044:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258796.492135:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258796.492138:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:3.0:1734258796.492141:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258796.492145:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:0.0:1734258796.492330:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000100:00000200:0.0:1734258796.492334:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098263936, portal 10 00000400:00000010:0.0:1734258796.492338:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734258796.492339:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098263936, offset 0 00000400:00000200:0.0:1734258796.492345:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258796.492349:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258796.492352:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258796.492353:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258796.492359:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258796.492361:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258796.492363:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [794:794:255:4294967295] 192.168.202.108@tcp LPNI seq info [793:793:7:4294967295] 00000400:00000200:0.0:1734258796.492368:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258796.492372:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258796.492374:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734258796.492377:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258796.492380:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258796.492383:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734258796.492509:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:3.0:1734258796.492512:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734258796.492519:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098263808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258812 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734258796.492556:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258796.492558:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:3.0:1734258796.492560:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258796.492562:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258796.492564:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:3.0:1734258796.492565:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:3.0:1734258796.492599:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098263936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258806 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258796.494037:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258796.494050:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618b00 00000400:00000200:0.0:1734258796.494057:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x19b9 [1] + 224 00000400:00000200:0.0:1734258796.494074:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258796.494078:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258796.494087:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098263808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258812 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258796.494233:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258796.494237:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258796.494240:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258796.494245:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098263808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258812 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258796.494252:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098263808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258812 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258796.494276:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734258796.494282:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734258796.494285:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000200:0.0:1734258796.494672:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258796.494679:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618b80 00000400:00000200:0.0:1734258796.494684:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x19c1 [1] + 0 00000400:00000200:0.0:1734258796.494693:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258796.494695:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258796.494699:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098263936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258806 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258796.494776:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50738. 00000400:00000200:2.0:1734258796.494780:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:2.0:1734258796.494781:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:2.0:1734258796.494785:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098263936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258806 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258796.494790:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098263936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258806 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258796.494806:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734258796.494809:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734258796.494816:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258801.502373:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258801.502396:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258801.502455:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258801.502462:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258801.502527:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258801.502536:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258801.502542:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258801.502546:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098264192, portal 10 00000400:00000010:3.0:1734258801.502550:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734258801.502551:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098264192, offset 0 00000400:00000200:3.0:1734258801.502557:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258801.502602:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258801.502606:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258801.502609:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258801.502612:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258801.502613:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258801.502615:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [795:795:256:4294967295] 192.168.202.108@tcp LPNI seq info [794:794:8:4294967295] 00000400:00000200:3.0:1734258801.502620:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258801.502623:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258801.502626:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258801.502630:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258801.502636:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258801.502639:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734258801.502727:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258801.502729:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:3.0:1734258801.502732:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258801.502735:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258801.502739:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:3.0:1734258801.502741:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734258801.502746:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098264192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258811 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258801.503965:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734258801.503971:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000010:2.0:1734258801.503976:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258801.503979:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098264064, portal 25 00000400:00000010:2.0:1734258801.503982:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734258801.503983:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098264064, offset 0 00000400:00000200:2.0:1734258801.503988:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258801.503995:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258801.503999:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258801.504001:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258801.504003:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258801.504004:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258801.504007:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [796:796:256:4294967295] 192.168.202.108@tcp LPNI seq info [795:795:8:4294967295] 00000400:00000200:2.0:1734258801.504013:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258801.504016:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258801.504019:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258801.504023:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258801.504102:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258801.504105:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258801.504358:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258801.504374:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258801.504378:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258801.504385:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258801.504389:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734258801.504391:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734258801.504399:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098264064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258817 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258801.504854:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258801.504866:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618c80 00000400:00000200:0.0:1734258801.504873:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x19c9 [1] + 0 00000400:00000200:0.0:1734258801.504890:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258801.504894:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258801.504900:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098264192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258811 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258801.505114:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258801.505119:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258801.505121:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258801.505125:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098264192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258811 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258801.505137:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098264192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258811 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258801.505164:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258801.505169:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258801.505174:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000200:0.0:1734258801.507546:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258801.507563:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618c00 00000400:00000200:0.0:1734258801.507599:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x19d1 [1] + 224 00000400:00000200:0.0:1734258801.507620:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258801.507625:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258801.507634:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098264064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258817 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258801.507724:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:2.0:1734258801.507805:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:2.0:1734258801.507807:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258801.507821:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098264064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258817 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258801.507829:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098264064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258817 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258801.507852:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734258801.507857:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734258801.507860:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734258806.507709:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258806.507731:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258806.508181:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258806.508190:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:0.0:1734258806.508268:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734258806.508275:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d506e0. 00000400:00000010:0.0:1734258806.508280:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734258806.508286:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098264448, portal 10 00000400:00000010:0.0:1734258806.508307:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734258806.508309:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098264448, offset 0 00000400:00000200:0.0:1734258806.508317:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258806.508329:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258806.508335:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258806.508339:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258806.508342:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258806.508343:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258806.508346:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [797:797:256:4294967295] 192.168.202.108@tcp LPNI seq info [796:796:8:4294967295] 00000400:00000200:0.0:1734258806.508354:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258806.508359:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258806.508362:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734258806.508367:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258806.508374:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258806.508379:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734258806.508598:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734258806.508603:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000010:2.0:1734258806.508606:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258806.508609:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098264320, portal 25 00000400:00000010:2.0:1734258806.508612:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258806.508614:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098264320, offset 0 00000400:00000200:2.0:1734258806.508618:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258806.508622:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258806.508624:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258806.508626:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258806.508628:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258806.508629:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258806.508631:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [798:798:255:4294967295] 192.168.202.108@tcp LPNI seq info [797:797:7:4294967295] 00000400:00000200:2.0:1734258806.508637:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258806.508640:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258806.508643:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258806.508645:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258806.508649:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258806.508650:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258806.508843:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258806.508846:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:1.0:1734258806.508851:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258806.508855:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258806.508859:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:1.0:1734258806.508861:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:1.0:1734258806.508868:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098264448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258816 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258806.508936:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258806.508938:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734258806.508940:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258806.508943:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258806.508945:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:1.0:1734258806.508946:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:1.0:1734258806.508949:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098264320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258822 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258806.513298:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258806.513316:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618d80 00000400:00000200:0.0:1734258806.513325:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x19d9 [1] + 0 00000400:00000200:0.0:1734258806.513347:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258806.513351:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258806.513362:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098264448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258816 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258806.515064:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258806.515073:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618d00 00000400:00000200:0.0:1734258806.515080:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x19e1 [1] + 224 00000400:00000200:0.0:1734258806.515095:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258806.515098:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258806.515107:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098264320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258822 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258806.515256:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:3.0:1734258806.515261:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:3.0:1734258806.515263:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:3.0:1734258806.515268:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098264320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258822 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258806.515274:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098264320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258822 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258806.515295:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:3.0:1734258806.515299:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734258806.515303:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:2.0:1734258806.515356:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d506e0. 00000400:00000200:2.0:1734258806.515360:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:2.0:1734258806.515361:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:2.0:1734258806.515365:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098264448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258816 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258806.515371:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098264448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258816 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258806.515384:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258806.515387:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258806.515388:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258811.515970:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258811.515990:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258811.516052:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258811.516059:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734258811.516098:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734258811.516104:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50688. 00000400:00000010:0.0:1734258811.516110:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000100:00000200:0.0:1734258811.516116:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098264704, portal 10 00000400:00000010:0.0:1734258811.516122:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000100:00000200:0.0:1734258811.516123:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098264704, offset 0 00000400:00000200:0.0:1734258811.516142:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258811.516154:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258811.516159:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258811.516163:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258811.516166:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258811.516168:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258811.516170:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [799:799:256:4294967295] 192.168.202.108@tcp LPNI seq info [798:798:8:4294967295] 00000400:00000200:0.0:1734258811.516177:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258811.516182:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258811.516214:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000800:00000200:0.0:1734258811.516220:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258811.516227:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258811.516231:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258811.516502:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734258811.516507:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258811.516511:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258811.516514:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098264576, portal 25 00000400:00000010:3.0:1734258811.516517:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734258811.516518:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098264576, offset 0 00000400:00000200:3.0:1734258811.516523:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258811.516528:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258811.516530:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258811.516532:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258811.516534:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258811.516536:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258811.516538:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [800:800:255:4294967295] 192.168.202.108@tcp LPNI seq info [799:799:7:4294967295] 00000400:00000200:3.0:1734258811.516543:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258811.516561:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258811.516563:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258811.516566:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258811.516595:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258811.516597:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258811.517716:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258811.517721:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:1.0:1734258811.517726:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258811.517732:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258811.517737:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:1.0:1734258811.517746:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:1.0:1734258811.517755:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098264704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258821 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258811.517825:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258811.517827:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:1.0:1734258811.517829:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258811.517832:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258811.517834:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:1.0:1734258811.517835:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:1.0:1734258811.517839:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098264576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258827 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258811.521720:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258811.521736:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618e00 00000400:00000200:0.0:1734258811.521744:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x19f1 [1] + 224 00000400:00000200:0.0:1734258811.521760:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258811.521764:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258811.521789:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098264576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258827 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258811.521833:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258811.521837:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618e80 00000400:00000200:0.0:1734258811.521842:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x19e9 [1] + 0 00000400:00000200:0.0:1734258811.521853:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258811.521856:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258811.521861:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098264704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258821 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258811.522399:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258811.522405:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258811.522407:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258811.522412:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098264576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258827 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258811.522418:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098264576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258827 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258811.522439:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734258811.522446:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734258811.522450:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:1.0:1734258811.522524:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50688. 00000400:00000200:1.0:1734258811.522528:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:1.0:1734258811.522529:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000100:00000200:1.0:1734258811.522534:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098264704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258821 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258811.522540:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098264704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258821 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258811.522559:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258811.522563:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734258811.522565:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734258816.524763:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258816.524783:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258816.524838:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258816.524845:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734258816.524882:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258816.524884:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:0.0:1734258816.524888:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50aa8. 00000400:00000010:0.0:1734258816.524894:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734258816.524900:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098264960, portal 10 00000400:00000010:2.0:1734258816.524900:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734258816.524904:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000400:00000010:0.0:1734258816.524905:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1088. 00000100:00000200:0.0:1734258816.524907:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098264960, offset 0 00000100:00000200:2.0:1734258816.524907:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098264832, portal 25 00000400:00000010:2.0:1734258816.524910:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000400:00000200:0.0:1734258816.524916:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734258816.525002:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098264832, offset 0 00000400:00000200:2.0:1734258816.525008:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258816.525012:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258816.525017:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258816.525020:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258816.525023:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258816.525025:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258816.525027:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [801:801:256:4294967295] 192.168.202.108@tcp LPNI seq info [800:800:8:4294967295] 00000400:00000200:0.0:1734258816.525036:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258816.525041:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258816.525042:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734258816.525045:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000400:00000200:2.0:1734258816.525045:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258816.525047:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258816.525049:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258816.525051:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258816.525053:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [802:802:255:4294967295] 192.168.202.108@tcp LPNI seq info [801:801:7:4294967295] 00000800:00000200:0.0:1734258816.525056:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734258816.525059:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258816.525063:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258816.525063:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258816.525065:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:0.0:1734258816.525066:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258816.525068:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258816.525071:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258816.525073:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258816.525126:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258816.525128:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:2.0:1734258816.525133:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258816.525136:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258816.525139:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1088 00000400:00000010:2.0:1734258816.525141:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1088. 00000100:00000200:2.0:1734258816.525179:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098264960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258826 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258816.525247:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258816.525249:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:2.0:1734258816.525251:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258816.525254:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258816.525256:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:2.0:1734258816.525261:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258816.525265:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098264832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258832 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258816.526834:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258816.526849:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c618f80 00000400:00000200:0.0:1734258816.526857:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x19f9 [1] + 0 00000400:00000200:0.0:1734258816.526875:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258816.526879:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258816.526888:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098264960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258826 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258816.526954:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50aa8. 00000400:00000200:2.0:1734258816.526958:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:2.0:1734258816.526960:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:2.0:1734258816.526964:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098264960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258826 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258816.526975:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098264960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258826 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258816.527000:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258816.527004:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258816.527007:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734258816.528756:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258816.528771:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c618f00 00000400:00000200:0.0:1734258816.528779:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x19fd [1] + 224 00000400:00000200:0.0:1734258816.528796:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258816.528799:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258816.528808:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098264832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258832 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258816.528915:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734258816.528920:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:2.0:1734258816.528923:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258816.528928:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098264832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258832 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258816.528935:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098264832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258832 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258816.528958:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734258816.528962:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:2.0:1734258816.528966:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734258821.534235:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258821.534255:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258821.534313:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258821.534319:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258821.534419:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734258821.534426:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734258821.534432:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258821.534439:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098265088, portal 25 00000400:00000010:2.0:1734258821.534443:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258821.534444:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098265088, offset 0 00000400:00000200:2.0:1734258821.534453:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258821.534465:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258821.534479:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258821.534483:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258821.534485:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258821.534487:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258821.534489:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [803:803:256:4294967295] 192.168.202.108@tcp LPNI seq info [802:802:8:4294967295] 00000400:00000200:2.0:1734258821.534497:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258821.534502:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258821.534505:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258821.534510:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258821.534517:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258821.534520:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258821.534642:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258821.534645:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:2.0:1734258821.534647:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258821.534651:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258821.534654:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:2.0:1734258821.534656:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258821.534661:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098265088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258837 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258821.534727:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258821.534731:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258821.534734:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258821.534736:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098265216, portal 10 00000400:00000010:3.0:1734258821.534741:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734258821.534742:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098265216, offset 0 00000400:00000200:3.0:1734258821.534746:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258821.534750:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258821.534753:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258821.534755:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258821.534756:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258821.534758:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258821.534760:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [804:804:256:4294967295] 192.168.202.108@tcp LPNI seq info [803:803:8:4294967295] 00000400:00000200:3.0:1734258821.534765:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258821.534768:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258821.534775:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734258821.534777:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258821.534781:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258821.534783:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258821.534868:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258821.534870:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734258821.534872:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258821.534875:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258821.534877:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:0.0:1734258821.534878:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734258821.534882:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098265216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258821.536687:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258821.536708:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619000 00000400:00000200:0.0:1734258821.536717:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a09 [1] + 224 00000400:00000200:0.0:1734258821.536740:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258821.536745:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258821.536756:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098265088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258837 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258821.537157:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734258821.537163:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:2.0:1734258821.537165:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258821.537170:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098265088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258837 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258821.537177:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098265088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258837 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258821.537203:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734258821.537207:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734258821.537211:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734258821.537687:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258821.537695:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619080 00000400:00000200:0.0:1734258821.537701:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a11 [1] + 0 00000400:00000200:0.0:1734258821.537713:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258821.537716:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258821.537722:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098265216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258831 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258821.537812:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258821.537821:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258821.537823:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258821.537833:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098265216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258821.537841:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098265216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258831 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258821.537868:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258821.537872:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258821.537877:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258826.539746:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258826.539764:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258826.540247:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258826.540255:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734258826.540292:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734258826.540300:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50aa8. 00000400:00000010:0.0:1734258826.540306:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000100:00000200:0.0:1734258826.540311:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098265472, portal 10 00000400:00000010:0.0:1734258826.540315:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1000. 00000100:00000200:0.0:1734258826.540317:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098265472, offset 0 00000400:00000200:0.0:1734258826.540325:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258826.540335:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258826.540339:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258826.540342:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258826.540355:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258826.540357:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258826.540360:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [805:805:256:4294967295] 192.168.202.108@tcp LPNI seq info [804:804:8:4294967295] 00000400:00000200:0.0:1734258826.540368:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258826.540372:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258826.540375:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734258826.540380:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258826.540386:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258826.540389:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258826.540486:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734258826.540490:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258826.540493:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258826.540495:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098265344, portal 25 00000400:00000010:3.0:1734258826.540498:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734258826.540499:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098265344, offset 0 00000400:00000200:3.0:1734258826.540503:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258826.540507:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258826.540509:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258826.540511:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258826.540513:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258826.540514:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258826.540516:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [806:806:255:4294967295] 192.168.202.108@tcp LPNI seq info [805:805:7:4294967295] 00000400:00000200:3.0:1734258826.540522:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258826.540525:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258826.540527:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734258826.540541:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258826.540544:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258826.540546:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258826.540700:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258826.540703:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734258826.540707:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258826.540710:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258826.540713:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1000 00000400:00000010:1.0:1734258826.540715:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1000. 00000100:00000200:1.0:1734258826.540721:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098265472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258836 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258826.540774:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258826.540776:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734258826.540778:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258826.540785:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258826.540787:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:1.0:1734258826.540788:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:1.0:1734258826.540791:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098265344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258842 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258826.546593:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258826.546609:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619100 00000400:00000200:0.0:1734258826.546616:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a21 [1] + 224 00000400:00000200:0.0:1734258826.546627:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258826.546630:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258826.546638:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098265344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258842 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258826.546672:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258826.546676:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619180 00000400:00000200:0.0:1734258826.546680:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a19 [1] + 0 00000400:00000200:0.0:1734258826.546694:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258826.546697:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258826.546701:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098265472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258836 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258826.546791:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258826.546795:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258826.546797:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258826.546801:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098265344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258842 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258826.546808:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098265344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258842 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258826.546825:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734258826.546830:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734258826.546833:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:1.0:1734258826.546898:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50aa8. 00000400:00000200:1.0:1734258826.546901:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:1.0:1734258826.546902:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:1.0:1734258826.546907:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098265472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258836 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258826.546913:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098265472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258836 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258826.546928:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258826.546930:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734258826.546933:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258831.547753:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258831.547779:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258831.547839:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258831.547847:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734258831.547909:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 02000000:00000010:1.0:1734258831.547928:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:3.0:1734258831.547929:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:1.0:1734258831.547934:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:3.0:1734258831.547936:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000010:1.0:1734258831.547937:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258831.547943:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098265728, portal 10 00000100:00000200:3.0:1734258831.547943:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098265600, portal 25 00000400:00000010:3.0:1734258831.547948:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:1.0:1734258831.547949:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734258831.547950:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098265728, offset 0 00000100:00000200:3.0:1734258831.547950:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098265600, offset 0 00000400:00000200:3.0:1734258831.547959:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258831.547965:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258831.547974:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258831.547979:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258831.547982:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258831.547985:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258831.547987:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258831.547990:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [807:807:256:4294967295] 192.168.202.108@tcp LPNI seq info [806:806:8:4294967295] 00000400:00000200:3.0:1734258831.547998:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258831.548004:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258831.548007:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734258831.548013:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258831.548020:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258831.548070:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734258831.548136:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258831.548139:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258831.548141:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258831.548143:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258831.548145:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258831.548147:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [808:808:255:4294967295] 192.168.202.108@tcp LPNI seq info [807:807:7:4294967295] 00000400:00000200:1.0:1734258831.548152:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258831.548156:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258831.548159:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734258831.548167:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258831.548171:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258831.548173:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258831.548196:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258831.548205:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734258831.548209:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258831.548213:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258831.548217:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:0.0:1734258831.548219:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734258831.548226:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098265600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258847 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258831.548295:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258831.548297:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734258831.548299:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258831.548302:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258831.548304:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:0.0:1734258831.548306:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:0.0:1734258831.548310:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098265728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258841 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258831.550617:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258831.550690:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619280 00000400:00000200:0.0:1734258831.550699:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a2d [1] + 0 00000400:00000200:0.0:1734258831.550710:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258831.550714:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258831.550722:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098265728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258841 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258831.550801:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258831.550806:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619200 00000400:00000200:0.0:1734258831.550811:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a29 [1] + 224 00000400:00000200:0.0:1734258831.550828:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258831.550831:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258831.550835:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098265600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258847 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258831.550966:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258831.550970:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258831.550972:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258831.550977:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098265728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258841 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258831.550983:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098265728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258841 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258831.551006:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258831.551011:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258831.551016:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:3.0:1734258831.551055:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258831.551058:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258831.551059:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258831.551067:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098265600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258847 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258831.551073:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098265600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258847 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258831.551085:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734258831.551090:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734258831.551091:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258836.555702:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258836.555736:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258836.555794:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258836.555801:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734258836.555845:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258836.555845:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:0.0:1734258836.555853:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50688. 00000400:00000010:1.0:1734258836.555855:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258836.555860:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000400:00000010:0.0:1734258836.555861:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000100:00000200:1.0:1734258836.555867:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098265856, portal 25 00000400:00000010:1.0:1734258836.555871:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734258836.555874:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098265984, portal 10 00000100:00000200:1.0:1734258836.555875:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098265856, offset 0 00000400:00000010:0.0:1734258836.555880:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1000. 00000400:00000200:1.0:1734258836.555883:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734258836.555889:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098265984, offset 0 00000400:00000200:0.0:1734258836.555897:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258836.555897:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258836.555901:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258836.555905:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258836.555908:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258836.555909:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258836.555912:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [809:809:256:4294967295] 192.168.202.108@tcp LPNI seq info [808:808:8:4294967295] 00000400:00000200:1.0:1734258836.555919:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258836.555924:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258836.555927:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734258836.555928:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258836.555932:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734258836.555932:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734258836.555935:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258836.555938:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258836.555940:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258836.555942:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [810:810:255:4294967295] 192.168.202.108@tcp LPNI seq info [809:809:7:4294967295] 00000800:00000200:1.0:1734258836.555949:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734258836.555950:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258836.555952:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258836.555954:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258836.555958:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734258836.555962:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258836.555968:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258836.555971:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258836.556077:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258836.556084:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:2.0:1734258836.556089:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258836.556094:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258836.556098:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:2.0:1734258836.556100:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:2.0:1734258836.556107:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098265856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258852 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734258836.556820:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258836.556823:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:2.0:1734258836.556826:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258836.556830:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258836.556833:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1000 00000400:00000010:2.0:1734258836.556834:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1000. 00000100:00000200:2.0:1734258836.556839:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098265984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258846 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258836.561541:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258836.561565:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619380 00000400:00000200:0.0:1734258836.561604:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a3d [1] + 0 00000400:00000200:0.0:1734258836.561703:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258836.561708:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258836.561719:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098265984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258846 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258836.561772:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258836.561777:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619300 00000400:00000200:0.0:1734258836.561782:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a39 [1] + 224 00000400:00000200:0.0:1734258836.561793:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258836.561796:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258836.561802:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098265856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258852 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258836.562020:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50688. 00000400:00000200:2.0:1734258836.562032:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:2.0:1734258836.562034:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:2.0:1734258836.562046:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098265984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258846 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258836.562054:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098265984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258846 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258836.562087:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258836.562092:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734258836.562098:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:1.0:1734258836.562504:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258836.562508:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258836.562509:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258836.562515:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098265856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258852 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258836.562521:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098265856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258852 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258836.562533:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258836.562537:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734258836.562539:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258841.564289:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258841.564319:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258841.564382:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258841.564389:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734258841.564467:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000400:00000010:1.0:1734258841.564482:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258841.564493:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258841.564501:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098266112, portal 25 00000400:00000010:1.0:1734258841.564505:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734258841.564508:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098266112, offset 0 00000400:00000200:1.0:1734258841.564518:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258841.564535:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258841.564540:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:3.0:1734258841.564540:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000200:1.0:1734258841.564545:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:3.0:1734258841.564545:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:1.0:1734258841.564549:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:3.0:1734258841.564549:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000200:1.0:1734258841.564551:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:3.0:1734258841.564552:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098266240, portal 10 00000400:00000200:1.0:1734258841.564554:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [811:811:256:4294967295] 192.168.202.108@tcp LPNI seq info [810:810:8:4294967295] 00000400:00000010:3.0:1734258841.564555:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734258841.564557:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098266240, offset 0 00000400:00000200:3.0:1734258841.564561:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258841.564563:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258841.564612:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258841.564612:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258841.564614:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258841.564616:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000010:1.0:1734258841.564617:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000400:00000200:3.0:1734258841.564617:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258841.564619:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258841.564621:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [812:812:255:4294967295] 192.168.202.108@tcp LPNI seq info [811:811:7:4294967295] 00000800:00000200:1.0:1734258841.564623:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258841.564627:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258841.564631:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734258841.564632:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:3.0:1734258841.564634:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734258841.564637:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258841.564641:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258841.564644:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258841.564647:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258841.564856:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258841.564859:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734258841.564865:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258841.564869:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258841.564873:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734258841.564874:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734258841.564881:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098266240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258851 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258841.564946:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258841.564948:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734258841.564950:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258841.564953:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258841.564981:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:0.0:1734258841.564983:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:0.0:1734258841.564987:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098266112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258857 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258841.567120:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258841.567138:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619480 00000400:00000200:0.0:1734258841.567157:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a51 [1] + 0 00000400:00000200:0.0:1734258841.567170:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258841.567173:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258841.567182:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098266240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258851 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258841.567221:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258841.567225:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619400 00000400:00000200:0.0:1734258841.567230:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a49 [1] + 224 00000400:00000200:0.0:1734258841.567243:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258841.567247:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258841.567251:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098266112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258857 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258841.567317:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258841.567322:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258841.567324:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258841.567329:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098266112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258857 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258841.567335:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098266112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258857 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258841.567355:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734258841.567359:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734258841.567362:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000010:3.0:1734258841.567536:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258841.567541:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258841.567542:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258841.567547:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098266240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258851 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258841.567554:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098266240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258851 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258841.567598:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258841.567602:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:3.0:1734258841.567604:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734258846.571676:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258846.571696:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258846.571752:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258846.571758:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258846.571777:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734258846.571784:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 02000000:00000010:0.0:1734258846.571790:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:2.0:1734258846.571791:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000400:00000010:0.0:1734258846.571794:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d506e0. 00000100:00000200:2.0:1734258846.571797:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098266368, portal 25 00000400:00000010:0.0:1734258846.571798:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734258846.571800:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098266496, portal 10 00000400:00000010:2.0:1734258846.571801:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258846.571803:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098266368, offset 0 00000400:00000010:0.0:1734258846.571805:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1088. 00000100:00000200:0.0:1734258846.571806:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098266496, offset 0 00000400:00000200:2.0:1734258846.571811:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258846.571831:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258846.571836:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258846.571839:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258846.571842:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258846.571843:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258846.571846:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258846.571846:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [813:813:256:4294967295] 192.168.202.108@tcp LPNI seq info [812:812:8:4294967295] 00000400:00000200:2.0:1734258846.571853:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258846.571858:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258846.571861:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258846.571866:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258846.571872:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258846.571875:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258846.572095:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258846.572098:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734258846.572101:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258846.572105:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258846.572108:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:1.0:1734258846.572109:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:1.0:1734258846.572115:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098266368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258862 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258846.572186:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258846.572189:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258846.572191:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258846.572193:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258846.572194:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258846.572196:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [814:814:255:4294967295] 192.168.202.108@tcp LPNI seq info [813:813:7:4294967295] 00000400:00000200:0.0:1734258846.572202:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258846.572212:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258846.572214:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734258846.572217:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258846.572221:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258846.572223:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258846.572307:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258846.572309:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734258846.572311:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258846.572315:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258846.572317:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1088 00000400:00000010:1.0:1734258846.572318:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1088. 00000100:00000200:1.0:1734258846.572321:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098266496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258856 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258846.574869:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258846.574884:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619500 00000400:00000200:0.0:1734258846.574891:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a59 [1] + 224 00000400:00000200:0.0:1734258846.574901:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258846.574905:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258846.574914:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098266368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258862 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258846.574957:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258846.574961:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619580 00000400:00000200:0.0:1734258846.574965:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a5d [1] + 0 00000400:00000200:0.0:1734258846.574978:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258846.574981:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258846.574986:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098266496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258856 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258846.574994:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734258846.574999:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:2.0:1734258846.575001:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258846.575007:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098266368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258862 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258846.575013:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098266368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258862 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258846.575030:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734258846.575034:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734258846.575037:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:1.0:1734258846.575236:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d506e0. 00000400:00000200:1.0:1734258846.575240:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:1.0:1734258846.575241:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:1.0:1734258846.575245:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098266496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258856 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258846.575263:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098266496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258856 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258846.575279:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258846.575281:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734258846.575284:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258851.579706:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258851.579727:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258851.579831:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258851.579839:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734258851.580171:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734258851.580179:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258851.580186:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258851.580192:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098266624, portal 25 00000400:00000010:3.0:1734258851.580197:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734258851.580198:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098266624, offset 0 00000400:00000200:3.0:1734258851.580207:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258851.580221:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258851.580226:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258851.580230:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258851.580233:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258851.580235:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258851.580238:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [815:815:256:4294967295] 192.168.202.108@tcp LPNI seq info [814:814:8:4294967295] 00000400:00000200:3.0:1734258851.580245:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258851.580251:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258851.580253:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258851.580259:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258851.580266:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258851.580269:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734258851.580385:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258851.580398:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:3.0:1734258851.580401:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258851.580405:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258851.580408:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:3.0:1734258851.580410:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734258851.580416:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098266624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258867 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258851.580510:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258851.580515:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258851.580518:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258851.580520:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098266752, portal 10 00000400:00000010:1.0:1734258851.580529:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734258851.580530:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098266752, offset 0 00000400:00000200:1.0:1734258851.580534:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258851.580539:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258851.580541:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258851.580547:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258851.580549:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258851.580550:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258851.580552:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [816:816:256:4294967295] 192.168.202.108@tcp LPNI seq info [815:815:8:4294967295] 00000400:00000200:1.0:1734258851.580558:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258851.580561:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258851.580564:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734258851.580592:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258851.580597:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258851.580599:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258851.580917:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258851.580919:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:2.0:1734258851.580922:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258851.580925:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258851.580927:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:2.0:1734258851.580928:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:2.0:1734258851.580932:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098266752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258861 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258851.582831:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258851.582844:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619600 00000400:00000200:0.0:1734258851.582852:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a69 [1] + 224 00000400:00000200:0.0:1734258851.582869:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258851.582887:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258851.582896:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098266624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258867 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258851.583048:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258851.583053:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258851.583054:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258851.583059:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098266624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258867 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258851.583066:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098266624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258867 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258851.583085:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734258851.583089:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:3.0:1734258851.583092:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734258851.583757:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258851.583764:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619680 00000400:00000200:0.0:1734258851.583769:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a71 [1] + 0 00000400:00000200:0.0:1734258851.583780:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258851.583783:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258851.583787:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098266752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258861 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258851.583959:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258851.583963:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258851.583964:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258851.583969:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098266752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258861 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258851.583983:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098266752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258861 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258851.583998:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258851.584002:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734258851.584004:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258856.587723:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258856.587746:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258856.587813:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258856.587821:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734258856.587910:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734258856.587918:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50738. 00000400:00000010:0.0:1734258856.587923:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000100:00000200:0.0:1734258856.587931:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098267008, portal 10 02000000:00000010:1.0:1734258856.587991:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734258856.587995:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258856.587998:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258856.588000:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098266880, portal 25 00000400:00000010:1.0:1734258856.588004:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734258856.588006:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098266880, offset 0 00000400:00000200:1.0:1734258856.588014:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258856.588031:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258856.588036:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258856.588040:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258856.588043:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258856.588045:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258856.588047:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [817:817:256:4294967295] 192.168.202.108@tcp LPNI seq info [816:816:8:4294967295] 00000400:00000200:1.0:1734258856.588055:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258856.588060:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258856.588064:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734258856.588069:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258856.588076:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258856.588079:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:0.0:1734258856.588222:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000100:00000200:0.0:1734258856.588228:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098267008, offset 0 00000400:00000200:0.0:1734258856.588275:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258856.588279:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258856.588281:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258856.588283:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258856.588285:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258856.588287:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258856.588289:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [818:818:255:4294967295] 192.168.202.108@tcp LPNI seq info [817:817:7:4294967295] 00000400:00000200:0.0:1734258856.588295:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258856.588298:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258856.588311:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000800:00000200:0.0:1734258856.588314:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258856.588318:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258856.588320:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734258856.588470:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258856.588473:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:3.0:1734258856.588476:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258856.588481:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258856.588484:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:3.0:1734258856.588486:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:3.0:1734258856.588492:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098266880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258872 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734258856.588623:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258856.588625:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:3.0:1734258856.588627:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258856.588631:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258856.588633:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:3.0:1734258856.588634:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:3.0:1734258856.588638:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098267008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258866 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258856.592085:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258856.592106:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619700 00000400:00000200:0.0:1734258856.592114:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a7d [1] + 224 00000400:00000200:0.0:1734258856.592125:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258856.592128:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258856.592138:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098266880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258872 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258856.592298:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258856.592303:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619780 00000400:00000010:1.0:1734258856.592304:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258856.592309:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258856.592311:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000400:00000200:0.0:1734258856.592316:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a79 [1] + 0 00000100:00000200:1.0:1734258856.592316:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098266880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258872 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258856.592332:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258856.592335:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:1.0:1734258856.592335:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098266880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258872 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734258856.592340:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098267008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258866 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258856.592357:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 00000400:00000010:2.0:1734258856.592404:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50738. 00000400:00000200:2.0:1734258856.592412:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:2.0:1734258856.592414:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000100:00000200:2.0:1734258856.592418:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098267008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258866 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258856.592423:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098267008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258866 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258856.592438:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258856.592443:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258856.592446:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 02000000:00000010:1.0:1734258856.592484:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734258856.592486:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258861.595985:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258861.596004:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258861.596059:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258861.596070:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258861.596103:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734258861.596110:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258861.596116:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258861.596122:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098267136, portal 25 00000400:00000010:1.0:1734258861.596125:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734258861.596127:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098267136, offset 0 00000400:00000200:1.0:1734258861.596134:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258861.596145:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258861.596149:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258861.596153:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258861.596155:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258861.596157:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258861.596160:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [819:819:256:4294967295] 192.168.202.108@tcp LPNI seq info [818:818:8:4294967295] 00000400:00000200:1.0:1734258861.596167:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258861.596171:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258861.596174:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 02000000:00000010:3.0:1734258861.596214:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258861.596219:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258861.596221:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258861.596223:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098267264, portal 10 00000400:00000010:3.0:1734258861.596227:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734258861.596229:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098267264, offset 0 00000400:00000200:3.0:1734258861.596232:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258861.596237:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258861.596238:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258861.596240:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258861.596242:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258861.596243:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258861.596245:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [820:820:255:4294967295] 192.168.202.108@tcp LPNI seq info [819:819:7:4294967295] 00000400:00000200:3.0:1734258861.596250:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258861.596253:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258861.596256:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734258861.596259:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258861.596267:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258861.596271:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258861.596319:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258861.596323:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258861.596326:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258861.596337:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258861.596340:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734258861.596344:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258861.596349:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258861.596352:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734258861.596354:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734258861.596359:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098267264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258871 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258861.596433:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258861.596435:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734258861.596437:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258861.596440:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258861.596442:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734258861.596443:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734258861.596446:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098267136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258877 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258861.598369:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258861.598382:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619800 00000400:00000200:0.0:1734258861.598389:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a89 [1] + 224 00000400:00000200:0.0:1734258861.598400:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258861.598403:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258861.598410:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098267136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258877 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258861.598448:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258861.598453:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619880 00000400:00000200:0.0:1734258861.598457:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a91 [1] + 0 00000400:00000200:0.0:1734258861.598471:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258861.598474:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258861.598479:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098267264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258871 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258861.598668:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258861.598673:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258861.598675:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258861.598683:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098267136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258877 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258861.598700:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098267136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258877 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258861.598717:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734258861.598721:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734258861.598724:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:3.0:1734258861.598792:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258861.598796:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258861.598797:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258861.598800:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098267264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258871 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258861.598842:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098267264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258871 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258861.598862:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258861.598865:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258861.598868:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258866.603679:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258866.603699:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258866.603752:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258866.603759:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:0.0:1734258866.603814:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734258866.603814:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:0.0:1734258866.603821:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50790. 00000400:00000010:2.0:1734258866.603826:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734258866.603833:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000400:00000010:0.0:1734258866.603837:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:2.0:1734258866.603840:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098267392, portal 25 00000100:00000200:0.0:1734258866.603843:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098267520, portal 10 00000400:00000010:2.0:1734258866.603846:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000400:00000010:0.0:1734258866.603848:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:2.0:1734258866.603848:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098267392, offset 0 00000100:00000200:0.0:1734258866.603850:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098267520, offset 0 00000400:00000200:2.0:1734258866.603858:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258866.603868:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258866.603872:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258866.603878:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258866.603882:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258866.603885:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258866.603888:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258866.603891:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [821:821:256:4294967295] 192.168.202.108@tcp LPNI seq info [820:820:8:4294967295] 00000400:00000200:2.0:1734258866.603899:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258866.603905:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258866.603909:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258866.603910:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258866.603915:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:2.0:1734258866.603915:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734258866.603918:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258866.603921:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258866.603924:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734258866.603924:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734258866.603926:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [822:822:255:4294967295] 192.168.202.108@tcp LPNI seq info [821:821:7:4294967295] 00000800:00000200:2.0:1734258866.603928:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734258866.603934:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258866.603939:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258866.603943:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734258866.603947:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258866.603957:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258866.603961:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258866.604065:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258866.604069:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734258866.604074:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258866.604079:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258866.604082:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:1.0:1734258866.604084:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:1.0:1734258866.604091:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098267392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258882 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258866.604164:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258866.604166:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734258866.604168:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258866.604171:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258866.604173:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:1.0:1734258866.604175:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:1.0:1734258866.604179:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098267520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258876 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258866.606073:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258866.606089:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619900 00000400:00000200:0.0:1734258866.606097:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1a99 [1] + 224 00000400:00000200:0.0:1734258866.606109:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258866.606113:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258866.606122:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098267392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258882 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258866.606162:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258866.606166:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619980 00000400:00000200:0.0:1734258866.606171:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1a9d [1] + 0 00000400:00000200:0.0:1734258866.606187:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258866.606190:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258866.606202:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098267520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258876 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258866.606293:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734258866.606297:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:2.0:1734258866.606304:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258866.606309:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098267392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258882 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258866.606315:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098267392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258882 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258866.606340:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734258866.606344:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734258866.606347:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:1.0:1734258866.606410:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50790. 00000400:00000200:1.0:1734258866.606413:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:1.0:1734258866.606414:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:1.0:1734258866.606419:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098267520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258876 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258866.606424:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098267520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258876 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258866.606441:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258866.606444:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734258866.606452:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258871.611781:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258871.611810:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258871.611883:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258871.611891:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258871.612147:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258871.612162:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258871.612171:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258871.612180:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098267776, portal 10 00000400:00000010:1.0:1734258871.612187:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734258871.612189:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098267776, offset 0 02000000:00000010:2.0:1734258871.612190:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734258871.612196:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000200:1.0:1734258871.612202:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734258871.612207:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000400:00000200:1.0:1734258871.612215:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258871.612220:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258871.612224:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258871.612227:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258871.612229:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258871.612232:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [823:823:256:4294967295] 192.168.202.108@tcp LPNI seq info [822:822:8:4294967295] 00000400:00000200:1.0:1734258871.612239:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258871.612244:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734258871.612245:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098267648, portal 25 00000800:00000010:1.0:1734258871.612248:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000400:00000010:2.0:1734258871.612249:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734258871.612251:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098267648, offset 0 00000800:00000200:1.0:1734258871.612254:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734258871.612256:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734258871.612261:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734258871.612262:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734258871.612264:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734258871.612264:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258871.612266:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258871.612268:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258871.612270:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258871.612272:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [824:824:255:4294967295] 192.168.202.108@tcp LPNI seq info [823:823:7:4294967295] 00000400:00000200:2.0:1734258871.612278:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258871.612282:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258871.612284:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258871.612287:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258871.612291:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258871.612293:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258871.612382:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258871.612385:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734258871.612391:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258871.612396:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258871.612400:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734258871.612401:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734258871.612409:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098267776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258881 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258871.612474:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258871.612476:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734258871.612479:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258871.612482:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258871.612484:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734258871.612485:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734258871.612489:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098267648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258887 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258871.614330:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258871.614346:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619a00 00000400:00000200:0.0:1734258871.614426:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ab1 [1] + 224 00000400:00000200:0.0:1734258871.614441:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258871.614445:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258871.614454:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098267648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258887 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258871.614493:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258871.614502:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619a80 00000400:00000200:0.0:1734258871.614507:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1aa9 [1] + 0 00000400:00000200:0.0:1734258871.614521:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258871.614523:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258871.614529:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098267776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258881 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258871.614537:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734258871.614542:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:2.0:1734258871.614544:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258871.614551:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098267648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258887 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258871.614563:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098267648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258887 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258871.614628:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734258871.614633:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734258871.614636:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:1.0:1734258871.614646:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258871.614654:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258871.614655:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258871.614660:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098267776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258881 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258871.614666:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098267776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258881 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258871.614685:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258871.614689:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734258871.614692:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258876.619759:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258876.619788:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258876.619856:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258876.619865:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734258876.619916:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734258876.619923:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d507e8. 00000400:00000010:0.0:1734258876.619931:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000100:00000200:0.0:1734258876.619940:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098268032, portal 10 00000400:00000010:0.0:1734258876.619947:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734258876.619949:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098268032, offset 0 00000400:00000200:0.0:1734258876.619959:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258876.619974:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258876.619979:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258876.619983:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258876.619986:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258876.619989:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258876.619991:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [825:825:256:4294967295] 192.168.202.108@tcp LPNI seq info [824:824:8:4294967295] 00000400:00000200:0.0:1734258876.619999:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258876.620005:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258876.620009:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734258876.620014:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258876.620024:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258876.620027:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734258876.620201:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734258876.620206:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258876.620210:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258876.620213:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098267904, portal 25 00000400:00000010:1.0:1734258876.620216:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734258876.620217:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098267904, offset 0 00000400:00000200:1.0:1734258876.620222:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258876.620226:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258876.620229:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258876.620231:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258876.620233:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258876.620234:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258876.620236:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [826:826:255:4294967295] 192.168.202.108@tcp LPNI seq info [825:825:7:4294967295] 00000400:00000200:1.0:1734258876.620242:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258876.620246:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258876.620248:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734258876.620251:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258876.620255:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258876.620256:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258876.620287:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258876.620290:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:0.0:1734258876.620292:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258876.620297:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258876.620301:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:0.0:1734258876.620303:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734258876.620309:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098268032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258886 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258876.620338:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258876.620340:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734258876.620343:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258876.620345:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258876.620347:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:0.0:1734258876.620348:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:0.0:1734258876.620351:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098267904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258892 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258876.622116:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258876.622133:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619b00 00000400:00000200:0.0:1734258876.622141:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ac1 [1] + 224 00000400:00000200:0.0:1734258876.622161:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258876.622165:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258876.622174:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098267904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258892 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258876.622306:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258876.622311:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258876.622313:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258876.622318:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098267904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258892 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258876.622326:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098267904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258892 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258876.622350:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734258876.622355:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734258876.622359:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000200:0.0:1734258876.622793:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258876.622800:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619b80 00000400:00000200:0.0:1734258876.622805:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ab9 [1] + 0 00000400:00000200:0.0:1734258876.622815:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258876.622818:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258876.622824:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098268032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258886 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258876.623018:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d507e8. 00000400:00000200:2.0:1734258876.623022:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:2.0:1734258876.623024:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:2.0:1734258876.623029:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098268032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258886 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258876.623034:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098268032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258886 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258876.623057:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258876.623060:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734258876.623063:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258881.627751:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258881.627775:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734258881.627836:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258881.627844:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258881.627950:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734258881.627959:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734258881.627966:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258881.627974:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098268160, portal 25 00000400:00000010:2.0:1734258881.627982:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734258881.627984:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098268160, offset 0 00000400:00000200:2.0:1734258881.627993:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258881.628008:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258881.628014:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258881.628018:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258881.628021:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258881.628023:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258881.628026:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [827:827:256:4294967295] 192.168.202.108@tcp LPNI seq info [826:826:8:4294967295] 00000400:00000200:2.0:1734258881.628035:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258881.628056:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258881.628060:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258881.628067:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258881.628076:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258881.628081:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258881.628150:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258881.628156:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258881.628159:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258881.628161:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098268288, portal 10 00000400:00000010:3.0:1734258881.628166:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734258881.628167:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098268288, offset 0 00000400:00000200:3.0:1734258881.628171:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258881.628175:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258881.628176:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258881.628178:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258881.628179:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258881.628180:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258881.628182:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [828:828:255:4294967295] 192.168.202.108@tcp LPNI seq info [827:827:7:4294967295] 00000400:00000200:3.0:1734258881.628186:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258881.628188:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258881.628190:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734258881.628192:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258881.628194:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258881.628195:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258881.628241:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258881.628244:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258881.628249:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258881.628253:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258881.628257:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734258881.628259:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734258881.628265:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098268160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258897 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258881.628291:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258881.628293:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734258881.628295:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258881.628298:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258881.628299:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734258881.628300:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734258881.628303:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098268288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258891 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258881.630901:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258881.630919:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619c00 00000400:00000200:0.0:1734258881.630927:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ac9 [1] + 224 00000400:00000200:0.0:1734258881.630945:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258881.630949:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258881.630957:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098268160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258897 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258881.631158:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734258881.631162:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:2.0:1734258881.631165:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734258881.631170:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098268160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258897 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258881.631176:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098268160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258897 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258881.631197:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734258881.631200:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734258881.631203:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734258881.631372:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258881.631379:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619c80 00000400:00000200:0.0:1734258881.631390:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ad1 [1] + 0 00000400:00000200:0.0:1734258881.631400:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258881.631403:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258881.631408:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098268288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258891 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258881.631861:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258881.631865:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258881.631866:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258881.631871:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098268288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258891 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258881.631878:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098268288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258891 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258881.631893:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258881.631895:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734258881.631898:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734258886.635918:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258886.635945:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734258886.636121:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258886.636129:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734258886.636179:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734258886.636186:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50840. 00000400:00000010:0.0:1734258886.636192:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734258886.636200:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098268544, portal 10 00000400:00000010:0.0:1734258886.636206:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:0.0:1734258886.636208:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098268544, offset 0 00000400:00000200:0.0:1734258886.636218:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258886.636234:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258886.636239:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258886.636243:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258886.636246:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258886.636248:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258886.636251:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [829:829:256:4294967295] 192.168.202.108@tcp LPNI seq info [828:828:8:4294967295] 02000000:00000010:2.0:1734258886.636251:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734258886.636256:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734258886.636259:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000400:00000200:0.0:1734258886.636260:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:2.0:1734258886.636261:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098268416, portal 25 00000400:00000010:2.0:1734258886.636264:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000800:00000200:0.0:1734258886.636265:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734258886.636265:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098268416, offset 0 00000800:00000010:0.0:1734258886.636268:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000400:00000200:2.0:1734258886.636269:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734258886.636274:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734258886.636276:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258886.636279:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258886.636281:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:0.0:1734258886.636282:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734258886.636282:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258886.636284:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734258886.636286:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734258886.636286:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [830:830:255:4294967295] 192.168.202.108@tcp LPNI seq info [829:829:7:4294967295] 00000400:00000200:2.0:1734258886.636291:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258886.636294:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258886.636321:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258886.636324:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258886.636328:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258886.636329:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258886.637058:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258886.637079:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734258886.637085:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258886.637092:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258886.637097:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:1.0:1734258886.637099:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:1.0:1734258886.637111:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098268544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258896 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258886.637179:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258886.637181:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734258886.637183:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258886.637187:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258886.637188:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:1.0:1734258886.637190:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:1.0:1734258886.637193:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098268416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258902 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258886.639516:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258886.639542:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619d80 00000400:00000200:0.0:1734258886.639550:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ad9 [1] + 0 00000400:00000200:0.0:1734258886.639562:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258886.639565:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258886.639599:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098268544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258896 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258886.639648:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258886.639653:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619d00 00000400:00000200:0.0:1734258886.639657:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ae1 [1] + 224 00000400:00000200:0.0:1734258886.639669:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258886.639672:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258886.639677:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098268416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258886.639823:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50840. 00000400:00000200:2.0:1734258886.639828:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:2.0:1734258886.639829:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:2.0:1734258886.639833:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098268544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258896 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258886.639839:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098268544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258896 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258886.639862:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258886.639866:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258886.639871:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:3.0:1734258886.639935:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:3.0:1734258886.639943:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:3.0:1734258886.639944:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:3.0:1734258886.639948:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098268416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258902 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258886.639953:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098268416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258902 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258886.639962:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:3.0:1734258886.639965:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734258886.639966:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258891.643713:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258891.643738:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734258891.643803:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258891.643810:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258891.643858:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258891.643869:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce70. 00000400:00000010:2.0:1734258891.643874:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258891.643879:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098268800, portal 10 00000400:00000010:2.0:1734258891.643885:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734258891.643887:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098268800, offset 0 00000400:00000200:2.0:1734258891.643894:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734258891.643900:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000200:2.0:1734258891.643905:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:3.0:1734258891.643906:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000200:2.0:1734258891.643909:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734258891.643911:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000200:2.0:1734258891.643912:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258891.643915:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:3.0:1734258891.643916:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098268672, portal 25 00000400:00000200:2.0:1734258891.643917:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258891.643919:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [831:831:256:4294967295] 192.168.202.108@tcp LPNI seq info [830:830:8:4294967295] 00000400:00000010:3.0:1734258891.643920:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734258891.643922:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098268672, offset 0 00000400:00000200:2.0:1734258891.643927:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:3.0:1734258891.643929:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734258891.643932:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258891.643936:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:3.0:1734258891.643938:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258891.643942:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258891.643946:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258891.643948:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734258891.643951:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258891.643951:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258891.643954:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [832:832:255:4294967295] 192.168.202.108@tcp LPNI seq info [831:831:7:4294967295] 00000800:00000200:2.0:1734258891.643957:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258891.643960:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734258891.643962:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258891.643967:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258891.643970:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734258891.643975:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258891.643981:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258891.643983:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258891.644168:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258891.644173:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734258891.644177:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258891.644182:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258891.644186:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:1.0:1734258891.644187:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:1.0:1734258891.644194:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098268800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258901 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258891.644248:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258891.644249:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:1.0:1734258891.644251:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258891.644254:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258891.644255:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:1.0:1734258891.644256:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:1.0:1734258891.644259:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098268672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258907 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258891.646204:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258891.646220:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619e80 00000400:00000200:0.0:1734258891.646226:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ae9 [1] + 0 00000400:00000200:0.0:1734258891.646236:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258891.646239:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258891.646246:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098268800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258901 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258891.646316:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258891.646321:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619e00 00000400:00000200:0.0:1734258891.646325:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1af1 [1] + 224 00000400:00000200:0.0:1734258891.646358:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258891.646361:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258891.646366:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098268672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258907 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258891.646440:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce70. 00000400:00000200:2.0:1734258891.646445:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:2.0:1734258891.646447:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258891.646452:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098268800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258901 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258891.646459:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098268800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258901 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258891.646492:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258891.646499:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258891.646502:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:3.0:1734258891.646531:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258891.646539:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258891.646541:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258891.646561:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098268672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258907 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258891.646633:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098268672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258907 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258891.646652:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258891.646657:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734258891.646660:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258896.651850:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258896.651872:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258896.651978:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258896.651986:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258896.652129:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734258896.652139:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce70. 00000400:00000010:2.0:1734258896.652147:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258896.652155:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098268928, portal 25 00000400:00000010:2.0:1734258896.652159:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734258896.652161:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098268928, offset 0 00000400:00000200:2.0:1734258896.652171:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258896.652186:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258896.652192:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258896.652196:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258896.652199:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258896.652201:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258896.652204:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [833:833:256:4294967295] 192.168.202.108@tcp LPNI seq info [832:832:8:4294967295] 00000400:00000200:2.0:1734258896.652211:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258896.652217:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258896.652221:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258896.652226:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258896.652248:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258896.652253:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734258896.652317:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734258896.652321:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258896.652324:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258896.652326:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098269056, portal 10 00000400:00000010:3.0:1734258896.652331:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734258896.652333:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098269056, offset 0 00000400:00000200:3.0:1734258896.652337:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258896.652341:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258896.652344:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258896.652346:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258896.652347:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258896.652349:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258896.652350:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [834:834:255:4294967295] 192.168.202.108@tcp LPNI seq info [833:833:7:4294967295] 00000400:00000200:3.0:1734258896.652356:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258896.652359:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258896.652362:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734258896.652364:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258896.652368:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258896.652369:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258896.652442:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258896.652445:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258896.652450:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258896.652454:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258896.652458:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734258896.652459:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734258896.652466:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098268928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258912 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258896.652598:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258896.652601:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734258896.652603:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258896.652606:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258896.652608:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734258896.652609:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734258896.652613:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098269056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258906 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258896.655199:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258896.655214:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c619f00 00000400:00000200:0.0:1734258896.655221:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1af9 [1] + 224 00000400:00000200:0.0:1734258896.655230:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258896.655233:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258896.655243:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098268928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258912 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258896.655291:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258896.655295:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c619f80 00000400:00000200:0.0:1734258896.655300:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b01 [1] + 0 00000400:00000200:0.0:1734258896.655311:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258896.655313:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258896.655318:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098269056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258906 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258896.655415:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258896.655421:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258896.655422:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258896.655427:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098269056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258906 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258896.655450:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098269056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258906 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258896.655478:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258896.655482:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:3.0:1734258896.655486:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:2.0:1734258896.655490:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce70. 00000400:00000200:2.0:1734258896.655495:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:2.0:1734258896.655496:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258896.655502:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098268928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258912 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258896.655508:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098268928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258912 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258896.655521:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734258896.655524:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734258896.655526:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258901.659835:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258901.659854:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734258901.660144:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258901.660151:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258901.660199:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734258901.660220:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258901.660228:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258901.660235:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098269184, portal 25 00000400:00000010:1.0:1734258901.660239:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734258901.660242:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098269184, offset 0 00000400:00000200:1.0:1734258901.660250:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258901.660261:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258901.660265:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258901.660269:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258901.660271:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258901.660273:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258901.660276:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [835:835:256:4294967295] 192.168.202.108@tcp LPNI seq info [834:834:8:4294967295] 00000400:00000200:1.0:1734258901.660283:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258901.660287:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734258901.660288:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000800:00000010:1.0:1734258901.660290:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000400:00000010:3.0:1734258901.660293:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000800:00000200:1.0:1734258901.660295:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:3.0:1734258901.660296:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258901.660298:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098269312, portal 10 00000800:00000200:1.0:1734258901.660302:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:3.0:1734258901.660302:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734258901.660304:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098269312, offset 0 00000800:00000200:1.0:1734258901.660305:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734258901.660308:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258901.660323:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258901.660325:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258901.660327:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258901.660329:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258901.660330:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258901.660332:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [836:836:255:4294967295] 192.168.202.108@tcp LPNI seq info [835:835:7:4294967295] 00000400:00000200:3.0:1734258901.660336:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258901.660339:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258901.660341:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734258901.660344:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258901.660347:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258901.660349:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258901.660387:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258901.660390:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734258901.660393:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258901.660397:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258901.660400:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:0.0:1734258901.660401:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:0.0:1734258901.660407:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098269184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258917 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258901.660430:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258901.660432:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734258901.660434:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258901.660436:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258901.660437:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734258901.660438:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734258901.660441:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098269312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258911 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258901.666305:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258901.666324:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a000 00000400:00000200:0.0:1734258901.666342:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b09 [1] + 224 00000400:00000200:0.0:1734258901.666356:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258901.666360:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258901.666370:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098269184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258917 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258901.666416:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258901.666422:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a080 00000400:00000200:0.0:1734258901.666427:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b11 [1] + 0 00000400:00000200:0.0:1734258901.666446:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258901.666449:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258901.666455:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098269312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258911 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258901.666762:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258901.666768:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258901.666769:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258901.666775:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098269312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258911 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258901.666789:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098269312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258911 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258901.666817:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734258901.666821:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734258901.666826:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:1.0:1734258901.668853:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258901.668863:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258901.668865:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258901.668875:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098269184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258917 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258901.668883:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098269184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258917 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258901.668902:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734258901.668907:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734258901.668910:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734258906.667938:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258906.667958:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258906.668014:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258906.668020:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:0.0:1734258906.668057:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734258906.668058:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:0.0:1734258906.668063:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50898. 00000400:00000010:3.0:1734258906.668063:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:0.0:1734258906.668068:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000400:00000010:3.0:1734258906.668068:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734258906.668074:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098269568, portal 10 00000100:00000200:3.0:1734258906.668074:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098269440, portal 25 00000400:00000010:3.0:1734258906.668078:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000400:00000010:0.0:1734258906.668079:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000100:00000200:3.0:1734258906.668080:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098269440, offset 0 00000100:00000200:0.0:1734258906.668081:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098269568, offset 0 00000400:00000200:3.0:1734258906.668087:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258906.668099:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258906.668104:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258906.668108:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258906.668111:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258906.668111:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258906.668112:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258906.668115:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [837:837:256:4294967295] 192.168.202.108@tcp LPNI seq info [836:836:8:4294967295] 00000400:00000200:3.0:1734258906.668122:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:0.0:1734258906.668128:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734258906.668128:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258906.668130:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734258906.668131:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734258906.668132:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258906.668134:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734258906.668135:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734258906.668136:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258906.668138:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [838:838:255:4294967295] 192.168.202.108@tcp LPNI seq info [837:837:7:4294967295] 00000800:00000200:3.0:1734258906.668143:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734258906.668144:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258906.668146:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258906.668160:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258906.668162:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734258906.668164:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258906.668168:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258906.668170:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258906.668268:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258906.668271:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:1.0:1734258906.668276:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258906.668285:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258906.668288:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:1.0:1734258906.668289:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:1.0:1734258906.668296:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098269440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258922 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258906.668405:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258906.668407:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734258906.668409:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258906.668413:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258906.668415:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:1.0:1734258906.668416:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:1.0:1734258906.668420:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098269568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258916 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258906.670320:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258906.670335:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a100 00000400:00000200:0.0:1734258906.670723:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b19 [1] + 224 00000400:00000200:0.0:1734258906.670736:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258906.670740:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258906.670749:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098269440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258922 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258906.670783:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258906.670788:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a180 00000400:00000200:0.0:1734258906.670793:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b1d [1] + 0 00000400:00000200:0.0:1734258906.670810:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258906.670813:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258906.670818:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098269568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258916 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258906.670897:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258906.670902:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258906.670904:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258906.670909:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098269440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258922 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258906.670926:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098269440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258922 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258906.670946:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258906.670950:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734258906.670954:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:1.0:1734258906.671066:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50898. 00000400:00000200:1.0:1734258906.671070:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:1.0:1734258906.671071:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:1.0:1734258906.671075:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098269568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258916 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258906.671080:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098269568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258916 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:1.0:1734258906.671092:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:1.0:1734258906.671100:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258906.671103:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734258906.671106:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258911.675769:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258911.675788:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258911.675845:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258911.675851:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734258911.675867:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258911.675874:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258911.675880:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258911.675886:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098269696, portal 25 00000400:00000010:3.0:1734258911.675889:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734258911.675891:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098269696, offset 0 00000400:00000200:3.0:1734258911.675898:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258911.675908:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258911.675912:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258911.675915:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258911.675918:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258911.675920:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258911.675922:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [839:839:256:4294967295] 192.168.202.108@tcp LPNI seq info [838:838:8:4294967295] 00000400:00000200:3.0:1734258911.675929:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258911.675934:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258911.675937:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734258911.675942:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258911.675949:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258911.675952:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258911.676227:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258911.676230:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734258911.676234:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258911.676237:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258911.676241:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734258911.676253:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734258911.676259:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098269696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258927 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258911.676516:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258911.676521:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258911.676525:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258911.676528:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098269824, portal 10 00000400:00000010:1.0:1734258911.676532:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734258911.676534:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098269824, offset 0 00000400:00000200:1.0:1734258911.676549:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258911.676595:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258911.676598:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258911.676601:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258911.676602:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258911.676604:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258911.676606:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [840:840:256:4294967295] 192.168.202.108@tcp LPNI seq info [839:839:8:4294967295] 00000400:00000200:1.0:1734258911.676611:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258911.676615:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258911.676618:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734258911.676621:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258911.676625:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258911.676627:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258911.676944:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258911.676947:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:2.0:1734258911.676950:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258911.676953:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258911.676956:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:2.0:1734258911.676957:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:2.0:1734258911.676961:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098269824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258921 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258911.679332:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258911.679349:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a280 00000400:00000200:0.0:1734258911.679358:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b31 [1] + 0 00000400:00000200:0.0:1734258911.679377:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258911.679381:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258911.679390:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098269824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258921 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258911.679465:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258911.679470:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258911.679472:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258911.679477:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098269824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258921 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258911.679484:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098269824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258921 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258911.679507:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258911.679511:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734258911.679515:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734258911.682515:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258911.682529:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a200 00000400:00000200:0.0:1734258911.682537:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b29 [1] + 224 00000400:00000200:0.0:1734258911.682555:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258911.682559:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258911.682592:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098269696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258927 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258911.682839:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258911.682844:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258911.682845:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258911.682850:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098269696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258927 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258911.682865:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098269696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258927 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258911.682883:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258911.682887:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:3.0:1734258911.682890:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734258916.683707:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258916.683728:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 02000000:00000010:1.0:1734258916.684424:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734258916.684433:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258916.684440:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258916.684447:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098269952, portal 25 00000400:00000010:1.0:1734258916.684451:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734258916.684452:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098269952, offset 0 00000400:00000200:1.0:1734258916.684460:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000010:0.0:1734258916.684464:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258916.684472:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 00000400:00000200:1.0:1734258916.684473:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258916.684490:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258916.684494:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258916.684498:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258916.684499:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258916.684502:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [841:841:256:4294967295] 192.168.202.108@tcp LPNI seq info [840:840:8:4294967295] 00000400:00000200:1.0:1734258916.684509:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258916.684515:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258916.684518:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734258916.684523:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258916.684530:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 02000000:00000010:2.0:1734258916.684532:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000800:00000200:1.0:1734258916.684533:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734258916.684536:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce70. 00000400:00000010:2.0:1734258916.684539:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258916.684541:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098270080, portal 10 00000400:00000010:2.0:1734258916.684545:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734258916.684547:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098270080, offset 0 00000400:00000200:2.0:1734258916.684550:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258916.684554:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258916.684556:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258916.684558:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258916.684560:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258916.684561:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258916.684590:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [842:842:255:4294967295] 192.168.202.108@tcp LPNI seq info [841:841:7:4294967295] 00000400:00000200:2.0:1734258916.684596:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258916.684600:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258916.684603:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258916.684605:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258916.684609:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258916.684611:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734258916.684690:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258916.684693:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:3.0:1734258916.684697:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258916.684700:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258916.684704:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:3.0:1734258916.684705:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:3.0:1734258916.684713:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098269952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258932 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734258916.684772:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258916.684774:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734258916.684777:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258916.684780:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258916.684782:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:3.0:1734258916.684783:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:3.0:1734258916.684786:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098270080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258926 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258916.687406:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258916.687423:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a300 00000400:00000200:0.0:1734258916.687431:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b39 [1] + 224 00000400:00000200:0.0:1734258916.687441:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258916.687445:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258916.687455:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098269952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258932 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258916.687510:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258916.687514:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a380 00000400:00000200:0.0:1734258916.687519:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b41 [1] + 0 00000400:00000200:0.0:1734258916.687529:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258916.687532:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258916.687537:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098270080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258926 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258916.687720:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce70. 00000400:00000200:2.0:1734258916.687724:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:2.0:1734258916.687726:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258916.687730:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098270080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258926 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258916.687736:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098270080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258926 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258916.687760:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258916.687765:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258916.687768:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:1.0:1734258916.687833:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:1.0:1734258916.687837:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:1.0:1734258916.687838:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258916.687843:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098269952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258932 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258916.687847:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098269952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258932 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258916.687857:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734258916.687860:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734258916.687861:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258921.691924:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258921.691948:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 02000000:00000010:2.0:1734258921.692202:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000400:00000010:2.0:1734258921.692209:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce70. 00000400:00000010:2.0:1734258921.692217:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734258921.692225:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098270208, portal 25 00000400:00000010:2.0:1734258921.692229:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258921.692231:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098270208, offset 0 00000400:00000200:2.0:1734258921.692240:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258921.692252:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258921.692257:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258921.692261:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258921.692263:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258921.692265:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258921.692268:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [843:843:256:4294967295] 192.168.202.108@tcp LPNI seq info [842:842:8:4294967295] 00000400:00000200:2.0:1734258921.692289:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258921.692294:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258921.692297:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258921.692303:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258921.692310:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258921.692314:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258921.692464:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258921.692467:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:2.0:1734258921.692470:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258921.692473:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258921.692477:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258921.692478:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258921.692484:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098270208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258937 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258921.692544:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258921.692551:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258921.692712:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258921.692715:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734258921.692718:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258921.692720:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098270336, portal 10 00000400:00000010:2.0:1734258921.692725:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734258921.692726:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098270336, offset 0 00000400:00000200:2.0:1734258921.692729:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258921.692734:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258921.692736:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258921.692738:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258921.692740:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258921.692742:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258921.692744:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [844:844:256:4294967295] 192.168.202.108@tcp LPNI seq info [843:843:8:4294967295] 00000400:00000200:2.0:1734258921.692750:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258921.692753:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258921.692754:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258921.692761:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258921.692766:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258921.692768:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734258921.692876:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258921.692879:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:3.0:1734258921.692881:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258921.692884:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258921.692887:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:3.0:1734258921.692888:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:3.0:1734258921.692891:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098270336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258931 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258921.695326:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258921.695356:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a480 00000400:00000200:0.0:1734258921.695364:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b51 [1] + 0 00000400:00000200:0.0:1734258921.695376:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258921.695379:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258921.695389:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098270336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258931 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258921.695426:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258921.695430:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a400 00000400:00000200:0.0:1734258921.695434:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b49 [1] + 224 00000400:00000200:0.0:1734258921.695450:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258921.695453:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258921.695458:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098270208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258937 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258921.695664:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734258921.695669:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258921.695671:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258921.695675:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098270336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258931 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258921.695681:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098270336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258931 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258921.695711:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258921.695717:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734258921.695720:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:3.0:1734258921.695927:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce70. 00000400:00000200:3.0:1734258921.695931:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:3.0:1734258921.695941:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:3.0:1734258921.695945:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098270208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258937 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258921.695951:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098270208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258937 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258921.695964:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:3.0:1734258921.695967:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734258921.695969:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258926.699822:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258926.699854:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258926.699911:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258926.699918:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:0.0:1734258926.699961:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734258926.699967:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d508f0. 00000400:00000010:0.0:1734258926.699974:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:0.0:1734258926.699980:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098270592, portal 10 00000400:00000010:0.0:1734258926.699985:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734258926.699988:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098270592, offset 0 00000400:00000200:0.0:1734258926.699995:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258926.700006:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258926.700010:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258926.700013:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258926.700016:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258926.700018:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258926.700020:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [845:845:256:4294967295] 192.168.202.108@tcp LPNI seq info [844:844:8:4294967295] 00000400:00000200:0.0:1734258926.700028:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258926.700033:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258926.700036:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734258926.700041:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258926.700048:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258926.700051:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258926.700085:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258926.700090:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258926.700094:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258926.700096:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098270464, portal 25 00000400:00000010:3.0:1734258926.700099:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734258926.700101:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098270464, offset 0 00000400:00000200:3.0:1734258926.700105:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258926.700110:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258926.700112:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258926.700114:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258926.700116:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258926.700118:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258926.700120:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [846:846:255:4294967295] 192.168.202.108@tcp LPNI seq info [845:845:7:4294967295] 00000400:00000200:3.0:1734258926.700126:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258926.700130:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258926.700132:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734258926.700135:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258926.700139:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258926.700141:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258926.700152:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258926.700154:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:0.0:1734258926.700157:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258926.700161:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258926.700164:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:0.0:1734258926.700165:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734258926.700171:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098270592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258936 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258926.700195:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258926.700200:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734258926.700203:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258926.700206:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258926.700208:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734258926.700209:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734258926.700213:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098270464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258942 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258926.703497:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258926.703512:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a580 00000400:00000200:0.0:1734258926.703519:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b59 [1] + 0 00000400:00000200:0.0:1734258926.703528:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258926.703531:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258926.703540:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098270592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258936 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258926.703599:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258926.703604:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a500 00000400:00000200:0.0:1734258926.703609:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b61 [1] + 224 00000400:00000200:0.0:1734258926.703630:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258926.703633:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258926.703640:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098270464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258942 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258926.703708:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258926.703714:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258926.703716:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258926.703720:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098270464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258942 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258926.703735:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098270464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258942 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258926.703754:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258926.703758:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734258926.703760:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:2.0:1734258926.703827:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d508f0. 00000400:00000200:2.0:1734258926.703833:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:2.0:1734258926.703835:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:2.0:1734258926.703840:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098270592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258936 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258926.703845:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098270592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258936 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258926.703865:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258926.703871:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734258926.703874:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258931.707683:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258931.707702:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258931.707759:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258931.707765:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734258931.707803:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734258931.707808:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50948. 00000400:00000010:0.0:1734258931.707814:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734258931.707820:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098270848, portal 10 00000400:00000010:0.0:1734258931.707836:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734258931.707839:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098270848, offset 0 00000400:00000200:0.0:1734258931.707858:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258931.707868:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258931.707873:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258931.707876:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258931.707879:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258931.707881:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258931.707884:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [847:847:256:4294967295] 192.168.202.108@tcp LPNI seq info [846:846:8:4294967295] 00000400:00000200:0.0:1734258931.707891:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258931.707895:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258931.707898:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734258931.707902:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258931.707908:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258931.707911:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734258931.707914:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258931.707919:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258931.707922:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258931.707924:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098270720, portal 25 00000400:00000010:3.0:1734258931.707927:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734258931.707928:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098270720, offset 0 00000400:00000200:3.0:1734258931.707934:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258931.707939:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258931.707941:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258931.707943:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258931.707945:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258931.707947:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258931.707949:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [848:848:255:4294967295] 192.168.202.108@tcp LPNI seq info [847:847:7:4294967295] 00000400:00000200:3.0:1734258931.707954:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258931.707958:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258931.707961:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734258931.707963:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258931.707967:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258931.707969:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258931.709140:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258931.709147:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734258931.709153:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258931.709159:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258931.709163:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:1.0:1734258931.709165:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:1.0:1734258931.709175:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098270848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258941 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258931.709248:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258931.709258:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:1.0:1734258931.709260:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258931.709297:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258931.709299:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:1.0:1734258931.709301:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:1.0:1734258931.709304:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098270720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258947 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258931.711679:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258931.711695:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a680 00000400:00000200:0.0:1734258931.711702:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b69 [1] + 0 00000400:00000200:0.0:1734258931.711711:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258931.711714:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258931.711722:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098270848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258941 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258931.711759:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258931.711763:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a600 00000400:00000200:0.0:1734258931.711768:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b71 [1] + 224 00000400:00000200:0.0:1734258931.711783:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258931.711786:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258931.711790:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098270720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258947 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258931.711882:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50948. 00000400:00000200:2.0:1734258931.711886:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:2.0:1734258931.711888:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:2.0:1734258931.711892:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098270848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258941 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258931.711898:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098270848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258941 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258931.711922:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734258931.711930:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258931.711933:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:3.0:1734258931.711987:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258931.711990:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258931.711991:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258931.711995:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098270720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258947 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258931.712008:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098270720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258947 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258931.712017:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258931.712020:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734258931.712022:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258936.719367:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258936.719391:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258936.719456:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258936.719462:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734258936.719564:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0200. 00000400:00000010:1.0:1734258936.719597:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1370. 00000400:00000010:1.0:1734258936.719603:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734258936.719610:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098270976, portal 25 00000400:00000010:1.0:1734258936.719614:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734258936.719615:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098270976, offset 0 00000400:00000200:1.0:1734258936.719624:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258936.719638:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258936.719642:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258936.719646:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258936.719649:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258936.719651:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258936.719654:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [849:849:256:4294967295] 192.168.202.108@tcp LPNI seq info [848:848:8:4294967295] 00000400:00000200:1.0:1734258936.719661:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258936.719667:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258936.719670:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734258936.719676:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258936.719683:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258936.719687:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258936.719880:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258936.719884:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734258936.719887:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258936.719892:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258936.719895:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:0.0:1734258936.719897:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:0.0:1734258936.719904:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098270976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258952 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258936.720659:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734258936.720666:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734258936.720670:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258936.720673:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098271104, portal 10 00000400:00000010:2.0:1734258936.720678:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734258936.720680:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098271104, offset 0 00000400:00000200:2.0:1734258936.720684:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258936.720691:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258936.720695:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258936.720697:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258936.720700:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258936.720701:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258936.720703:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [850:850:256:4294967295] 192.168.202.108@tcp LPNI seq info [849:849:8:4294967295] 00000400:00000200:2.0:1734258936.720710:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258936.720713:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258936.720717:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258936.720720:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258936.720725:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258936.720728:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734258936.721715:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258936.721730:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a700 00000400:00000200:0.0:1734258936.721737:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b79 [1] + 224 00000400:00000200:0.0:1734258936.721757:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258936.721760:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258936.721769:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098270976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258952 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258936.721824:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258936.721827:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734258936.721831:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258936.721834:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258936.721836:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734258936.721838:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734258936.721843:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098271104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258946 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258936.722397:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1370. 00000400:00000200:2.0:1734258936.722402:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:2.0:1734258936.722404:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:2.0:1734258936.722408:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098270976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258952 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258936.722415:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098270976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258952 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258936.722437:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0200. 02000000:00000010:2.0:1734258936.722442:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734258936.722454:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000200:0.0:1734258936.727220:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258936.727270:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a780 00000400:00000200:0.0:1734258936.727293:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b81 [1] + 0 00000400:00000200:0.0:1734258936.727316:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258936.727320:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258936.727330:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098271104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258946 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258936.727438:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734258936.727443:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258936.727445:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258936.727450:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098271104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258946 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258936.727456:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098271104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258946 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258936.727486:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734258936.727492:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734258936.727497:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734258941.723839:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258941.723869:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258941.723938:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258941.723945:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734258941.724026:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734258941.724027:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:0.0:1734258941.724034:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509a0. 00000400:00000010:3.0:1734258941.724034:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:0.0:1734258941.724040:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000400:00000010:3.0:1734258941.724040:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734258941.724047:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098271360, portal 10 00000400:00000010:0.0:1734258941.724054:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734258941.724098:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098271360, offset 0 00000100:00000200:3.0:1734258941.724098:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098271232, portal 25 00000400:00000010:3.0:1734258941.724101:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000400:00000200:0.0:1734258941.724108:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734258941.724112:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098271232, offset 0 00000400:00000200:3.0:1734258941.724117:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258941.724124:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258941.724130:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258941.724134:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258941.724138:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258941.724140:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258941.724144:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [851:851:256:4294967295] 192.168.202.108@tcp LPNI seq info [850:850:8:4294967295] 00000400:00000200:0.0:1734258941.724151:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:3.0:1734258941.724156:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:0.0:1734258941.724157:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258941.724158:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734258941.724160:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000400:00000200:3.0:1734258941.724160:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258941.724161:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258941.724163:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258941.724164:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [852:852:255:4294967295] 192.168.202.108@tcp LPNI seq info [851:851:7:4294967295] 00000800:00000200:0.0:1734258941.724168:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258941.724169:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258941.724171:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258941.724173:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734258941.724175:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258941.724177:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258941.724178:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258941.724181:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734258941.724181:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258941.724476:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258941.724479:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734258941.724484:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258941.724488:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258941.724493:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:1.0:1734258941.724510:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:1.0:1734258941.724518:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098271360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258951 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258941.724769:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258941.724771:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734258941.724774:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258941.724777:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258941.724779:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:1.0:1734258941.724781:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:1.0:1734258941.724784:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098271232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258957 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258941.726528:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258941.726561:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a800 00000400:00000200:0.0:1734258941.726598:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b8d [1] + 224 00000400:00000200:0.0:1734258941.726614:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258941.726618:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258941.726629:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098271232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258957 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258941.726669:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258941.726674:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a880 00000400:00000200:0.0:1734258941.726679:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1b89 [1] + 0 00000400:00000200:0.0:1734258941.726693:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258941.726695:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258941.726700:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098271360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258951 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258941.726715:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258941.726720:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258941.726721:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258941.726725:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098271232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258957 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258941.726741:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098271232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258957 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258941.726778:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734258941.726785:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734258941.726789:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:1.0:1734258941.726794:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509a0. 00000400:00000200:1.0:1734258941.726799:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:1.0:1734258941.726800:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:1.0:1734258941.726805:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098271360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258951 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258941.726812:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098271360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258951 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258941.726832:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258941.726835:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734258941.726839:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734258946.731898:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258946.731918:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 02000000:00000010:2.0:1734258946.731990:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734258946.731998:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734258946.732004:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258946.732010:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098271488, portal 25 00000400:00000010:2.0:1734258946.732014:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734258946.732015:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098271488, offset 0 00000400:00000200:2.0:1734258946.732022:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258946.732032:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258946.732036:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258946.732039:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258946.732042:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258946.732044:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258946.732046:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [853:853:256:4294967295] 192.168.202.108@tcp LPNI seq info [852:852:8:4294967295] 00000400:00000200:2.0:1734258946.732051:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258946.732055:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258946.732057:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734258946.732062:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258946.732068:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258946.732070:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258946.732238:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258946.732241:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734258946.732245:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258946.732249:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258946.732252:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:1.0:1734258946.732253:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:1.0:1734258946.732260:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098271488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258962 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258946.732351:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258946.732358:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734258946.732401:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258946.732406:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734258946.732409:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258946.732415:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098271616, portal 10 00000400:00000010:1.0:1734258946.732420:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734258946.732421:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098271616, offset 0 00000400:00000200:1.0:1734258946.732426:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258946.732429:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258946.732432:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258946.732434:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258946.732435:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258946.732437:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258946.732438:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [854:854:256:4294967295] 192.168.202.108@tcp LPNI seq info [853:853:8:4294967295] 00000400:00000200:1.0:1734258946.732443:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258946.732447:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258946.732449:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734258946.732452:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258946.732456:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258946.732458:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734258946.732533:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258946.732536:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:2.0:1734258946.732539:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258946.732542:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258946.732548:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:2.0:1734258946.732549:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:2.0:1734258946.732553:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098271616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258956 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258946.735000:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258946.735019:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61a900 00000400:00000200:0.0:1734258946.735027:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1b99 [1] + 224 00000400:00000200:0.0:1734258946.735048:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258946.735052:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258946.735063:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098271488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258962 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258946.735137:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734258946.735142:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258946.735145:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258946.735161:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098271488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258962 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258946.735169:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098271488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258962 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258946.735194:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734258946.735199:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734258946.735202:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000200:0.0:1734258946.735320:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258946.735326:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61a980 00000400:00000200:0.0:1734258946.735332:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ba1 [1] + 0 00000400:00000200:0.0:1734258946.735352:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258946.735354:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258946.735359:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098271616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258956 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258946.735427:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258946.735431:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258946.735432:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258946.735438:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098271616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258956 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258946.735444:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098271616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258956 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258946.735461:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258946.735465:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734258946.735468:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734258951.739718:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734258951.739743:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734258951.739810:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734258951.739817:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734258951.739903:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734258951.739915:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258951.739922:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258951.739939:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098271744, portal 25 00000400:00000010:3.0:1734258951.739943:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734258951.739945:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098271744, offset 0 00000400:00000200:3.0:1734258951.739953:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258951.739967:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258951.739971:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258951.739974:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258951.739977:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258951.739979:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258951.739982:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [855:855:256:4294967295] 192.168.202.108@tcp LPNI seq info [854:854:8:4294967295] 00000400:00000200:3.0:1734258951.739988:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258951.739993:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258951.739996:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734258951.740001:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258951.740007:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258951.740011:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734258951.740168:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734258951.740172:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:2.0:1734258951.740175:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734258951.740179:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734258951.740184:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:2.0:1734258951.740185:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:2.0:1734258951.740192:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098271744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258967 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258951.740278:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258951.740283:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734258951.740286:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258951.740289:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098271872, portal 10 00000400:00000010:1.0:1734258951.740302:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734258951.740303:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098271872, offset 0 00000400:00000200:1.0:1734258951.740308:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258951.740312:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258951.740314:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258951.740316:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258951.740318:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258951.740319:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258951.740321:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [856:856:256:4294967295] 192.168.202.108@tcp LPNI seq info [855:855:8:4294967295] 00000400:00000200:1.0:1734258951.740327:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258951.740331:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258951.740334:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734258951.740338:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258951.740346:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258951.740347:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258951.740423:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258951.740425:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734258951.740428:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258951.740431:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258951.740433:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734258951.740435:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734258951.740439:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098271872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258961 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258951.741648:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258951.741661:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61aa00 00000400:00000200:0.0:1734258951.741667:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ba9 [1] + 224 00000400:00000200:0.0:1734258951.741675:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258951.741677:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258951.741684:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098271744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258967 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258951.741717:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258951.741721:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61aa80 00000400:00000200:0.0:1734258951.741725:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1bb1 [1] + 0 00000400:00000200:0.0:1734258951.741736:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258951.741739:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258951.741743:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098271872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258961 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258951.741809:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258951.741814:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258951.741816:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258951.741824:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098271744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258967 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258951.741839:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098271744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258967 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258951.741846:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258951.741849:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258951.741850:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258951.741853:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098271872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258961 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258951.741857:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 00000100:00000200:1.0:1734258951.741858:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098271872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258961 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258951.741861:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734258951.741864:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 02000000:00000010:1.0:1734258951.741872:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258951.741875:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734258951.741877:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734258956.747697:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734258956.747716:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734258956.747785:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734258956.747794:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258956.747805:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734258956.747813:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734258956.747818:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258956.747824:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098272000, portal 25 00000400:00000010:2.0:1734258956.747828:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734258956.747830:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098272000, offset 0 00000400:00000200:2.0:1734258956.747847:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258956.747857:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258956.747862:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258956.747866:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258956.747868:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258956.747870:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258956.747872:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [857:857:256:4294967295] 192.168.202.108@tcp LPNI seq info [856:856:8:4294967295] 00000400:00000200:2.0:1734258956.747884:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258956.747889:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258956.747891:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734258956.747896:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258956.747994:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258956.747998:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734258956.748002:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258956.748008:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734258956.748012:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258956.748016:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098272128, portal 10 00000400:00000010:1.0:1734258956.748020:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734258956.748032:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098272128, offset 0 00000400:00000200:1.0:1734258956.748038:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258956.748044:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258956.748047:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258956.748049:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734258956.748226:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258956.748229:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:3.0:1734258956.748233:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258956.748238:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258956.748242:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:3.0:1734258956.748243:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:3.0:1734258956.748250:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098272000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258972 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734258956.748284:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258956.748287:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258956.748290:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [858:858:255:4294967295] 192.168.202.108@tcp LPNI seq info [857:857:7:4294967295] 00000400:00000200:1.0:1734258956.748296:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258956.748301:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258956.748305:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734258956.748308:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258956.748314:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258956.748316:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734258956.748395:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734258956.748398:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:3.0:1734258956.748400:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734258956.748404:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734258956.748407:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:3.0:1734258956.748408:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:3.0:1734258956.748412:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098272128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258966 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258956.750333:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258956.750346:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ab00 00000400:00000200:0.0:1734258956.750352:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1bb9 [1] + 224 00000400:00000200:0.0:1734258956.750361:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258956.750364:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258956.750372:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098272000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258972 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258956.750406:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258956.750410:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ab80 00000400:00000200:0.0:1734258956.750414:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1bc1 [1] + 0 00000400:00000200:0.0:1734258956.750426:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258956.750429:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:2.0:1734258956.750433:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734258956.750436:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258956.750437:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258956.750441:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098272000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258972 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734258956.750442:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098272128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258966 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258956.750446:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098272000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258972 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258956.750461:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258956.750465:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734258956.750468:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:1.0:1734258956.750501:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258956.750505:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258956.750506:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258956.750510:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098272128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258966 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258956.750516:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098272128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258966 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258956.750528:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258956.750531:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734258956.750672:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734258961.755678:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734258961.755696:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734258961.756164:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734258961.756172:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258961.756227:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258961.756233:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734258961.756238:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258961.756243:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098272384, portal 10 00000400:00000010:1.0:1734258961.756247:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:1.0:1734258961.756248:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098272384, offset 0 00000400:00000200:1.0:1734258961.756263:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734258961.756263:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734258961.756269:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000200:1.0:1734258961.756272:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734258961.756272:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258961.756274:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098272256, portal 25 00000400:00000200:1.0:1734258961.756275:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734258961.756277:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000400:00000200:1.0:1734258961.756278:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:2.0:1734258961.756278:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098272256, offset 0 00000400:00000200:1.0:1734258961.756281:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258961.756282:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258961.756283:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258961.756290:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [859:859:256:4294967295] 192.168.202.108@tcp LPNI seq info [858:858:8:4294967295] 00000400:00000200:1.0:1734258961.756297:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258961.756301:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258961.756302:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734258961.756305:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734258961.756310:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258961.756316:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734258961.756316:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258961.756318:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734258961.756320:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734258961.756382:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258961.756384:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258961.756386:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [860:860:255:4294967295] 192.168.202.108@tcp LPNI seq info [859:859:7:4294967295] 00000400:00000200:2.0:1734258961.756392:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258961.756396:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258961.756398:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734258961.756401:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258961.756404:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258961.756406:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258961.756438:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258961.756441:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734258961.756445:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258961.756449:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258961.756453:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:0.0:1734258961.756454:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:0.0:1734258961.756465:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098272384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258971 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258961.756494:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258961.756496:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734258961.756499:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258961.756502:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258961.756504:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734258961.756505:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734258961.756508:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098272256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258977 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258961.757961:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258961.757973:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ac00 00000400:00000200:0.0:1734258961.757979:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1bd1 [1] + 224 00000400:00000200:0.0:1734258961.757994:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258961.757997:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258961.758003:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098272256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258977 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258961.758080:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734258961.758083:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258961.758085:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258961.758089:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098272256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258977 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258961.758096:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098272256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258977 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258961.758113:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258961.758117:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:2.0:1734258961.758120:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734258961.758394:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258961.758401:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ac80 00000400:00000200:0.0:1734258961.758404:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1bc9 [1] + 0 00000400:00000200:0.0:1734258961.758413:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258961.758416:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258961.758421:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098272384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258971 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258961.758553:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258961.758556:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258961.758557:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258961.758561:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098272384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258971 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258961.758567:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098272384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258971 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258961.758612:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258961.758615:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734258961.758617:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734258966.765399:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734258966.765494:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734258966.765634:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734258966.765642:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734258966.765709:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258966.765717:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 02000000:00000010:3.0:1734258966.765721:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:1.0:1734258966.765724:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000010:3.0:1734258966.765726:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000100:00000200:1.0:1734258966.765733:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098272640, portal 10 00000400:00000010:3.0:1734258966.765736:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258966.765739:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098272512, portal 25 00000400:00000010:1.0:1734258966.765740:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734258966.765742:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098272640, offset 0 00000400:00000010:3.0:1734258966.765742:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734258966.765743:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098272512, offset 0 00000400:00000200:1.0:1734258966.765753:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258966.765774:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258966.765781:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258966.765787:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258966.765790:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258966.765793:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258966.765796:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258966.765798:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [861:861:256:4294967295] 192.168.202.108@tcp LPNI seq info [860:860:8:4294967295] 00000400:00000200:1.0:1734258966.765806:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258966.765810:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258966.765812:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734258966.765814:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000400:00000200:3.0:1734258966.765814:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258966.765816:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734258966.765820:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734258966.765824:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258966.765825:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734258966.765828:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734258966.765828:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [862:862:255:4294967295] 192.168.202.108@tcp LPNI seq info [861:861:7:4294967295] 00000800:00000200:1.0:1734258966.765832:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734258966.765833:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258966.765837:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258966.765840:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734258966.765843:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258966.765847:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258966.765849:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734258966.765927:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258966.765935:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734258966.765940:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258966.765945:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258966.765949:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734258966.765951:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734258966.765959:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098272640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258976 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258966.766045:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258966.766047:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734258966.766050:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258966.766053:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258966.766055:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734258966.766057:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734258966.766060:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098272512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258982 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258966.768124:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258966.768144:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ad80 00000400:00000200:0.0:1734258966.768152:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1bd9 [1] + 0 00000400:00000200:0.0:1734258966.768165:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258966.768169:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258966.768184:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098272640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258976 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258966.768222:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258966.768226:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ad00 00000400:00000200:0.0:1734258966.768235:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1bdd [1] + 224 00000400:00000200:0.0:1734258966.768252:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258966.768255:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258966.768260:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098272512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258982 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258966.768265:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258966.768270:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258966.768272:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258966.768278:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098272640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258976 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258966.768285:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098272640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258976 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258966.768316:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258966.768321:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734258966.768327:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:3.0:1734258966.768342:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258966.768347:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258966.768348:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258966.768353:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098272512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258982 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258966.768360:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098272512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258982 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258966.768372:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258966.768377:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734258966.768379:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734258971.771775:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734258971.771805:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 02000000:00000010:3.0:1734258971.771880:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258971.771888:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258971.771893:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258971.771899:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098272768, portal 25 00000400:00000010:3.0:1734258971.771902:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734258971.771904:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098272768, offset 0 00000400:00000200:3.0:1734258971.771912:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258971.771922:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258971.771926:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258971.771929:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258971.771931:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258971.771933:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258971.771940:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [863:863:256:4294967295] 192.168.202.108@tcp LPNI seq info [862:862:8:4294967295] 00000400:00000200:3.0:1734258971.771948:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258971.771952:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258971.771972:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734258971.771977:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258971.771983:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258971.771986:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734258971.772230:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258971.772233:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:1.0:1734258971.772236:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258971.772240:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258971.772244:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:1.0:1734258971.772246:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:1.0:1734258971.772252:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098272768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258987 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734258971.772480:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734258971.772488:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734258971.772541:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258971.772548:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734258971.772551:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258971.772553:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098272896, portal 10 00000400:00000010:1.0:1734258971.772556:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734258971.772557:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098272896, offset 0 00000400:00000200:1.0:1734258971.772561:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258971.772564:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258971.772566:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258971.772596:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258971.772597:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258971.772599:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258971.772600:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [864:864:256:4294967295] 192.168.202.108@tcp LPNI seq info [863:863:8:4294967295] 00000400:00000200:1.0:1734258971.772604:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258971.772607:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258971.772608:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734258971.772611:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258971.772614:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258971.772615:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258971.772700:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258971.772702:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734258971.772704:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258971.772707:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258971.772709:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:0.0:1734258971.772711:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734258971.772714:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098272896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258981 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258971.775935:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258971.775969:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ae00 00000400:00000200:0.0:1734258971.775980:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1be9 [1] + 224 00000400:00000200:0.0:1734258971.775994:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258971.775998:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258971.776010:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098272768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258987 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258971.776559:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258971.776565:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ae80 00000400:00000200:0.0:1734258971.776605:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1bf1 [1] + 0 00000400:00000200:0.0:1734258971.776625:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258971.776628:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258971.776634:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098272896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258981 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258971.776997:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258971.777003:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258971.777005:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258971.777012:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098272896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258981 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258971.777019:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098272896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258981 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258971.777052:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258971.777059:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734258971.777064:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:3.0:1734258971.777222:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258971.777227:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258971.777229:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258971.777235:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098272768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258987 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258971.777242:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098272768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258987 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258971.777254:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258971.777259:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734258971.777260:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734258976.779686:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734258976.779707:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 02000000:00000010:2.0:1734258976.780623:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734258976.780632:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734258976.780638:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258976.780643:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098273024, portal 25 00000400:00000010:2.0:1734258976.780648:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734258976.780650:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098273024, offset 0 00000400:00000200:2.0:1734258976.780657:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258976.780668:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258976.780673:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258976.780693:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258976.780696:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258976.780697:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258976.780700:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [865:865:256:4294967295] 192.168.202.108@tcp LPNI seq info [864:864:8:4294967295] 00000400:00000200:2.0:1734258976.780708:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734258976.780714:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258976.780717:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734258976.780722:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734258976.780729:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258976.780733:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734258976.780739:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734258976.780748:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734258976.780786:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734258976.780790:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509f8. 00000400:00000010:0.0:1734258976.780793:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734258976.780795:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098273152, portal 10 00000400:00000010:0.0:1734258976.780799:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734258976.780801:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098273152, offset 0 00000400:00000200:0.0:1734258976.780805:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734258976.780809:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734258976.780811:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734258976.780813:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734258976.780815:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734258976.780816:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734258976.780818:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [866:866:255:4294967295] 192.168.202.108@tcp LPNI seq info [865:865:7:4294967295] 00000400:00000200:0.0:1734258976.780823:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734258976.780826:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734258976.780828:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734258976.780831:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734258976.780835:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734258976.780837:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734258976.781021:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258976.781024:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734258976.781034:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258976.781037:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258976.781041:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:1.0:1734258976.781042:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:1.0:1734258976.781049:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098273024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258992 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734258976.781257:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734258976.781260:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734258976.781262:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734258976.781266:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734258976.781268:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:1.0:1734258976.781269:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:1.0:1734258976.781272:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098273152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258986 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258976.782901:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258976.782927:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61af00 00000400:00000200:0.0:1734258976.782935:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1bf9 [1] + 224 00000400:00000200:0.0:1734258976.782946:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258976.782949:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258976.782958:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098273024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258992 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258976.782994:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258976.782999:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61af80 00000400:00000200:0.0:1734258976.783004:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c01 [1] + 0 00000400:00000200:0.0:1734258976.783029:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258976.783032:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258976.783037:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098273152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258986 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258976.783127:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509f8. 00000400:00000200:1.0:1734258976.783132:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:1.0:1734258976.783134:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:1.0:1734258976.783268:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098273152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258986 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258976.783275:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098273152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258986 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258976.783300:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734258976.783304:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258976.783307:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:2.0:1734258976.783396:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734258976.783400:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258976.783401:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258976.783406:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098273024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258992 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258976.783411:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098273024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258992 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258976.783423:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258976.783426:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734258976.783428:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734258981.787669:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734258981.787688:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734258981.787739:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734258981.787746:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734258981.787783:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734258981.787791:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734258981.787796:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258981.787802:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098273280, portal 25 00000400:00000010:2.0:1734258981.787805:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734258981.787806:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098273280, offset 0 00000400:00000200:2.0:1734258981.787814:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258981.787823:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258981.787827:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258981.787830:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258981.787833:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258981.787844:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:1.0:1734258981.787847:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:2.0:1734258981.787847:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [867:867:256:4294967295] 192.168.202.108@tcp LPNI seq info [866:866:8:4294967295] 00000400:00000010:1.0:1734258981.787852:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000200:2.0:1734258981.787854:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734258981.787855:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258981.787858:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098273408, portal 10 00000800:00000200:2.0:1734258981.787859:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734258981.787862:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000010:1.0:1734258981.787863:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734258981.787864:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098273408, offset 0 00000800:00000200:2.0:1734258981.787866:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734258981.787869:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734258981.787873:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734258981.787874:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734258981.787876:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734258981.787899:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258981.787902:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258981.787904:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258981.787906:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258981.787907:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [868:868:255:4294967295] 192.168.202.108@tcp LPNI seq info [867:867:7:4294967295] 00000400:00000200:1.0:1734258981.787913:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258981.787917:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258981.787919:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734258981.787922:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258981.787925:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258981.787927:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258981.788192:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258981.788194:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258981.788199:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258981.788203:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258981.788206:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734258981.788207:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734258981.788214:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098273280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258997 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258981.788402:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258981.788404:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734258981.788406:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258981.788409:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258981.788411:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:0.0:1734258981.788413:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:0.0:1734258981.788416:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098273408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258991 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258981.790552:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258981.790585:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b080 00000400:00000200:0.0:1734258981.790592:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c11 [1] + 0 00000400:00000200:0.0:1734258981.790609:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258981.790612:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258981.790620:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098273408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258981.790909:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258981.790914:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258981.790915:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258981.790919:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098273408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258991 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258981.790925:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098273408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258991 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258981.790947:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258981.790951:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734258981.790955:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734258981.791442:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258981.791450:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b000 00000400:00000200:0.0:1734258981.791456:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c09 [1] + 224 00000400:00000200:0.0:1734258981.791466:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258981.791469:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258981.791474:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098273280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258997 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258981.791590:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734258981.791594:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258981.791595:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258981.791600:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098273280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258997 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258981.791605:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098273280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734258997 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258981.791616:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258981.791618:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734258981.791620:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734258986.798030:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734258986.798062:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734258986.798150:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734258986.798158:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734258986.798315:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734258986.798325:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:3.0:1734258986.798333:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258986.798342:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098273536, portal 25 00000400:00000010:3.0:1734258986.798347:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734258986.798350:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098273536, offset 0 00000400:00000200:3.0:1734258986.798363:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734258986.798381:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734258986.798388:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734258986.798392:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734258986.798396:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734258986.798398:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734258986.798408:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [869:869:256:4294967295] 192.168.202.108@tcp LPNI seq info [868:868:8:4294967295] 00000400:00000200:3.0:1734258986.798442:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734258986.798448:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734258986.798453:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734258986.798460:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734258986.798469:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734258986.798473:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734258986.798563:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258986.798600:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734258986.798604:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258986.798608:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098273664, portal 10 00000400:00000010:1.0:1734258986.798612:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734258986.798614:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098273664, offset 0 00000400:00000200:1.0:1734258986.798618:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258986.798624:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258986.798626:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258986.798634:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258986.798641:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258986.798643:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258986.798646:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [870:870:255:4294967295] 192.168.202.108@tcp LPNI seq info [869:869:7:4294967295] 00000400:00000200:1.0:1734258986.798652:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258986.798656:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258986.798659:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734258986.798661:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258986.798665:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258986.798667:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258986.800996:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258986.801003:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734258986.801010:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258986.801018:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258986.801023:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734258986.801025:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734258986.801038:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098273536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259002 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258986.801262:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258986.801265:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734258986.801267:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258986.801271:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258986.801274:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734258986.801275:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734258986.801280:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098273664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258996 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258986.803517:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258986.803536:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b100 00000400:00000200:0.0:1734258986.803554:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c19 [1] + 224 00000400:00000200:0.0:1734258986.803597:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258986.803602:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258986.803612:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098273536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259002 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734258986.803763:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734258986.803772:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734258986.803774:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734258986.803784:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098273536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259002 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734258986.803794:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098273536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259002 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734258986.803819:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734258986.803825:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734258986.803829:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734258986.804763:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258986.804773:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b180 00000400:00000200:0.0:1734258986.804779:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c21 [1] + 0 00000400:00000200:0.0:1734258986.804793:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258986.804796:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258986.804802:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098273664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258996 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258986.804885:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258986.804892:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258986.804893:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258986.804900:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098273664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258996 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258986.804908:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098273664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734258996 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258986.804929:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258986.804934:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734258986.804937:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734258991.803938:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258991.804032:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734258991.804116:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258991.804124:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734258991.804154:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734258991.804162:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734258991.804168:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258991.804175:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098273792, portal 25 00000400:00000010:2.0:1734258991.804179:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734258991.804181:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098273792, offset 0 00000400:00000200:2.0:1734258991.804189:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258991.804201:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258991.804205:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734258991.804209:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258991.804212:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734258991.804214:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258991.804217:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [871:871:256:4294967295] 192.168.202.108@tcp LPNI seq info [870:870:8:4294967295] 02000000:00000010:1.0:1734258991.804228:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734258991.804239:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000200:2.0:1734258991.804241:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734258991.804244:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000800:00000200:2.0:1734258991.804246:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:1.0:1734258991.804250:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098273920, portal 10 00000800:00000010:2.0:1734258991.804250:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734258991.804255:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:1.0:1734258991.804258:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734258991.804260:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098273920, offset 0 00000800:00000200:2.0:1734258991.804263:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734258991.804266:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734258991.804267:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258991.804277:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734258991.804281:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734258991.804284:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258991.804296:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734258991.804298:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734258991.804300:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [872:872:255:4294967295] 192.168.202.108@tcp LPNI seq info [871:871:7:4294967295] 00000400:00000200:1.0:1734258991.804308:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258991.804312:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258991.804315:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734258991.804319:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258991.804325:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258991.804328:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258991.804514:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258991.804519:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734258991.804525:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258991.804530:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258991.804535:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734258991.804537:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734258991.804546:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098273792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259007 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258991.805550:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258991.805555:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734258991.805560:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258991.805564:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258991.805587:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734258991.805589:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734258991.805604:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098273920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259001 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258991.806520:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258991.806545:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b200 00000400:00000200:0.0:1734258991.806553:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c29 [1] + 224 00000400:00000200:0.0:1734258991.806566:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258991.806595:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258991.806604:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098273792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259007 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258991.807217:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258991.807226:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b280 00000400:00000200:0.0:1734258991.807234:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c31 [1] + 0 00000400:00000200:0.0:1734258991.807256:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258991.807260:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258991.807267:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098273920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259001 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258991.807619:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258991.807626:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258991.807628:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258991.807636:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098273920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259001 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258991.807644:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098273920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259001 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258991.807674:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258991.807682:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734258991.807690:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:2.0:1734258991.807973:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734258991.807978:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258991.807980:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258991.807987:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098273792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259007 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258991.807994:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098273792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259007 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258991.808007:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258991.808011:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:2.0:1734258991.808014:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734258996.811699:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734258996.811716:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734258996.811784:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734258996.811791:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734258996.811803:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734258996.811810:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734258996.811815:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258996.811821:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098274048, portal 25 00000400:00000010:2.0:1734258996.811825:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734258996.811826:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098274048, offset 0 00000400:00000200:2.0:1734258996.811834:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734258996.811844:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734258996.811849:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:1.0:1734258996.811852:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:2.0:1734258996.811853:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734258996.811855:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:1.0:1734258996.811858:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000200:2.0:1734258996.811858:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734258996.811860:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [873:873:256:4294967295] 192.168.202.108@tcp LPNI seq info [872:872:8:4294967295] 00000400:00000010:1.0:1734258996.811861:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258996.811863:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098274176, portal 10 00000400:00000010:1.0:1734258996.811867:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000400:00000200:2.0:1734258996.811867:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:1.0:1734258996.811869:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098274176, offset 0 00000400:00000200:1.0:1734258996.811873:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258996.811880:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734258996.811880:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734258996.811883:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734258996.811883:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734258996.811885:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734258996.811886:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734258996.811888:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734258996.811894:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734258996.811895:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734258996.811896:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [874:874:255:4294967295] 192.168.202.108@tcp LPNI seq info [873:873:7:4294967295] 00000800:00000200:2.0:1734258996.811898:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734258996.811902:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734258996.811906:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734258996.811909:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734258996.811911:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734258996.811915:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734258996.811917:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734258996.812513:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258996.812516:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734258996.812520:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258996.812523:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258996.812527:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734258996.812528:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734258996.812533:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098274048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259012 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734258996.812594:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734258996.812599:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734258996.812601:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258996.812603:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734258996.812604:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:0.0:1734258996.812605:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:0.0:1734258996.812608:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098274176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259006 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734258996.814194:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258996.814208:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b300 00000400:00000200:0.0:1734258996.814215:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c39 [1] + 224 00000400:00000200:0.0:1734258996.814233:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258996.814236:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258996.814243:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098274048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259012 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734258996.814458:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734258996.814468:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734258996.814470:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734258996.814480:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098274048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259012 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734258996.814498:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098274048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259012 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734258996.814630:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734258996.814637:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734258996.814641:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734258996.819002:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734258996.819017:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b380 00000400:00000200:0.0:1734258996.819025:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c41 [1] + 0 00000400:00000200:0.0:1734258996.819044:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734258996.819047:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734258996.819056:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098274176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259006 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734258996.819132:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734258996.819137:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734258996.819139:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734258996.819144:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098274176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259006 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734258996.819151:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098274176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259006 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734258996.819176:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734258996.819181:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734258996.819185:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734259001.819745:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734259001.819765:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734259001.819828:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734259001.819834:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734259001.819931:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 02000000:00000010:1.0:1734259001.819932:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734259001.819938:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:3.0:1734259001.819938:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:1.0:1734259001.819945:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000010:3.0:1734259001.819945:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259001.819951:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098274304, portal 25 00000100:00000200:1.0:1734259001.819957:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098274432, portal 10 00000400:00000010:3.0:1734259001.819960:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000010:1.0:1734259001.819962:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:3.0:1734259001.819962:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098274304, offset 0 00000100:00000200:1.0:1734259001.819964:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098274432, offset 0 00000400:00000200:3.0:1734259001.819971:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259001.819979:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259001.819990:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259001.819995:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259001.819998:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259001.820001:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259001.820003:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259001.820005:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [875:875:256:4294967295] 192.168.202.108@tcp LPNI seq info [874:874:8:4294967295] 00000400:00000200:3.0:1734259001.820012:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259001.820027:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259001.820028:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259001.820031:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000400:00000200:1.0:1734259001.820032:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259001.820034:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259001.820036:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259001.820036:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259001.820037:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734259001.820043:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259001.820046:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734259001.820053:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [876:876:255:4294967295] 192.168.202.108@tcp LPNI seq info [875:875:7:4294967295] 00000400:00000200:1.0:1734259001.820058:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259001.820062:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259001.820065:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734259001.820068:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259001.820071:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259001.820074:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259001.820147:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259001.820149:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734259001.820153:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259001.820158:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259001.820161:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:0.0:1734259001.820167:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:0.0:1734259001.820174:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098274304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259017 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259001.820230:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259001.820232:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734259001.820234:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259001.820385:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259001.820388:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:0.0:1734259001.820390:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734259001.820394:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098274432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259011 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259001.824102:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259001.824122:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b400 00000400:00000200:0.0:1734259001.824132:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c49 [1] + 224 00000400:00000200:0.0:1734259001.824143:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259001.824147:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259001.824157:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098274304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259017 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259001.824197:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259001.824201:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b480 00000400:00000200:0.0:1734259001.824205:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c4d [1] + 0 00000400:00000200:0.0:1734259001.824225:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259001.824227:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259001.824232:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098274432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259001.824325:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259001.824333:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259001.824335:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259001.824344:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098274432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259011 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259001.824352:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098274432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259011 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259001.824377:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734259001.824382:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734259001.824385:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:3.0:1734259001.824395:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734259001.824399:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259001.824401:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259001.824406:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098274304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259017 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259001.824412:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098274304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259017 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259001.824431:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259001.824435:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734259001.824438:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734259006.827840:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734259006.827864:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 02000000:00000010:2.0:1734259006.828143:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734259006.828153:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734259006.828161:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734259006.828167:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098274560, portal 25 00000400:00000010:2.0:1734259006.828172:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734259006.828174:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098274560, offset 0 00000400:00000200:2.0:1734259006.828182:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259006.828196:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259006.828202:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259006.828206:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259006.828209:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259006.828210:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259006.828214:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [877:877:256:4294967295] 192.168.202.108@tcp LPNI seq info [876:876:8:4294967295] 00000400:00000200:2.0:1734259006.828221:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259006.828227:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259006.828243:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259006.828249:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259006.828256:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259006.828260:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259006.828469:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259006.828473:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259006.828476:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259006.828480:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259006.828484:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:1.0:1734259006.828485:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000010:0.0:1734259006.828492:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 00000100:00000200:1.0:1734259006.828492:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098274560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259022 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:0.0:1734259006.828500:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734259006.828531:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734259006.828536:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259006.828539:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259006.828541:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098274688, portal 10 00000400:00000010:1.0:1734259006.828546:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734259006.828553:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098274688, offset 0 00000400:00000200:1.0:1734259006.828595:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259006.828600:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259006.828602:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259006.828605:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259006.828606:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259006.828608:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259006.828609:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [878:878:256:4294967295] 192.168.202.108@tcp LPNI seq info [877:877:8:4294967295] 00000400:00000200:1.0:1734259006.828615:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259006.828618:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259006.828620:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734259006.828623:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259006.828627:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259006.828629:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259006.828758:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259006.828760:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734259006.828762:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259006.828765:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259006.828767:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734259006.828768:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734259006.828772:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098274688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259016 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259006.830519:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259006.830538:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b500 00000400:00000200:0.0:1734259006.830548:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c59 [1] + 224 00000400:00000200:0.0:1734259006.830560:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259006.830563:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259006.830597:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098274560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259022 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259006.830634:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259006.830639:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b580 00000400:00000200:0.0:1734259006.830644:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c61 [1] + 0 00000400:00000200:0.0:1734259006.830657:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259006.830660:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259006.830664:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098274688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259006.830724:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734259006.830729:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:2.0:1734259006.830730:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734259006.830736:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098274560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259022 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259006.830742:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098274560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259022 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259006.830765:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734259006.830770:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734259006.830776:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:1.0:1734259006.830944:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259006.830949:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259006.830951:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259006.830955:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098274688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259016 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259006.830961:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098274688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259016 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259006.830977:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734259006.830981:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734259006.830984:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734259011.835831:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734259011.835853:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734259011.835908:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734259011.835915:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734259011.835963:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 02000000:00000010:1.0:1734259011.835967:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:3.0:1734259011.835970:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:1.0:1734259011.835971:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259011.835976:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000010:3.0:1734259011.835976:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:1.0:1734259011.835980:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098274944, portal 10 00000100:00000200:3.0:1734259011.835980:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098274816, portal 25 00000400:00000010:3.0:1734259011.835983:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000400:00000010:1.0:1734259011.835984:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:3.0:1734259011.835984:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098274816, offset 0 00000100:00000200:1.0:1734259011.835985:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098274944, offset 0 00000400:00000200:3.0:1734259011.835992:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259011.836001:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259011.836003:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259011.836007:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259011.836010:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259011.836013:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259011.836015:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259011.836018:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [879:879:256:4294967295] 192.168.202.108@tcp LPNI seq info [878:878:8:4294967295] 00000400:00000200:3.0:1734259011.836025:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259011.836029:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259011.836031:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259011.836033:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259011.836035:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259011.836037:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000010:3.0:1734259011.836037:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000400:00000200:1.0:1734259011.836038:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259011.836040:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [880:880:255:4294967295] 192.168.202.108@tcp LPNI seq info [879:879:7:4294967295] 00000800:00000200:3.0:1734259011.836042:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259011.836046:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259011.836049:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734259011.836049:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:1.0:1734259011.836052:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:3.0:1734259011.836052:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259011.836054:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259011.836058:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259011.836060:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259011.836127:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259011.836130:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734259011.836135:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259011.836144:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259011.836148:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734259011.836150:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734259011.836156:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098274816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259027 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259011.836224:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259011.836226:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734259011.836229:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259011.836232:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259011.836234:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:0.0:1734259011.836235:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:0.0:1734259011.836238:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098274944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259021 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259011.839018:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259011.839041:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b680 00000400:00000200:0.0:1734259011.839049:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c69 [1] + 0 00000400:00000200:0.0:1734259011.839060:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259011.839064:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259011.839074:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098274944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259011.839114:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259011.839119:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b600 00000400:00000200:0.0:1734259011.839124:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c6d [1] + 224 00000400:00000200:0.0:1734259011.839141:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259011.839144:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259011.839148:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098274816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259027 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259011.839224:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734259011.839229:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259011.839231:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259011.839236:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098274816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259027 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259011.839243:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000100:00000200:3.0:1734259011.839243:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098274816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259027 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734259011.839247:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259011.839248:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259011.839253:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098274944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259021 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259011.839259:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098274944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259021 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259011.839265:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259011.839270:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734259011.839273:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 02000000:00000010:1.0:1734259011.839276:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734259011.839279:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734259011.839283:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734259016.843870:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734259016.843892:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734259016.843969:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734259016.843976:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:0.0:1734259016.844019:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734259016.844026:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d505d8. 00000400:00000010:0.0:1734259016.844033:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000100:00000200:0.0:1734259016.844039:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098275200, portal 10 00000400:00000010:0.0:1734259016.844046:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734259016.844048:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098275200, offset 0 00000400:00000200:0.0:1734259016.844057:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259016.844070:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259016.844075:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259016.844079:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259016.844082:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259016.844084:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259016.844087:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [881:881:256:4294967295] 192.168.202.108@tcp LPNI seq info [880:880:8:4294967295] 00000400:00000200:0.0:1734259016.844095:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259016.844100:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259016.844103:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734259016.844108:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259016.844116:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259016.844119:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734259016.844140:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734259016.844145:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734259016.844149:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734259016.844151:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098275072, portal 25 00000400:00000010:2.0:1734259016.844154:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734259016.844155:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098275072, offset 0 00000400:00000200:2.0:1734259016.844160:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259016.844165:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259016.844167:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259016.844169:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259016.844172:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259016.844173:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259016.844175:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [882:882:255:4294967295] 192.168.202.108@tcp LPNI seq info [881:881:7:4294967295] 00000400:00000200:2.0:1734259016.844181:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259016.844185:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259016.844187:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259016.844196:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259016.844200:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259016.844202:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259016.844223:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259016.844226:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:0.0:1734259016.844229:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259016.844233:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259016.844237:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:0.0:1734259016.844239:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734259016.844245:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098275200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259026 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259016.844271:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259016.844272:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259016.844280:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259016.844283:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259016.844284:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734259016.844286:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734259016.844289:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098275072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259032 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259016.848335:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259016.848353:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b780 00000400:00000200:0.0:1734259016.848360:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c79 [1] + 0 00000400:00000200:0.0:1734259016.848371:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259016.848374:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259016.848384:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098275200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259026 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259016.848426:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259016.848430:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b700 00000400:00000200:0.0:1734259016.848435:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c81 [1] + 224 00000400:00000200:0.0:1734259016.848452:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259016.848454:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259016.848459:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098275072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259032 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259016.848554:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d505d8. 00000400:00000200:2.0:1734259016.848559:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:2.0:1734259016.848562:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:2.0:1734259016.848642:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098275200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259026 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259016.848649:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098275200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259026 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259016.848674:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734259016.848677:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734259016.848680:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:3.0:1734259016.848747:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:3.0:1734259016.848751:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:3.0:1734259016.848752:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:3.0:1734259016.848756:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098275072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259032 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259016.848762:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098275072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259032 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259016.848771:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:3.0:1734259016.848774:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734259016.848776:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734259021.851743:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734259021.851763:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734259021.851865:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734259021.851873:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734259021.851937:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259021.851941:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:2.0:1734259021.851946:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:3.0:1734259021.851946:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000400:00000010:2.0:1734259021.851952:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000400:00000010:3.0:1734259021.851952:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259021.851957:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098275328, portal 25 00000100:00000200:2.0:1734259021.851961:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098275456, portal 10 00000400:00000010:3.0:1734259021.851961:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734259021.851963:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098275328, offset 0 00000400:00000010:2.0:1734259021.851965:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000400:00000200:3.0:1734259021.851970:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259021.851982:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098275456, offset 0 00000400:00000200:2.0:1734259021.851987:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259021.851991:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259021.851995:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259021.851999:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259021.852002:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259021.852004:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259021.852006:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [883:883:256:4294967295] 192.168.202.108@tcp LPNI seq info [882:882:8:4294967295] 00000400:00000200:3.0:1734259021.852013:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259021.852017:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259021.852019:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259021.852020:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000400:00000200:2.0:1734259021.852021:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259021.852023:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259021.852025:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259021.852025:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259021.852027:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259021.852029:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [884:884:255:4294967295] 192.168.202.108@tcp LPNI seq info [883:883:7:4294967295] 00000800:00000200:3.0:1734259021.852032:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259021.852034:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259021.852035:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259021.852038:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259021.852041:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259021.852044:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259021.852053:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259021.852055:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259021.852127:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259021.852130:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734259021.852134:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259021.852138:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259021.852141:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734259021.852147:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:0.0:1734259021.852205:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098275328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259037 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259021.852269:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259021.852271:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259021.852274:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259021.852276:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259021.852278:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734259021.852279:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734259021.852283:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098275456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259031 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259021.858141:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259021.858169:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b880 00000400:00000200:0.0:1734259021.858180:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c8d [1] + 0 00000400:00000200:0.0:1734259021.858210:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259021.858216:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259021.858233:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098275456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259031 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259021.858505:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259021.858512:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:2.0:1734259021.858514:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259021.858520:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098275456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259031 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259021.858527:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098275456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259031 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259021.858566:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259021.858635:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734259021.858642:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000200:0.0:1734259021.861671:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259021.861695:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b800 00000400:00000200:0.0:1734259021.861705:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1c89 [1] + 224 00000400:00000200:0.0:1734259021.861729:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259021.861732:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259021.861745:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098275328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259037 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259021.861966:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:3.0:1734259021.861973:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259021.861975:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259021.861982:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098275328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259037 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259021.861990:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098275328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259037 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259021.862021:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259021.862031:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:3.0:1734259021.862037:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734259026.860237:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734259026.860277:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734259026.860361:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734259026.860370:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734259026.860462:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734259026.860470:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50580. 00000400:00000010:0.0:1734259026.860481:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734259026.860492:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098275712, portal 10 00000400:00000010:0.0:1734259026.860503:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:0.0:1734259026.860506:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098275712, offset 0 00000400:00000200:0.0:1734259026.860519:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259026.860594:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259026.860600:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259026.860606:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259026.860610:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259026.860612:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259026.860616:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [885:885:256:4294967295] 192.168.202.108@tcp LPNI seq info [884:884:8:4294967295] 00000400:00000200:0.0:1734259026.860627:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259026.860634:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734259026.860638:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000800:00000010:0.0:1734259026.860639:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734259026.860647:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259026.860658:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:3.0:1734259026.860662:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16c08. 00000800:00000200:0.0:1734259026.860663:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000400:00000010:3.0:1734259026.860674:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259026.860684:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098275584, portal 25 00000400:00000010:3.0:1734259026.860692:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734259026.860694:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098275584, offset 0 00000400:00000200:3.0:1734259026.860706:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259026.860724:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259026.860729:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259026.860750:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259026.860754:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259026.860757:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259026.860762:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [886:886:255:4294967295] 192.168.202.108@tcp LPNI seq info [885:885:7:4294967295] 00000400:00000200:3.0:1734259026.860775:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259026.860785:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259026.860791:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734259026.860801:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259026.860812:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259026.860818:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259026.860848:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259026.860852:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734259026.860855:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259026.860860:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259026.860864:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:1.0:1734259026.860865:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:1.0:1734259026.860873:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098275712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259036 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259026.860916:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259026.860918:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:1.0:1734259026.860920:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259026.860923:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259026.860926:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:1.0:1734259026.860927:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:1.0:1734259026.860929:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098275584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259042 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259026.866767:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259026.866792:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61b980 00000400:00000200:0.0:1734259026.866801:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1c99 [1] + 0 00000400:00000200:0.0:1734259026.866816:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259026.866820:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259026.866832:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098275712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259036 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259026.867234:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259026.867239:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61b900 00000400:00000200:0.0:1734259026.867481:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ca1 [1] + 224 00000400:00000200:0.0:1734259026.867522:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259026.867525:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:2.0:1734259026.867958:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50580. 00000400:00000200:2.0:1734259026.867966:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:2.0:1734259026.867968:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:2.0:1734259026.867977:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098275712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259036 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259026.867985:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098275712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259036 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259026.868024:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734259026.868031:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734259026.868037:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000200:0.0:1734259026.868295:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098275584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259042 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259026.868431:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16c08. 00000400:00000200:2.0:1734259026.868436:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:2.0:1734259026.868437:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259026.868443:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098275584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259042 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259026.868450:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098275584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259042 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259026.868464:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:2.0:1734259026.868699:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734259026.868702:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734259031.867786:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734259031.867807:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734259031.867922:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734259031.867929:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734259031.867989:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734259031.867998:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259031.868004:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259031.868012:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098275840, portal 25 00000400:00000010:2.0:1734259031.868016:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259031.868018:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098275840, offset 0 00000400:00000200:2.0:1734259031.868028:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259031.868042:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259031.868047:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259031.868051:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259031.868054:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259031.868056:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259031.868059:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [887:887:256:4294967295] 192.168.202.108@tcp LPNI seq info [886:886:8:4294967295] 00000400:00000200:2.0:1734259031.868067:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259031.868072:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259031.868075:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259031.868081:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259031.868089:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259031.868092:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259031.868277:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259031.868281:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259031.868285:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734259031.868287:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098275968, portal 10 00000400:00000010:2.0:1734259031.868292:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259031.868294:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098275968, offset 0 00000400:00000200:2.0:1734259031.868297:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259031.868302:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259031.868305:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259031.868306:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259031.868320:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259031.868321:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259031.868324:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [888:888:255:4294967295] 192.168.202.108@tcp LPNI seq info [887:887:7:4294967295] 00000400:00000200:2.0:1734259031.868329:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259031.868332:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259031.868335:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259031.868337:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259031.868340:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259031.868342:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259031.868465:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259031.868468:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259031.868473:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259031.868477:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259031.868481:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:1.0:1734259031.868482:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:1.0:1734259031.868489:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098275840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259047 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259031.868660:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259031.868662:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734259031.868665:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259031.868668:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259031.868670:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:1.0:1734259031.868671:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:1.0:1734259031.868675:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098275968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259041 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259031.870170:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259031.870186:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ba80 00000400:00000200:0.0:1734259031.870194:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1cb1 [1] + 0 00000400:00000200:0.0:1734259031.870212:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259031.870215:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259031.870223:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098275968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259041 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259031.870293:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259031.870298:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:2.0:1734259031.870299:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734259031.870303:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098275968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259041 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259031.870309:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098275968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259041 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259031.870334:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259031.870339:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734259031.870343:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734259031.870616:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259031.870622:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ba00 00000400:00000200:0.0:1734259031.870627:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ca9 [1] + 224 00000400:00000200:0.0:1734259031.870638:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259031.870642:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259031.870646:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098275840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259047 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259031.870709:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259031.870712:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:2.0:1734259031.870713:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259031.870717:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098275840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259047 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259031.870723:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098275840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259047 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259031.870734:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734259031.870738:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734259031.870739:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734259036.875631:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734259036.875656:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 02000000:00000010:3.0:1734259036.875820:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734259036.875835:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259036.875845:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259036.875853:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098276096, portal 25 00000400:00000010:3.0:1734259036.875858:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734259036.875861:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098276096, offset 0 00000400:00000200:3.0:1734259036.875871:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259036.875953:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259036.875958:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259036.875962:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259036.875965:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259036.875967:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259036.875970:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [889:889:256:4294967295] 192.168.202.108@tcp LPNI seq info [888:888:8:4294967295] 00000400:00000200:3.0:1734259036.875978:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259036.875983:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259036.875987:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734259036.875993:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259036.876001:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259036.876005:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734259036.876128:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734259036.876342:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734259036.876630:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259036.876652:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259036.876658:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259036.876664:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098276224, portal 10 00000400:00000010:2.0:1734259036.876670:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734259036.876672:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098276224, offset 0 00000400:00000200:2.0:1734259036.876679:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259036.876689:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259036.876693:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259036.876697:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259036.876699:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259036.876701:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259036.876704:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [890:890:255:4294967295] 192.168.202.108@tcp LPNI seq info [889:889:7:4294967295] 00000400:00000200:2.0:1734259036.876712:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259036.876717:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259036.876720:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259036.876725:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259036.876731:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259036.876734:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734259036.876811:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734259036.876825:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:3.0:1734259036.876829:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734259036.876834:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734259036.876838:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:3.0:1734259036.876840:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734259036.876849:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098276096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259052 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734259036.877330:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734259036.877333:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:3.0:1734259036.877337:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734259036.877340:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734259036.877343:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:3.0:1734259036.877344:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:3.0:1734259036.877349:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098276224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259046 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259036.878620:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259036.878635:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61bb80 00000400:00000200:0.0:1734259036.878648:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1cc1 [1] + 0 00000400:00000200:0.0:1734259036.878664:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259036.878667:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259036.878675:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098276224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259046 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259036.878857:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259036.878867:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:2.0:1734259036.878869:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259036.878879:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098276224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259046 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259036.878887:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098276224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259046 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259036.878924:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259036.878934:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734259036.878943:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734259036.879415:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259036.879427:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61bb00 00000400:00000200:0.0:1734259036.879433:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1cb9 [1] + 224 00000400:00000200:0.0:1734259036.879443:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259036.879446:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259036.879452:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098276096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259052 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259036.879625:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259036.879631:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259036.879632:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259036.879637:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098276096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259052 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259036.879643:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098276096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259052 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259036.879665:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259036.879670:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734259036.879673:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:2.0:1734259041.884239:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259041.884265:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259041.884340:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259041.884348:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259041.884381:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259041.884389:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259041.884398:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259041.884406:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098276480, portal 10 00000400:00000010:2.0:1734259041.884414:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734259041.884416:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098276480, offset 0 00000400:00000200:2.0:1734259041.884459:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259041.884473:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259041.884478:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259041.884482:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259041.884485:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259041.884487:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259041.884490:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [891:891:256:4294967295] 192.168.202.108@tcp LPNI seq info [890:890:8:4294967295] 00000400:00000200:2.0:1734259041.884498:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259041.884503:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259041.884506:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259041.884512:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259041.884520:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259041.884524:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259041.884531:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734259041.884535:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259041.884538:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259041.884540:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098276352, portal 25 00000400:00000010:3.0:1734259041.884543:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734259041.884544:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098276352, offset 0 00000400:00000200:3.0:1734259041.884548:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259041.884557:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259041.884559:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259041.884561:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259041.884563:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259041.884564:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259041.884566:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [892:892:255:4294967295] 192.168.202.108@tcp LPNI seq info [891:891:7:4294967295] 00000400:00000200:3.0:1734259041.884609:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259041.884612:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259041.884614:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734259041.884617:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259041.884620:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259041.884622:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734259041.884670:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734259041.884673:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:3.0:1734259041.884678:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734259041.884683:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734259041.884686:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:3.0:1734259041.884687:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:3.0:1734259041.884695:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098276480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259051 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734259041.884757:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734259041.884759:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:3.0:1734259041.884761:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734259041.884763:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734259041.884765:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:3.0:1734259041.884766:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734259041.884769:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098276352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259057 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259041.889360:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259041.889379:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61bc80 00000400:00000200:0.0:1734259041.889387:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1cc9 [1] + 0 00000400:00000200:0.0:1734259041.889398:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259041.889402:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259041.889411:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098276480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259051 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259041.889460:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259041.889465:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61bc00 00000400:00000200:0.0:1734259041.889470:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1cd1 [1] + 224 00000400:00000200:0.0:1734259041.889489:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259041.889492:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259041.889498:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098276352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259057 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259041.889503:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259041.889508:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:2.0:1734259041.889510:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259041.889516:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098276480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259051 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259041.889523:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098276480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259051 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259041.889548:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259041.889554:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259041.889566:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000010:3.0:1734259041.889600:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259041.889604:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259041.889605:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259041.889614:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098276352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259057 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259041.889620:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098276352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259057 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259041.889630:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259041.889633:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734259041.889635:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000100:00000010:0.0:1734259046.891833:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734259046.891863:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734259046.891966:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734259046.891973:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734259046.891973:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734259046.891980:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259046.891985:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259046.891991:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098276608, portal 25 00000400:00000010:2.0:1734259046.891994:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259046.891996:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098276608, offset 0 02000000:00000010:3.0:1734259046.891996:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259046.892001:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000200:2.0:1734259046.892004:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734259046.892008:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259046.892011:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098276736, portal 10 00000400:00000200:2.0:1734259046.892014:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:3.0:1734259046.892014:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734259046.892016:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098276736, offset 0 00000400:00000200:2.0:1734259046.892019:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259046.892020:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259046.892023:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259046.892026:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259046.892027:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259046.892030:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [893:893:256:4294967295] 192.168.202.108@tcp LPNI seq info [892:892:8:4294967295] 00000400:00000200:2.0:1734259046.892042:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259046.892047:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259046.892051:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259046.892056:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259046.892063:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259046.892066:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734259046.892105:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259046.892108:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259046.892110:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259046.892112:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259046.892114:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259046.892116:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [894:894:255:4294967295] 192.168.202.108@tcp LPNI seq info [893:893:7:4294967295] 00000400:00000200:3.0:1734259046.892122:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259046.892126:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259046.892128:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734259046.892131:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259046.892134:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259046.892136:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259046.892165:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259046.892167:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259046.892171:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259046.892175:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259046.892178:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734259046.892179:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734259046.892185:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098276608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259062 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259046.892210:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259046.892212:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734259046.892214:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259046.892216:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259046.892217:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734259046.892218:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734259046.892221:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098276736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259056 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259046.893884:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259046.893896:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61bd80 00000400:00000200:0.0:1734259046.893901:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ce1 [1] + 0 00000400:00000200:0.0:1734259046.893909:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259046.893911:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259046.893918:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098276736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259056 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259046.893951:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259046.893955:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61bd00 00000400:00000200:0.0:1734259046.893959:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1cd9 [1] + 224 00000400:00000200:0.0:1734259046.893972:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259046.893981:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259046.893985:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098276608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259062 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259046.894068:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259046.894072:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:2.0:1734259046.894073:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259046.894078:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098276608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259062 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259046.894079:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259046.894082:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259046.894083:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259046.894084:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098276608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259062 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259046.894086:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098276736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259056 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259046.894099:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098276736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259056 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259046.894103:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734259046.894106:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:2.0:1734259046.894109:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 02000000:00000010:3.0:1734259046.894114:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259046.894116:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:3.0:1734259046.894117:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734259051.899925:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734259051.899944:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734259051.899999:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734259051.900005:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734259051.900037:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 02000000:00000010:0.0:1734259051.900040:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734259051.900045:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50528. 00000400:00000010:3.0:1734259051.900045:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:0.0:1734259051.900051:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000400:00000010:3.0:1734259051.900051:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259051.900056:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098276864, portal 25 00000100:00000200:0.0:1734259051.900060:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098276992, portal 10 00000400:00000010:3.0:1734259051.900060:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734259051.900062:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098276864, offset 0 00000400:00000010:0.0:1734259051.900064:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000400:00000200:3.0:1734259051.900069:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734259051.900074:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098276992, offset 0 00000400:00000200:0.0:1734259051.900079:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259051.900080:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259051.900084:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259051.900087:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259051.900090:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259051.900092:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259051.900094:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [895:895:256:4294967295] 192.168.202.108@tcp LPNI seq info [894:894:8:4294967295] 00000400:00000200:3.0:1734259051.900101:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259051.900105:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259051.900106:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259051.900109:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734259051.900109:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734259051.900111:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259051.900112:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259051.900113:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259051.900114:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259051.900116:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [896:896:255:4294967295] 192.168.202.108@tcp LPNI seq info [895:895:7:4294967295] 00000800:00000200:3.0:1734259051.900120:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734259051.900121:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259051.900123:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259051.900125:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259051.900127:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734259051.900130:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259051.900133:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259051.900135:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259051.900500:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259051.900504:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:1.0:1734259051.900508:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259051.900511:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259051.900515:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:1.0:1734259051.900516:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:1.0:1734259051.900522:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098276864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259067 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259051.900734:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259051.900736:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734259051.900738:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259051.900741:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259051.900743:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:1.0:1734259051.900745:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:1.0:1734259051.900748:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098276992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259061 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259051.905757:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259051.905774:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61be80 00000400:00000200:0.0:1734259051.905781:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ced [1] + 0 00000400:00000200:0.0:1734259051.905799:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259051.905809:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259051.905819:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098276992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259061 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259051.906059:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50528. 00000400:00000200:2.0:1734259051.906064:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:2.0:1734259051.906066:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:2.0:1734259051.906070:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098276992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259061 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259051.906075:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098276992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259061 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259051.906099:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734259051.906103:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734259051.906107:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734259051.906335:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259051.906350:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61be00 00000400:00000200:0.0:1734259051.906355:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ce9 [1] + 224 00000400:00000200:0.0:1734259051.906365:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259051.906368:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259051.906373:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098276864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259067 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259051.906607:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259051.906611:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259051.906612:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259051.906616:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098276864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259067 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259051.906630:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098276864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259067 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259051.906640:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259051.906643:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734259051.906645:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734259056.907903:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734259056.907934:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734259056.908006:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734259056.908013:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734259056.908047:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734259056.908056:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259056.908064:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259056.908071:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098277120, portal 25 00000400:00000010:3.0:1734259056.908077:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734259056.908079:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098277120, offset 0 00000400:00000200:3.0:1734259056.908089:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259056.908105:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259056.908111:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259056.908115:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259056.908118:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 02000000:00000010:2.0:1734259056.908119:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:3.0:1734259056.908120:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259056.908123:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [897:897:256:4294967295] 192.168.202.108@tcp LPNI seq info [896:896:8:4294967295] 00000400:00000010:2.0:1734259056.908124:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259056.908127:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259056.908129:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098277248, portal 10 00000400:00000200:3.0:1734259056.908131:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:2.0:1734259056.908134:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734259056.908135:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098277248, offset 0 00000800:00000200:3.0:1734259056.908136:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259056.908140:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259056.908141:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000400:00000200:2.0:1734259056.908144:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259056.908147:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:3.0:1734259056.908147:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259056.908149:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259056.908151:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259056.908152:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734259056.908154:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259056.908155:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [898:898:255:4294967295] 192.168.202.108@tcp LPNI seq info [897:897:7:4294967295] 00000800:00000200:3.0:1734259056.908159:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259056.908160:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259056.908163:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259056.908166:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259056.908168:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259056.908171:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259056.908173:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259056.908439:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259056.908442:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734259056.908448:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259056.908452:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259056.908457:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734259056.908459:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734259056.908468:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098277120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259072 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259056.908621:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259056.908623:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259056.908626:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259056.908629:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259056.908631:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734259056.908632:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734259056.908635:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098277248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259066 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259056.910757:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259056.910796:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61bf00 00000400:00000200:0.0:1734259056.910806:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1cf9 [1] + 224 00000400:00000200:0.0:1734259056.910821:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259056.910824:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259056.910838:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098277120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259072 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259056.910881:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259056.910886:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61bf80 00000400:00000200:0.0:1734259056.910891:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d01 [1] + 0 00000400:00000200:0.0:1734259056.910905:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259056.910908:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259056.910914:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098277248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259066 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259056.911004:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259056.911011:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259056.911013:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259056.911019:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098277120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259072 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259056.911037:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098277120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259072 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259056.911061:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259056.911067:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734259056.911072:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:2.0:1734259056.911146:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259056.911156:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:2.0:1734259056.911157:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259056.911162:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098277248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259066 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259056.911170:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098277248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259066 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734259056.911184:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:2.0:1734259056.911193:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259056.911198:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734259056.911202:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734259061.915735:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734259061.915759:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 02000000:00000010:1.0:1734259061.915843:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0000. 00000400:00000010:1.0:1734259061.915852:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259061.915859:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259061.915866:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098277376, portal 25 00000400:00000010:1.0:1734259061.915870:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734259061.915871:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098277376, offset 0 00000400:00000200:1.0:1734259061.915879:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259061.915892:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259061.915897:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000010:0.0:1734259061.915898:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 00000400:00000200:1.0:1734259061.915901:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259061.915903:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 02000000:00000010:0.0:1734259061.915906:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 00000400:00000200:1.0:1734259061.915906:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259061.915909:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [899:899:256:4294967295] 192.168.202.108@tcp LPNI seq info [898:898:8:4294967295] 00000400:00000200:1.0:1734259061.915917:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259061.915922:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259061.915926:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734259061.915930:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259061.915937:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259061.915941:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259061.916041:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259061.916044:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734259061.916048:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259061.916052:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259061.916056:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:0.0:1734259061.916058:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:0.0:1734259061.916064:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098277376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259077 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259061.916174:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259061.916178:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259061.916181:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259061.916184:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098277504, portal 10 00000400:00000010:2.0:1734259061.916188:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734259061.916190:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098277504, offset 0 00000400:00000200:2.0:1734259061.916194:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259061.916198:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259061.916200:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259061.916202:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259061.916204:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259061.916205:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259061.916207:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [900:900:256:4294967295] 192.168.202.108@tcp LPNI seq info [899:899:8:4294967295] 00000400:00000200:2.0:1734259061.916212:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259061.916215:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259061.916217:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259061.916220:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259061.916224:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259061.916226:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259061.916474:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259061.916476:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259061.916483:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259061.916486:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259061.916488:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734259061.916505:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734259061.916511:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098277504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259071 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259061.920750:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259061.920770:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c000 00000400:00000200:0.0:1734259061.920779:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d09 [1] + 224 00000400:00000200:0.0:1734259061.920792:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259061.920795:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259061.920806:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098277376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259077 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259061.920850:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259061.920854:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c080 00000400:00000200:0.0:1734259061.920859:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d11 [1] + 0 00000400:00000200:0.0:1734259061.920876:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259061.920879:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259061.920883:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098277504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259071 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259061.920957:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259061.920969:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:2.0:1734259061.920970:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259061.920975:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098277504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259071 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259061.920981:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098277504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259071 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259061.920982:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259061.920986:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259061.920987:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259061.920998:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098277376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259077 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259061.921004:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098277376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259077 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259061.921010:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259061.921016:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 02000000:00000010:1.0:1734259061.921017:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0000. 02000000:00000010:1.0:1734259061.921020:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734259061.921020:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:1.0:1734259061.921022:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734259066.923730:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734259066.923750:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734259066.923810:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734259066.923817:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734259066.923859:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734259066.923865:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d504d0. 00000400:00000010:0.0:1734259066.923871:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734259066.923877:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098277760, portal 10 00000400:00000010:0.0:1734259066.923882:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000100:00000200:0.0:1734259066.923884:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098277760, offset 0 00000400:00000200:0.0:1734259066.923892:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259066.923903:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259066.923918:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259066.923921:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259066.923924:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259066.923926:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259066.923928:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [901:901:256:4294967295] 192.168.202.108@tcp LPNI seq info [900:900:8:4294967295] 00000400:00000200:0.0:1734259066.923936:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259066.923941:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259066.923944:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734259066.923949:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259066.923956:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259066.923960:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734259066.924065:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734259066.924070:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259066.924073:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259066.924076:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098277632, portal 25 00000400:00000010:2.0:1734259066.924078:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734259066.924079:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098277632, offset 0 00000400:00000200:2.0:1734259066.924083:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259066.924088:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259066.924090:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259066.924092:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734259066.924137:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259066.924141:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:1.0:1734259066.924145:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259066.924150:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259066.924154:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:1.0:1734259066.924156:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:1.0:1734259066.924164:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098277760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259076 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734259066.924201:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259066.924203:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259066.924204:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [902:902:255:4294967295] 192.168.202.108@tcp LPNI seq info [901:901:7:4294967295] 00000400:00000200:2.0:1734259066.924210:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259066.924214:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259066.924217:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259066.924219:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259066.924223:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259066.924225:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259066.925019:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259066.925023:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259066.925027:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259066.925031:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259066.925034:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:1.0:1734259066.925036:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:1.0:1734259066.925040:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098277632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259082 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259066.927749:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259066.927767:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c180 00000400:00000200:0.0:1734259066.927774:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d19 [1] + 0 00000400:00000200:0.0:1734259066.927784:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259066.927787:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259066.927796:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098277760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259076 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259066.927833:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259066.927837:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c100 00000400:00000200:0.0:1734259066.927841:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d21 [1] + 224 00000400:00000200:0.0:1734259066.927854:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259066.927856:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259066.927860:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098277632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259082 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259066.928057:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d504d0. 00000400:00000200:2.0:1734259066.928061:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:2.0:1734259066.928071:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:2.0:1734259066.928075:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098277760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259076 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259066.928080:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098277760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259076 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259066.928105:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:2.0:1734259066.928109:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734259066.928112:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:3.0:1734259066.928154:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:3.0:1734259066.928160:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:3.0:1734259066.928162:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:3.0:1734259066.928169:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098277632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259082 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259066.928177:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098277632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259082 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259066.928191:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:3.0:1734259066.928196:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734259066.928199:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:2.0:1734259071.931778:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259071.931801:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259071.931852:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259071.931858:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259071.931886:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259071.931892:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259071.931898:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734259071.931904:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098278016, portal 10 00000400:00000010:2.0:1734259071.931910:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259071.931912:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098278016, offset 0 00000400:00000200:2.0:1734259071.931919:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259071.931929:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259071.931933:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259071.931937:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259071.931939:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259071.931941:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259071.931944:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [903:903:256:4294967295] 192.168.202.108@tcp LPNI seq info [902:902:8:4294967295] 00000400:00000200:2.0:1734259071.931955:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259071.931959:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259071.931963:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259071.931967:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259071.931974:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259071.931988:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:0.0:1734259071.932073:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3a600. 00000400:00000010:0.0:1734259071.932078:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50478. 00000400:00000010:0.0:1734259071.932081:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734259071.932088:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098277888, portal 25 00000400:00000010:0.0:1734259071.932090:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000100:00000200:0.0:1734259071.932091:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098277888, offset 0 00000400:00000200:0.0:1734259071.932095:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259071.932098:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259071.932101:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259071.932102:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259071.932104:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259071.932106:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259071.932107:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [904:904:255:4294967295] 192.168.202.108@tcp LPNI seq info [903:903:7:4294967295] 00000400:00000200:0.0:1734259071.932113:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259071.932116:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259071.932118:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000800:00000200:0.0:1734259071.932120:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259071.932124:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259071.932126:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259071.932165:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259071.932169:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734259071.932173:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259071.932177:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259071.932181:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:1.0:1734259071.932183:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:1.0:1734259071.932202:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098278016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259081 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259071.932265:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259071.932271:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:1.0:1734259071.932273:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259071.932275:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259071.932283:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:1.0:1734259071.932284:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:1.0:1734259071.932287:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098277888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259087 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259071.934063:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259071.934079:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c200 00000400:00000200:0.0:1734259071.934085:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d31 [1] + 224 00000400:00000200:0.0:1734259071.934103:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259071.934106:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259071.934113:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098277888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259087 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259071.934225:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50478. 00000400:00000200:2.0:1734259071.934230:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:2.0:1734259071.934232:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:2.0:1734259071.934236:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098277888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259087 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259071.934242:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098277888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259087 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259071.934262:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3a600. 02000000:00000010:2.0:1734259071.934266:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259071.934269:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000200:0.0:1734259071.935283:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259071.935296:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c280 00000400:00000200:0.0:1734259071.935302:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d29 [1] + 0 00000400:00000200:0.0:1734259071.935316:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259071.935320:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259071.935327:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098278016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259081 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259071.935497:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259071.935502:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:2.0:1734259071.935504:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734259071.935508:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098278016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259081 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259071.935514:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098278016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259081 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259071.935535:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259071.935539:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259071.935542:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:2.0:1734259076.940248:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259076.940270:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259076.940325:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259076.940331:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259076.940341:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734259076.940348:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259076.940354:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 02000000:00000010:2.0:1734259076.940356:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259076.940359:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000100:00000200:3.0:1734259076.940360:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098278144, portal 25 00000400:00000010:2.0:1734259076.940363:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000400:00000010:3.0:1734259076.940364:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:2.0:1734259076.940365:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098278272, portal 10 00000100:00000200:3.0:1734259076.940366:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098278144, offset 0 00000400:00000010:2.0:1734259076.940370:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000400:00000200:3.0:1734259076.940373:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259076.940387:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259076.940391:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259076.940395:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259076.940397:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259076.940399:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259076.940401:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [905:905:256:4294967295] 192.168.202.108@tcp LPNI seq info [904:904:8:4294967295] 00000400:00000200:3.0:1734259076.940408:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259076.940412:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259076.940425:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734259076.940431:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259076.940438:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259076.940441:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:2.0:1734259076.940473:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098278272, offset 0 00000400:00000200:2.0:1734259076.940484:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259076.940488:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259076.940491:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259076.940493:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259076.940494:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259076.940496:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259076.940498:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [906:906:255:4294967295] 192.168.202.108@tcp LPNI seq info [905:905:7:4294967295] 00000400:00000200:2.0:1734259076.940503:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259076.940506:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259076.940509:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259076.940511:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259076.940515:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259076.940517:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259076.940618:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259076.940621:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:1.0:1734259076.940624:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259076.940627:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259076.940630:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:1.0:1734259076.940631:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:1.0:1734259076.940636:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098278144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259092 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259076.941113:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259076.941115:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259076.941117:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259076.941119:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259076.941121:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:1.0:1734259076.941122:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:1.0:1734259076.941125:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098278272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259086 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259076.944110:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259076.944126:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c300 00000400:00000200:0.0:1734259076.944133:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d39 [1] + 224 00000400:00000200:0.0:1734259076.944163:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259076.944167:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259076.944175:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098278144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259092 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259076.944267:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259076.944272:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259076.944274:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259076.944278:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098278144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259092 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259076.944284:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098278144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259092 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259076.944302:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259076.944306:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734259076.944309:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000200:0.0:1734259076.944840:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259076.944846:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c380 00000400:00000200:0.0:1734259076.944850:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d3d [1] + 0 00000400:00000200:0.0:1734259076.944858:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259076.944859:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259076.944863:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098278272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259086 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259076.944923:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259076.944927:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:2.0:1734259076.944928:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734259076.944933:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098278272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259086 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259076.944939:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098278272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259086 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259076.944954:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259076.944958:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259076.944959:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259081.947696:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259081.947717:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 02000000:00000010:1.0:1734259081.948058:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734259081.948066:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259081.948073:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259081.948080:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098278400, portal 25 00000400:00000010:1.0:1734259081.948084:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734259081.948086:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098278400, offset 0 00000400:00000200:1.0:1734259081.948095:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259081.948108:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259081.948144:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259081.948161:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259081.948164:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259081.948166:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259081.948169:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [907:907:256:4294967295] 192.168.202.108@tcp LPNI seq info [906:906:8:4294967295] 00000400:00000200:1.0:1734259081.948181:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259081.948187:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259081.948191:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734259081.948196:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259081.948204:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259081.948208:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:2.0:1734259081.948566:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259081.948594:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259081.948621:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259081.948624:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259081.948627:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734259081.948635:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098278528, portal 10 00000400:00000010:2.0:1734259081.948639:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734259081.948640:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098278528, offset 0 00000400:00000200:2.0:1734259081.948644:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259081.948648:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259081.948650:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259081.948652:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259081.948654:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259081.948655:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259081.948657:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [908:908:255:4294967295] 192.168.202.108@tcp LPNI seq info [907:907:7:4294967295] 00000400:00000200:2.0:1734259081.948663:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259081.948666:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259081.948668:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259081.948671:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259081.948674:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259081.948676:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259081.948768:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259081.948772:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734259081.948776:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259081.948780:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259081.948784:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734259081.948785:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734259081.948792:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098278400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259097 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259081.948850:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259081.948852:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259081.948854:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259081.948857:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259081.948859:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734259081.948860:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734259081.948863:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098278528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259091 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259081.953469:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259081.953488:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c400 00000400:00000200:0.0:1734259081.953497:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d49 [1] + 224 00000400:00000200:0.0:1734259081.953507:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259081.953511:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259081.953522:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098278400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259097 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259081.953561:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259081.953565:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c480 00000400:00000200:0.0:1734259081.953607:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d51 [1] + 0 00000400:00000200:0.0:1734259081.953623:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259081.953626:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259081.953630:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098278528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259091 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259081.953723:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259081.953728:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259081.953729:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259081.953734:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098278400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259097 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259081.953740:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098278400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259097 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259081.953763:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734259081.953767:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259081.953771:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000010:2.0:1734259081.953838:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259081.953842:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:2.0:1734259081.953843:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734259081.953848:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098278528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259091 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259081.953854:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098278528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259091 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259081.953872:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259081.953876:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259081.953878:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734259086.955755:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259086.955784:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259086.955862:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259086.955870:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259086.955941:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259086.955951:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259086.955959:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734259086.955968:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098278784, portal 10 00000400:00000010:2.0:1734259086.955976:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734259086.955978:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098278784, offset 0 00000400:00000200:2.0:1734259086.955988:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259086.956005:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259086.956012:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259086.956016:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259086.956019:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259086.956021:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259086.956024:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [909:909:256:4294967295] 192.168.202.108@tcp LPNI seq info [908:908:8:4294967295] 00000400:00000200:2.0:1734259086.956033:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259086.956038:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259086.956042:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259086.956049:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259086.956059:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259086.956064:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:0.0:1734259086.956100:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734259086.956116:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50420. 00000400:00000010:0.0:1734259086.956124:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734259086.956132:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098278656, portal 25 00000400:00000010:0.0:1734259086.956139:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734259086.956142:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098278656, offset 0 00000400:00000200:0.0:1734259086.956151:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259086.956164:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259086.956171:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259086.956174:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259086.956177:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259086.956179:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259086.956182:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [910:910:255:4294967295] 192.168.202.108@tcp LPNI seq info [909:909:7:4294967295] 00000400:00000200:0.0:1734259086.956191:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259086.956210:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259086.956213:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734259086.956217:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259086.956223:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259086.956226:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259086.956233:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259086.956237:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734259086.956241:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259086.956246:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259086.956249:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:1.0:1734259086.956251:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:1.0:1734259086.956259:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098278784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259096 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259086.956285:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259086.956287:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:1.0:1734259086.956289:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259086.956296:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259086.956299:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:1.0:1734259086.956300:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:1.0:1734259086.956303:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098278656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259102 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259086.959947:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259086.959970:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c500 00000400:00000200:0.0:1734259086.959979:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d61 [1] + 224 00000400:00000200:0.0:1734259086.959994:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259086.959998:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259086.960010:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098278656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259102 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259086.960052:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259086.960056:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c580 00000400:00000200:0.0:1734259086.960061:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d59 [1] + 0 00000400:00000200:0.0:1734259086.960089:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259086.960092:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259086.960098:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098278784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259096 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259086.960197:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50420. 00000400:00000200:2.0:1734259086.960204:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:2.0:1734259086.960205:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:2.0:1734259086.960215:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098278656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259102 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259086.960221:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098278656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259102 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259086.960247:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734259086.960254:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259086.960259:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000400:00000010:3.0:1734259086.960338:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:3.0:1734259086.960342:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:3.0:1734259086.960344:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:3.0:1734259086.960349:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098278784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259096 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259086.960354:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098278784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259096 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259086.960372:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259086.960377:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259086.960379:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734259091.963802:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259091.963839:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259091.963908:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259091.963916:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259091.963954:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3be00. 02000000:00000010:2.0:1734259091.963954:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:0.0:1734259091.963961:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d503c8. 00000400:00000010:2.0:1734259091.963962:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:0.0:1734259091.963968:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000400:00000010:2.0:1734259091.963968:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259091.963976:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098279040, portal 10 00000100:00000200:0.0:1734259091.963981:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098278912, portal 25 00000400:00000010:2.0:1734259091.963982:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734259091.963984:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098279040, offset 0 00000400:00000010:0.0:1734259091.963985:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734259091.963986:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098278912, offset 0 00000400:00000200:2.0:1734259091.963992:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259091.963997:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259091.964006:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259091.964011:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259091.964015:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259091.964019:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259091.964020:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259091.964023:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [911:911:256:4294967295] 192.168.202.108@tcp LPNI seq info [910:910:8:4294967295] 00000400:00000200:2.0:1734259091.964031:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259091.964049:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259091.964050:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259091.964053:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734259091.964053:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259091.964059:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259091.964065:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734259091.964066:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734259091.964067:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259091.964069:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734259091.964069:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734259091.964071:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [912:912:255:4294967295] 192.168.202.108@tcp LPNI seq info [911:911:7:4294967295] 00000400:00000200:0.0:1734259091.964077:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259091.964081:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259091.964083:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734259091.964086:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259091.964090:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259091.964092:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259091.964149:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259091.964152:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259091.964158:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259091.964162:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259091.964165:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:1.0:1734259091.964166:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:1.0:1734259091.964173:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098279040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259101 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259091.964243:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259091.964245:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734259091.964248:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259091.964250:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259091.964252:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:1.0:1734259091.964253:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:1.0:1734259091.964256:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098278912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259107 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259091.968406:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259091.968428:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c680 00000400:00000200:0.0:1734259091.968438:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d69 [1] + 0 00000400:00000200:0.0:1734259091.968452:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259091.968456:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259091.968466:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098279040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259101 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259091.968508:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259091.968513:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c600 00000400:00000200:0.0:1734259091.968518:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d6d [1] + 224 00000400:00000200:0.0:1734259091.968537:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259091.968540:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259091.968545:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098278912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259107 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259091.968858:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259091.968863:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259091.968865:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259091.968870:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098279040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259101 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259091.968876:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098279040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259101 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259091.968904:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259091.968917:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259091.968921:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:1.0:1734259091.968994:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d503c8. 00000400:00000200:1.0:1734259091.968998:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:1.0:1734259091.968999:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:1.0:1734259091.969003:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098278912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259107 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259091.969009:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098278912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259107 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259091.969019:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3be00. 02000000:00000010:1.0:1734259091.969023:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259091.969026:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734259096.971693:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259096.971713:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 02000000:00000010:3.0:1734259096.971792:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734259096.971800:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259096.971805:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259096.971811:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098279168, portal 25 00000400:00000010:3.0:1734259096.971814:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734259096.971817:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098279168, offset 0 00000400:00000200:3.0:1734259096.971824:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259096.971844:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259096.971848:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259096.971851:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259096.971854:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259096.971856:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259096.971858:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [913:913:256:4294967295] 192.168.202.108@tcp LPNI seq info [912:912:8:4294967295] 00000100:00000010:2.0:1734259096.971865:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 00000400:00000200:3.0:1734259096.971866:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259096.971870:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734259096.971872:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 00000800:00000010:3.0:1734259096.971873:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734259096.971878:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259096.971885:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259096.971892:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:0.0:1734259096.972040:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734259096.972045:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50370. 00000400:00000010:0.0:1734259096.972049:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000100:00000200:0.0:1734259096.972051:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098279296, portal 10 00000400:00000010:0.0:1734259096.972061:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000100:00000200:0.0:1734259096.972062:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098279296, offset 0 00000400:00000200:0.0:1734259096.972067:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259096.972071:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259096.972074:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259096.972076:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259096.972078:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259096.972080:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259096.972082:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [914:914:255:4294967295] 192.168.202.108@tcp LPNI seq info [913:913:7:4294967295] 00000400:00000200:0.0:1734259096.972088:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259096.972091:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259096.972093:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000800:00000200:0.0:1734259096.972096:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259096.972100:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259096.972101:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259096.972233:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259096.972240:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:1.0:1734259096.972243:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259096.972247:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259096.972251:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:1.0:1734259096.972252:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:1.0:1734259096.972258:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098279168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259112 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259096.972297:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259096.972299:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734259096.972302:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259096.972304:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259096.972306:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:1.0:1734259096.972307:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:1.0:1734259096.972311:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098279296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259106 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259096.974254:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259096.974270:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c780 00000400:00000200:0.0:1734259096.974279:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d81 [1] + 0 00000400:00000200:0.0:1734259096.974290:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259096.974292:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259096.974301:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098279296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259106 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259096.974333:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259096.974336:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c700 00000400:00000200:0.0:1734259096.974340:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d79 [1] + 224 00000400:00000200:0.0:1734259096.974357:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259096.974360:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259096.974364:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098279168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259112 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259096.974369:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50370. 00000400:00000200:2.0:1734259096.974374:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:2.0:1734259096.974375:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:2.0:1734259096.974380:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098279296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259106 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259096.974387:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098279296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259106 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259096.974411:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734259096.974415:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259096.974419:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000400:00000010:3.0:1734259096.974630:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259096.974634:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259096.974636:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259096.974640:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098279168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259112 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259096.974646:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098279168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259112 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259096.974656:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259096.974659:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259096.974661:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:0.0:1734259101.979871:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734259101.979894:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734259101.979956:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734259101.979974:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734259101.980014:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734259101.980021:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50318. 00000400:00000010:0.0:1734259101.980028:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000100:00000200:0.0:1734259101.980035:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098279552, portal 10 00000400:00000010:0.0:1734259101.980042:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734259101.980044:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098279552, offset 0 00000400:00000200:0.0:1734259101.980054:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259101.980069:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259101.980075:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259101.980079:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259101.980082:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259101.980084:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259101.980088:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [915:915:256:4294967295] 192.168.202.108@tcp LPNI seq info [914:914:8:4294967295] 00000400:00000200:0.0:1734259101.980097:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259101.980103:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259101.980106:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734259101.980111:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259101.980122:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259101.980126:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734259101.980223:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0200. 00000400:00000010:1.0:1734259101.980228:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259101.980231:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259101.980234:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098279424, portal 25 00000400:00000010:1.0:1734259101.980237:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734259101.980239:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098279424, offset 0 00000400:00000200:1.0:1734259101.980244:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259101.980249:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:0.0:1734259101.980251:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:1.0:1734259101.980251:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259101.980254:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000010:0.0:1734259101.980255:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734259101.980256:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259101.980258:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259101.980258:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259101.980260:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [916:916:255:4294967295] 192.168.202.108@tcp LPNI seq info [915:915:7:4294967295] 00000400:00000200:0.0:1734259101.980262:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259101.980265:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:0.0:1734259101.980267:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000400:00000200:1.0:1734259101.980271:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:0.0:1734259101.980274:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098279552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259111 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259101.980275:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259101.980278:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734259101.980292:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259101.980296:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259101.980298:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259101.980317:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259101.980319:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734259101.980322:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259101.980325:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259101.980326:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:0.0:1734259101.980328:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:0.0:1734259101.980331:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098279424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259117 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259101.984795:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259101.984817:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c800 00000400:00000200:0.0:1734259101.984826:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d91 [1] + 224 00000400:00000200:0.0:1734259101.984840:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259101.984844:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259101.984855:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098279424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259117 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259101.984896:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259101.984900:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c880 00000400:00000200:0.0:1734259101.984904:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1d89 [1] + 0 00000400:00000200:0.0:1734259101.984923:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259101.984926:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259101.984931:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098279552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259111 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259101.985045:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50318. 00000400:00000200:2.0:1734259101.985052:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:2.0:1734259101.985055:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:2.0:1734259101.985061:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098279552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259111 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259101.985068:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098279552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259111 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259101.985104:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734259101.985113:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734259101.985118:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:1.0:1734259101.985186:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259101.985190:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259101.985192:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259101.985196:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098279424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259117 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259101.985206:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098279424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259117 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259101.985220:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0200. 02000000:00000010:1.0:1734259101.985224:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:1.0:1734259101.985226:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734259106.987779:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734259106.987804:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734259106.987872:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734259106.987880:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734259106.987971:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734259106.987986:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259106.987995:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259106.988004:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098279680, portal 25 00000400:00000010:1.0:1734259106.988009:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734259106.988011:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098279680, offset 0 00000400:00000200:1.0:1734259106.988021:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259106.988035:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259106.988040:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259106.988044:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259106.988048:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259106.988049:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259106.988052:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [917:917:256:4294967295] 192.168.202.108@tcp LPNI seq info [916:916:8:4294967295] 00000400:00000200:1.0:1734259106.988062:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:2.0:1734259106.988115:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259106.988120:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259106.988123:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259106.988126:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098279808, portal 10 00000400:00000010:2.0:1734259106.988130:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734259106.988144:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098279808, offset 0 00000400:00000200:2.0:1734259106.988148:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734259106.988753:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259106.988758:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734259106.988762:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259106.988771:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259106.988782:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259106.988851:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259106.988855:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259106.988857:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259106.988859:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259106.988861:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259106.988862:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [918:918:255:4294967295] 192.168.202.108@tcp LPNI seq info [917:917:7:4294967295] 00000400:00000200:2.0:1734259106.988869:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259106.988872:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259106.988875:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259106.988877:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259106.988880:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259106.988882:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259106.989311:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259106.989315:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734259106.989324:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259106.989329:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259106.989334:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:0.0:1734259106.989336:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734259106.989343:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098279680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259122 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259106.989412:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259106.989414:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259106.989417:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259106.989420:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259106.989422:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734259106.989423:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734259106.989426:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098279808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259116 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259106.994178:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259106.994199:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61c900 00000400:00000200:0.0:1734259106.994208:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1d99 [1] + 224 00000400:00000200:0.0:1734259106.996366:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259106.996379:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259106.996391:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098279680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259122 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259106.996440:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259106.996449:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61c980 00000400:00000200:0.0:1734259106.996456:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1da1 [1] + 0 00000400:00000200:0.0:1734259106.996473:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259106.996476:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259106.996481:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098279808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259116 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259106.996718:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259106.996723:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259106.996725:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259106.996730:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098279680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259122 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259106.996736:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098279680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259122 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259106.996756:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734259106.996761:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:1.0:1734259106.996765:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:2.0:1734259106.997233:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259106.997237:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259106.997239:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259106.997243:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098279808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259116 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259106.997250:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098279808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259116 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259106.997266:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259106.997270:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734259106.997272:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734259111.995737:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734259111.995776:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734259111.995843:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734259111.995849:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734259111.995931:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 02000000:00000010:2.0:1734259111.995932:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259111.995940:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:3.0:1734259111.995940:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259111.995947:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259111.995947:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259111.995954:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098280064, portal 10 00000100:00000200:3.0:1734259111.995956:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098279936, portal 25 00000400:00000010:2.0:1734259111.995960:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734259111.995960:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734259111.995961:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098279936, offset 0 00000100:00000200:2.0:1734259111.995962:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098280064, offset 0 00000400:00000200:3.0:1734259111.995971:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259111.995980:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259111.995984:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259111.995988:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259111.995996:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259111.995999:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259111.996001:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259111.996004:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [919:919:256:4294967295] 192.168.202.108@tcp LPNI seq info [918:918:8:4294967295] 00000400:00000200:3.0:1734259111.996011:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259111.996020:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259111.996022:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259111.996023:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000400:00000200:2.0:1734259111.996024:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259111.996026:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259111.996028:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259111.996028:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259111.996029:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259111.996031:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [920:920:255:4294967295] 192.168.202.108@tcp LPNI seq info [919:919:7:4294967295] 00000800:00000200:3.0:1734259111.996034:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259111.996037:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259111.996038:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259111.996040:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259111.996043:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259111.996045:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259111.996049:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259111.996051:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259111.996147:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259111.996150:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734259111.996156:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259111.996160:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259111.996164:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734259111.996166:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734259111.996173:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098279936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259127 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259111.996238:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259111.996239:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259111.996242:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259111.996245:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259111.996247:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:0.0:1734259111.996248:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734259111.996252:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098280064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259121 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259111.998392:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259111.998411:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ca00 00000400:00000200:0.0:1734259111.998419:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1dad [1] + 224 00000400:00000200:0.0:1734259111.998429:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259111.998433:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259111.998443:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098279936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259127 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259111.998486:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259111.998491:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ca80 00000400:00000200:0.0:1734259111.998496:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1da9 [1] + 0 00000400:00000200:0.0:1734259111.998516:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259111.998527:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259111.998532:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098280064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259121 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259111.998631:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259111.998638:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259111.998640:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259111.998645:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098279936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259127 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259111.998652:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000100:00000200:3.0:1734259111.998652:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098279936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259127 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734259111.998657:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259111.998659:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259111.998665:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098280064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259121 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259111.998672:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098280064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259121 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259111.998694:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259111.998701:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734259111.998706:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 02000000:00000010:3.0:1734259111.998768:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259111.998774:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734259111.998777:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734259117.003775:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734259117.003794:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 02000000:00000010:2.0:1734259117.003927:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734259117.003939:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259117.003947:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259117.003955:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098280192, portal 25 00000400:00000010:2.0:1734259117.003961:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259117.003963:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098280192, offset 0 00000400:00000200:2.0:1734259117.003973:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259117.004001:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259117.004007:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259117.004011:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259117.004014:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259117.004017:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259117.004020:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [921:921:256:4294967295] 192.168.202.108@tcp LPNI seq info [920:920:8:4294967295] 00000400:00000200:2.0:1734259117.004029:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259117.004035:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259117.004039:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259117.004045:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259117.004054:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259117.004059:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259117.004214:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259117.004217:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:2.0:1734259117.004222:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259117.004226:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259117.004230:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259117.004231:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259117.004238:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098280192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259133 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:0.0:1734259117.004284:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734259117.004291:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734259117.004366:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259117.004371:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259117.004377:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259117.004382:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098280320, portal 10 00000400:00000010:2.0:1734259117.004387:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734259117.004389:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098280320, offset 0 00000400:00000200:2.0:1734259117.004457:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259117.004469:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259117.004473:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259117.004476:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259117.004479:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259117.004493:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259117.004497:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [922:922:256:4294967295] 192.168.202.108@tcp LPNI seq info [921:921:8:4294967295] 00000400:00000200:2.0:1734259117.004504:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259117.004509:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259117.004511:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259117.004516:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259117.004523:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259117.004526:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259117.004661:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259117.004663:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259117.004666:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259117.004669:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259117.004671:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734259117.004672:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734259117.004678:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098280320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259127 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259117.006146:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259117.006162:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61cb00 00000400:00000200:0.0:1734259117.006169:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1db9 [1] + 224 00000400:00000200:0.0:1734259117.006186:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259117.006189:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259117.006196:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098280192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259133 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259117.006315:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259117.006319:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259117.006320:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259117.006324:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098280192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259133 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259117.006328:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098280192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259133 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259117.006345:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734259117.006347:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734259117.006349:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000200:0.0:1734259117.006517:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259117.006523:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61cb80 00000400:00000200:0.0:1734259117.006528:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1dc1 [1] + 0 00000400:00000200:0.0:1734259117.006538:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259117.006541:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259117.006546:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098280320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259127 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259117.006896:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259117.006899:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259117.006900:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259117.006904:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098280320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259127 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259117.006909:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098280320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259127 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259117.006923:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259117.006927:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734259117.006929:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734259122.011962:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734259122.011984:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 02000000:00000010:1.0:1734259122.012319:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734259122.012327:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259122.012334:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259122.012341:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098280448, portal 25 00000400:00000010:1.0:1734259122.012345:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259122.012347:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098280448, offset 0 00000400:00000200:1.0:1734259122.012356:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000010:0.0:1734259122.012393:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734259122.012410:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734259122.012506:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259122.012511:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000200:1.0:1734259122.012548:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259122.012554:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259122.012557:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259122.012560:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259122.012562:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259122.012565:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [923:923:256:4294967295] 192.168.202.108@tcp LPNI seq info [922:922:8:4294967295] 00000400:00000200:1.0:1734259122.012607:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259122.012613:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259122.012616:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734259122.012622:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259122.012629:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259122.012633:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734259122.012788:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259122.012792:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098280576, portal 10 00000400:00000010:2.0:1734259122.012797:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259122.012798:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098280576, offset 0 00000400:00000200:2.0:1734259122.012802:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259122.012817:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259122.012820:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259122.012822:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259122.012823:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259122.012825:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259122.012827:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [924:924:255:4294967295] 192.168.202.108@tcp LPNI seq info [923:923:7:4294967295] 00000400:00000200:2.0:1734259122.012833:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259122.012836:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259122.012839:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259122.012841:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259122.012844:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259122.012847:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259122.012971:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259122.012974:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734259122.012979:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259122.012983:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259122.012986:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:0.0:1734259122.012988:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:0.0:1734259122.012994:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098280448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259138 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259122.013230:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259122.013236:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259122.013242:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259122.013250:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259122.013255:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734259122.013257:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734259122.013264:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098280576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259132 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259122.015107:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259122.015124:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61cc00 00000400:00000200:0.0:1734259122.015131:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1dc9 [1] + 224 00000400:00000200:0.0:1734259122.015140:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259122.015143:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259122.015150:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098280448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259138 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259122.015225:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259122.015230:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259122.015232:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259122.015237:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098280448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259138 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259122.015243:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098280448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259138 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259122.015267:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734259122.015271:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734259122.015274:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734259122.015312:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259122.015317:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61cc80 00000400:00000200:0.0:1734259122.015337:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1dd1 [1] + 0 00000400:00000200:0.0:1734259122.015350:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259122.015353:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259122.015358:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098280576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259132 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259122.015440:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259122.015444:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259122.015445:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259122.015452:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098280576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259132 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259122.015459:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098280576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259132 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259122.015474:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259122.015478:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734259122.015481:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734259127.020150:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734259127.020179:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734259127.020257:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734259127.020264:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734259127.020310:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734259127.020323:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259127.020329:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259127.020337:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098280704, portal 25 00000400:00000010:3.0:1734259127.020342:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734259127.020344:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098280704, offset 0 00000400:00000200:3.0:1734259127.020355:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259127.020371:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259127.020378:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259127.020381:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259127.020385:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 02000000:00000010:2.0:1734259127.020400:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:3.0:1734259127.020401:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259127.020404:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [925:925:256:4294967295] 192.168.202.108@tcp LPNI seq info [924:924:8:4294967295] 00000400:00000010:2.0:1734259127.020405:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259127.020409:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000400:00000200:3.0:1734259127.020412:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:2.0:1734259127.020417:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098280832, portal 10 00000800:00000200:3.0:1734259127.020418:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259127.020422:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000800:00000010:3.0:1734259127.020422:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000100:00000200:2.0:1734259127.020424:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098280832, offset 0 00000400:00000200:2.0:1734259127.020428:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734259127.020428:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259127.020433:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259127.020435:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259127.020438:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734259127.020439:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259127.020440:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259127.020442:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259127.020443:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [926:926:255:4294967295] 192.168.202.108@tcp LPNI seq info [925:925:7:4294967295] 00000800:00000200:3.0:1734259127.020443:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259127.020448:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259127.020450:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259127.020454:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259127.020455:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259127.020458:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259127.020460:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259127.020529:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259127.020532:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734259127.020536:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259127.020541:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259127.020544:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734259127.020546:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734259127.021500:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098280704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259143 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259127.021741:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259127.021745:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259127.021749:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259127.021752:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259127.021755:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:0.0:1734259127.021757:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:0.0:1734259127.021762:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098280832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259137 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259127.023855:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259127.023877:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61cd80 00000400:00000200:0.0:1734259127.023886:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1de1 [1] + 0 00000400:00000200:0.0:1734259127.023900:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259127.023903:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259127.023928:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098280832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259137 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259127.023971:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259127.023976:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61cd00 00000400:00000200:0.0:1734259127.023981:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1dd9 [1] + 224 00000400:00000200:0.0:1734259127.023994:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259127.023998:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259127.024003:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098280704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259143 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259127.024030:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259127.024036:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259127.024038:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259127.024043:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098280832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259137 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259127.024051:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098280832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259137 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259127.024082:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259127.024089:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734259127.024094:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:3.0:1734259127.024167:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259127.024180:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259127.024424:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259127.024437:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098280704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259143 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259127.024446:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098280704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259143 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259127.024469:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259127.024476:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734259127.024481:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:2.0:1734259132.027846:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259132.027871:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259132.028002:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259132.028009:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259132.028051:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259132.028058:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259132.028064:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259132.028070:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098281088, portal 10 00000400:00000010:2.0:1734259132.028076:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734259132.028078:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098281088, offset 0 00000400:00000200:2.0:1734259132.028086:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259132.028099:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259132.028103:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259132.028107:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259132.028110:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259132.028112:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259132.028115:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [927:927:256:4294967295] 192.168.202.108@tcp LPNI seq info [926:926:8:4294967295] 00000400:00000200:2.0:1734259132.028123:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259132.028127:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259132.028131:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259132.028136:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259132.028142:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259132.028146:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259132.028222:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734259132.028226:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259132.028229:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259132.028232:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098280960, portal 25 00000400:00000010:3.0:1734259132.028234:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259132.028236:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098280960, offset 0 00000400:00000200:3.0:1734259132.028239:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259132.028243:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259132.028245:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259132.028247:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259132.028249:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259132.028250:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259132.028252:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [928:928:255:4294967295] 192.168.202.108@tcp LPNI seq info [927:927:7:4294967295] 00000400:00000200:3.0:1734259132.028262:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259132.028266:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259132.028268:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734259132.028271:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259132.028274:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259132.028276:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259132.028369:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259132.028372:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259132.028377:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259132.028381:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259132.028385:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734259132.028386:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734259132.028393:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098281088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259142 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259132.028529:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259132.028532:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734259132.028535:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259132.028538:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259132.028540:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:0.0:1734259132.028542:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:0.0:1734259132.028545:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098280960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259148 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259132.031610:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259132.031640:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ce80 00000400:00000200:0.0:1734259132.031648:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1de9 [1] + 0 00000400:00000200:0.0:1734259132.031672:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259132.031682:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259132.031698:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098281088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259142 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259132.032308:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259132.032313:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259132.032315:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259132.032319:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098281088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259142 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259132.032326:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098281088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259142 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259132.032350:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259132.032356:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259132.032359:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000400:00000200:0.0:1734259132.032648:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259132.032657:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ce00 00000400:00000200:0.0:1734259132.032663:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1df1 [1] + 224 00000400:00000200:0.0:1734259132.032677:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259132.032680:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259132.032687:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098280960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259132.032788:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259132.032793:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259132.032794:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259132.032798:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098280960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259148 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259132.032805:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098280960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259148 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259132.032815:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259132.032818:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734259132.032821:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734259137.035884:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259137.035920:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259137.035983:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259137.035990:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259137.036065:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259137.036072:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259137.036077:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259137.036083:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098281344, portal 10 00000400:00000010:3.0:1734259137.036087:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 02000000:00000010:0.0:1734259137.036088:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 00000100:00000200:3.0:1734259137.036089:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098281344, offset 0 00000400:00000010:0.0:1734259137.036093:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d502c0. 00000400:00000200:3.0:1734259137.036096:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:0.0:1734259137.036102:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734259137.036105:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098281216, portal 25 00000400:00000010:0.0:1734259137.036107:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000400:00000200:3.0:1734259137.036108:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:0.0:1734259137.036109:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098281216, offset 0 00000400:00000200:0.0:1734259137.036113:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259137.036113:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259137.036116:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259137.036119:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259137.036121:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259137.036124:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [929:929:256:4294967295] 192.168.202.108@tcp LPNI seq info [928:928:8:4294967295] 00000400:00000200:3.0:1734259137.036130:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259137.036140:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259137.036141:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259137.036143:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734259137.036143:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734259137.036146:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259137.036148:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259137.036148:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259137.036149:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259137.036151:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [930:930:255:4294967295] 192.168.202.108@tcp LPNI seq info [929:929:7:4294967295] 00000800:00000200:3.0:1734259137.036154:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734259137.036157:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259137.036157:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259137.036161:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259137.036163:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734259137.036166:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259137.036170:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259137.036172:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259137.036253:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259137.036256:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:1.0:1734259137.036260:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259137.036264:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259137.036268:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:1.0:1734259137.036269:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:1.0:1734259137.036276:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098281344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259147 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259137.036332:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259137.036334:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734259137.036337:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259137.036339:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259137.036341:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:1.0:1734259137.036342:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:1.0:1734259137.036345:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098281216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259153 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259137.038316:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259137.038332:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61cf80 00000400:00000200:0.0:1734259137.038339:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1df9 [1] + 0 00000400:00000200:0.0:1734259137.038358:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259137.038362:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259137.038371:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098281344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259147 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259137.038948:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259137.038953:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259137.038955:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259137.038960:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098281344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259147 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259137.038966:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098281344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259147 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259137.038994:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259137.038998:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259137.039002:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000200:0.0:1734259137.041268:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259137.041290:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61cf00 00000400:00000200:0.0:1734259137.041300:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e01 [1] + 224 00000400:00000200:0.0:1734259137.041325:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259137.041330:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259137.041342:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098281216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259137.041721:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d502c0. 00000400:00000200:2.0:1734259137.041726:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:2.0:1734259137.041729:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:2.0:1734259137.041734:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098281216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259153 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259137.041740:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098281216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259153 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259137.041766:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 02000000:00000010:2.0:1734259137.041773:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259137.041778:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259142.044029:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259142.044051:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259142.044129:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259142.044138:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259142.044166:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259142.044173:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259142.044179:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259142.044185:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098281600, portal 10 02000000:00000010:2.0:1734259142.044190:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:3.0:1734259142.044191:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734259142.044193:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098281600, offset 0 00000400:00000010:2.0:1734259142.044196:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000200:3.0:1734259142.044201:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259142.044213:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259142.044217:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259142.044220:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259142.044223:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259142.044225:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259142.044228:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [931:931:256:4294967295] 192.168.202.108@tcp LPNI seq info [930:930:8:4294967295] 00000400:00000200:3.0:1734259142.044235:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259142.044240:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259142.044264:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734259142.044269:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259142.044276:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259142.044279:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259142.044445:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259142.044449:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734259142.044453:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259142.044458:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259142.044565:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:2.0:1734259142.044588:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000400:00000010:0.0:1734259142.044589:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:2.0:1734259142.044596:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098281472, portal 25 00000100:00000200:0.0:1734259142.044597:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098281600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259152 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259142.044600:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734259142.044603:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098281472, offset 0 00000400:00000200:2.0:1734259142.044608:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259142.044616:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259142.044619:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259142.044622:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259142.044624:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259142.044626:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259142.044628:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [932:932:256:4294967295] 192.168.202.108@tcp LPNI seq info [931:931:8:4294967295] 00000400:00000200:2.0:1734259142.044635:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259142.044683:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259142.044687:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259142.044692:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259142.044697:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259142.044700:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259142.045814:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259142.045819:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259142.045825:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259142.045831:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259142.045836:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734259142.045837:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734259142.045846:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098281472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259158 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259142.046424:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259142.046441:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d080 00000400:00000200:0.0:1734259142.046453:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e09 [1] + 0 00000400:00000200:0.0:1734259142.046482:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259142.046487:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259142.046496:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098281600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259152 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259142.047089:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259142.047094:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259142.047096:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259142.047102:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098281600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259152 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259142.047109:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098281600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259152 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259142.047134:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259142.047139:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734259142.047144:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000400:00000200:0.0:1734259142.050897:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259142.050919:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d000 00000400:00000200:0.0:1734259142.050929:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e11 [1] + 224 00000400:00000200:0.0:1734259142.050956:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259142.050962:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259142.050974:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098281472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259158 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259142.053180:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259142.053192:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259142.053194:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259142.053206:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098281472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259158 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259142.053216:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098281472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259158 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259142.053240:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734259142.053247:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259142.053251:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259147.051741:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259147.051762:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259147.051818:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259147.051826:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259147.051863:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259147.051870:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259147.051875:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259147.051881:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098281856, portal 10 00000400:00000010:2.0:1734259147.051886:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734259147.051888:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098281856, offset 0 00000400:00000200:2.0:1734259147.051895:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259147.051905:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259147.051909:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259147.051913:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259147.051916:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259147.051918:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259147.051930:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [933:933:256:4294967295] 192.168.202.108@tcp LPNI seq info [932:932:8:4294967295] 00000400:00000200:2.0:1734259147.051938:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259147.051943:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259147.051947:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259147.051951:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259147.051957:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259147.051961:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259147.051988:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259147.051994:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259147.051997:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259147.051999:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098281728, portal 25 00000400:00000010:3.0:1734259147.052002:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734259147.052003:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098281728, offset 0 00000400:00000200:3.0:1734259147.052007:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259147.052011:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259147.052014:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259147.052016:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259147.052018:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259147.052019:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259147.052021:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [934:934:255:4294967295] 192.168.202.108@tcp LPNI seq info [933:933:7:4294967295] 00000400:00000200:3.0:1734259147.052027:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259147.052030:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259147.052032:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734259147.052040:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259147.052043:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259147.052045:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259147.052192:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259147.052196:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259147.052200:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259147.052204:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259147.052207:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734259147.052208:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734259147.052213:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098281856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259157 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259147.052249:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259147.052250:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734259147.052252:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259147.052255:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259147.052257:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734259147.052258:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734259147.052265:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098281728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259163 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259147.054465:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259147.054480:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d180 00000400:00000200:0.0:1734259147.054487:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e19 [1] + 0 00000400:00000200:0.0:1734259147.054496:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259147.054500:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259147.054508:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098281856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259157 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259147.054547:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259147.054552:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d100 00000400:00000200:0.0:1734259147.054556:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e21 [1] + 224 00000400:00000200:0.0:1734259147.054599:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259147.054603:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259147.054607:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098281728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259163 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259147.054707:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259147.054711:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259147.054713:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259147.054718:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098281856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259157 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259147.054724:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098281856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259157 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259147.054747:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259147.054752:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259147.054756:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000400:00000010:3.0:1734259147.054817:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259147.054821:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259147.054822:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259147.054827:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098281728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259163 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259147.054833:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098281728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259163 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259147.054842:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259147.054845:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259147.054848:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259152.059701:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259152.059721:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259152.060301:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259152.060310:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259152.060348:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259152.060355:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259152.060362:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259152.060368:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098282112, portal 10 00000400:00000010:2.0:1734259152.060374:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734259152.060376:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098282112, offset 0 00000400:00000200:2.0:1734259152.060385:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259152.060399:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259152.060405:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259152.060423:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259152.060426:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259152.060428:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259152.060431:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [935:935:256:4294967295] 192.168.202.108@tcp LPNI seq info [934:934:8:4294967295] 00000400:00000200:2.0:1734259152.060439:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259152.060444:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259152.060447:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259152.060453:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259152.060461:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259152.060465:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734259152.060624:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734259152.060629:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259152.060633:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259152.060635:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098281984, portal 25 00000400:00000010:1.0:1734259152.060638:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734259152.060639:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098281984, offset 0 00000400:00000200:1.0:1734259152.060649:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259152.060654:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259152.060656:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259152.060658:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259152.060659:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259152.060661:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259152.060663:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [936:936:255:4294967295] 192.168.202.108@tcp LPNI seq info [935:935:7:4294967295] 00000400:00000200:1.0:1734259152.060668:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259152.060671:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259152.060674:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734259152.060676:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259152.060679:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259152.060681:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259152.060940:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259152.060943:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259152.060947:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259152.060951:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259152.060955:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734259152.060956:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734259152.060962:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098282112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259162 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259152.061131:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259152.061134:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734259152.061136:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259152.061139:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259152.061141:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:0.0:1734259152.061147:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:0.0:1734259152.061151:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098281984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259168 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259152.063095:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259152.063114:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d200 00000400:00000200:0.0:1734259152.063123:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e31 [1] + 224 00000400:00000200:0.0:1734259152.063135:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259152.063139:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259152.063147:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098281984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259168 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259152.063187:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259152.063191:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d280 00000400:00000200:0.0:1734259152.063196:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e29 [1] + 0 00000400:00000200:0.0:1734259152.063210:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259152.063212:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259152.063217:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098282112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259162 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259152.063372:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259152.063376:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259152.063378:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259152.063383:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098281984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259168 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259152.063389:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098281984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259168 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259152.063408:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734259152.063412:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259152.063416:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000400:00000010:2.0:1734259152.063743:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259152.063748:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259152.063749:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259152.063754:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098282112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259162 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259152.063761:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098282112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259162 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259152.063777:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259152.063781:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259152.063783:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734259157.067717:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259157.067740:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259157.067805:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259157.067811:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734259157.067938:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734259157.067946:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259157.067953:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259157.067959:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098282240, portal 25 00000400:00000010:1.0:1734259157.067968:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734259157.067970:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098282240, offset 0 00000400:00000200:1.0:1734259157.067980:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259157.067993:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259157.068010:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259157.068014:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259157.068017:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259157.068019:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259157.068022:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [937:937:256:4294967295] 192.168.202.108@tcp LPNI seq info [936:936:8:4294967295] 00000400:00000200:1.0:1734259157.068030:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259157.068035:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259157.068038:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734259157.068044:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259157.068182:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259157.068186:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259157.068292:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259157.068294:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:1.0:1734259157.068297:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259157.068300:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259157.068304:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:1.0:1734259157.068305:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734259157.068311:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098282240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259173 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259157.068643:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259157.068649:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259157.068652:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259157.068655:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098282368, portal 10 00000400:00000010:3.0:1734259157.068660:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734259157.068661:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098282368, offset 0 00000400:00000200:3.0:1734259157.068665:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259157.068670:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259157.068673:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259157.068675:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259157.068677:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259157.068678:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259157.068681:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [938:938:256:4294967295] 192.168.202.108@tcp LPNI seq info [937:937:8:4294967295] 00000400:00000200:3.0:1734259157.068686:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259157.068690:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259157.068692:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734259157.068695:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259157.068721:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259157.068723:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259157.069142:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259157.069146:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734259157.069150:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259157.069153:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259157.069156:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734259157.069158:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734259157.069163:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098282368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259167 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259157.070277:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259157.070293:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d300 00000400:00000200:0.0:1734259157.070300:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e39 [1] + 224 00000400:00000200:0.0:1734259157.070320:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259157.070329:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259157.070339:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098282240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259173 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259157.070755:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259157.070761:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d380 00000400:00000200:0.0:1734259157.070767:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e41 [1] + 0 00000400:00000200:0.0:1734259157.070777:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259157.070780:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259157.070785:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098282368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259167 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259157.070867:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259157.070872:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259157.070874:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259157.070883:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098282368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259167 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259157.070885:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259157.070889:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259157.070891:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:3.0:1734259157.070895:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098282368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259167 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259157.070896:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098282240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259173 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259157.070904:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098282240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259173 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259157.070921:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:3.0:1734259157.070921:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:1.0:1734259157.070926:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 02000000:00000010:3.0:1734259157.070926:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259157.070929:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:3.0:1734259157.070930:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734259162.075714:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259162.075735:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259162.075796:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259162.075809:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259162.075817:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734259162.075839:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259162.075846:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259162.075851:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098282496, portal 25 00000400:00000010:1.0:1734259162.075855:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734259162.075857:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098282496, offset 0 00000400:00000200:1.0:1734259162.075867:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734259162.075870:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259162.075876:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259162.075879:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000200:1.0:1734259162.075880:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:3.0:1734259162.075882:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098282624, portal 10 00000400:00000200:1.0:1734259162.075886:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734259162.075887:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734259162.075888:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098282624, offset 0 00000400:00000200:1.0:1734259162.075889:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259162.075892:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259162.075893:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259162.075894:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259162.075897:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [939:939:256:4294967295] 192.168.202.108@tcp LPNI seq info [938:938:8:4294967295] 00000400:00000200:1.0:1734259162.075905:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259162.075909:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259162.075910:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259162.075912:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000400:00000200:3.0:1734259162.075912:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259162.075915:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734259162.075917:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259162.075917:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259162.075919:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259162.075921:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [940:940:255:4294967295] 192.168.202.108@tcp LPNI seq info [939:939:7:4294967295] 00000800:00000200:1.0:1734259162.075926:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259162.075928:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259162.075929:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734259162.075931:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259162.075933:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734259162.075936:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259162.075940:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259162.075946:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259162.076049:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259162.076052:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734259162.076057:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259162.076062:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259162.076066:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:0.0:1734259162.076067:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:0.0:1734259162.076074:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098282496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259178 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259162.076143:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259162.076145:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734259162.076147:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259162.076149:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259162.076151:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734259162.076152:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734259162.076155:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098282624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259172 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259162.080347:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259162.080363:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d480 00000400:00000200:0.0:1734259162.080371:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e51 [1] + 0 00000400:00000200:0.0:1734259162.080380:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259162.080392:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259162.080403:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098282624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259172 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259162.080437:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259162.080440:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d400 00000400:00000200:0.0:1734259162.080444:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e49 [1] + 224 00000400:00000200:0.0:1734259162.080453:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259162.080455:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259162.080458:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098282496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259162.080618:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259162.080623:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259162.080625:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259162.080630:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098282624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259172 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259162.080632:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259162.080635:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000100:00000200:3.0:1734259162.080635:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098282624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259172 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259162.080636:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259162.080640:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098282496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259178 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259162.080644:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098282496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259178 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259162.080660:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:3.0:1734259162.080660:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:1.0:1734259162.080663:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 02000000:00000010:3.0:1734259162.080663:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259162.080666:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:3.0:1734259162.080666:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734259167.083688:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259167.083708:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259167.083773:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259167.083780:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259167.083787:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734259167.083794:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259167.083800:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 02000000:00000010:3.0:1734259167.083806:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000100:00000200:1.0:1734259167.083809:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098282752, portal 25 00000400:00000010:3.0:1734259167.083811:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:1.0:1734259167.083813:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734259167.083814:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098282752, offset 0 00000400:00000010:3.0:1734259167.083815:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259167.083817:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098282880, portal 10 00000400:00000200:1.0:1734259167.083821:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734259167.083821:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734259167.083824:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098282880, offset 0 00000400:00000200:3.0:1734259167.083828:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259167.083830:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259167.083834:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259167.083837:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259167.083840:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259167.083841:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259167.083844:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [941:941:256:4294967295] 192.168.202.108@tcp LPNI seq info [940:940:8:4294967295] 00000400:00000200:1.0:1734259167.083852:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259167.083856:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259167.083857:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259167.083859:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000400:00000200:3.0:1734259167.083859:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259167.083861:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259167.083863:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734259167.083864:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259167.083865:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259167.083867:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [942:942:255:4294967295] 192.168.202.108@tcp LPNI seq info [941:941:7:4294967295] 00000800:00000200:1.0:1734259167.083872:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259167.083873:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259167.083875:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734259167.083877:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259167.083879:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734259167.083882:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259167.083885:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259167.083887:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259167.084145:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259167.084148:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734259167.084152:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259167.084156:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259167.084159:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:0.0:1734259167.084160:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:0.0:1734259167.084167:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098282752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259183 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259167.084357:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259167.084360:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734259167.084362:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259167.084365:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259167.084367:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734259167.084368:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734259167.084372:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098282880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259177 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259167.086809:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259167.086824:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d500 00000400:00000200:0.0:1734259167.086833:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e59 [1] + 224 00000400:00000200:0.0:1734259167.086842:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259167.086855:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259167.086864:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098282752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259167.086902:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259167.086907:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d580 00000400:00000200:0.0:1734259167.086912:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e61 [1] + 0 00000400:00000200:0.0:1734259167.086926:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259167.086929:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259167.086934:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098282880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259177 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259167.087124:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259167.087128:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259167.087130:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259167.087135:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098282752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259183 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259167.087141:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098282752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259183 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259167.087165:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734259167.087169:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:1.0:1734259167.087199:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000400:00000010:3.0:1734259167.087209:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259167.087213:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259167.087214:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259167.087218:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098282880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259177 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259167.087223:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098282880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259177 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259167.087245:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259167.087248:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259167.087251:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259172.091672:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259172.091691:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259172.091745:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259172.091751:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259172.091794:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259172.091797:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:2.0:1734259172.091800:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:3.0:1734259172.091803:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259172.091805:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000400:00000010:3.0:1734259172.091806:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259172.091810:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098283008, portal 25 00000400:00000010:3.0:1734259172.091814:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:2.0:1734259172.091815:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098283136, portal 10 00000100:00000200:3.0:1734259172.091816:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098283008, offset 0 00000400:00000010:2.0:1734259172.091820:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000400:00000200:3.0:1734259172.091823:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259172.091826:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098283136, offset 0 00000400:00000200:2.0:1734259172.091831:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259172.091833:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259172.091837:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259172.091840:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259172.091843:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259172.091845:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259172.091847:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [943:943:256:4294967295] 192.168.202.108@tcp LPNI seq info [942:942:8:4294967295] 00000400:00000200:3.0:1734259172.091854:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:2.0:1734259172.091860:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734259172.091860:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259172.091863:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734259172.091863:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000400:00000200:2.0:1734259172.091864:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259172.091866:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259172.091867:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259172.091868:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259172.091869:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [944:944:255:4294967295] 192.168.202.108@tcp LPNI seq info [943:943:7:4294967295] 00000800:00000200:3.0:1734259172.091874:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259172.091875:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259172.091877:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259172.091878:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259172.091881:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259172.091884:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259172.091887:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259172.091888:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259172.091971:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259172.091973:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734259172.091977:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259172.091979:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259172.091982:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734259172.091983:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734259172.091988:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098283008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259188 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259172.092047:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259172.092049:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259172.092052:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259172.092054:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259172.092056:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734259172.092057:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734259172.092060:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098283136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259182 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259172.093883:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259172.093895:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d600 00000400:00000200:0.0:1734259172.093901:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e69 [1] + 224 00000400:00000200:0.0:1734259172.093920:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259172.093929:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259172.093936:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098283008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259172.094215:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259172.094224:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259172.094225:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259172.094230:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098283008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259188 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259172.094236:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098283008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259188 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259172.094254:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259172.094259:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259172.094262:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000400:00000200:0.0:1734259172.094487:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259172.094493:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d680 00000400:00000200:0.0:1734259172.094498:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e6d [1] + 0 00000400:00000200:0.0:1734259172.094508:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259172.094511:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259172.094516:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098283136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259182 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259172.096238:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259172.096246:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259172.096247:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259172.096254:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098283136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259182 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259172.096261:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098283136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259182 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259172.096289:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259172.096294:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259172.096297:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:3.0:1734259177.099722:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734259177.099743:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dba00. 00000100:00000010:3.0:1734259177.099854:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734259177.099861:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806400. 02000000:00000010:1.0:1734259177.099938:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734259177.099946:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259177.099953:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259177.099959:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098283264, portal 25 02000000:00000010:2.0:1734259177.099965:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259177.099970:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:1.0:1734259177.099972:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:2.0:1734259177.099974:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259177.099978:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098283392, portal 10 00000400:00000010:2.0:1734259177.099982:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734259177.099983:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098283392, offset 0 00000100:00000200:1.0:1734259177.099984:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098283264, offset 0 00000400:00000200:2.0:1734259177.099991:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259177.100000:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259177.100009:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259177.100015:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259177.100018:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259177.100022:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259177.100024:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259177.100027:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [945:945:256:4294967295] 192.168.202.108@tcp LPNI seq info [944:944:8:4294967295] 00000400:00000200:2.0:1734259177.100034:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259177.100039:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259177.100040:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259177.100042:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734259177.100043:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734259177.100044:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259177.100046:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259177.100048:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734259177.100048:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259177.100050:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [946:946:255:4294967295] 192.168.202.108@tcp LPNI seq info [945:945:7:4294967295] 00000800:00000200:2.0:1734259177.100055:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734259177.100057:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259177.100059:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259177.100060:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259177.100063:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734259177.100065:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259177.100069:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259177.100072:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259177.100156:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259177.100160:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259177.100164:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259177.100169:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259177.100173:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734259177.100174:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734259177.100182:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098283392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259187 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259177.100254:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259177.100256:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734259177.100258:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259177.100261:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259177.100263:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:0.0:1734259177.100264:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:0.0:1734259177.100267:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098283264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259193 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259177.108039:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259177.108838:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d780 00000400:00000200:0.0:1734259177.108848:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e7d [1] + 0 00000400:00000200:0.0:1734259177.108864:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259177.108880:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259177.108892:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098283392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259187 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259177.108935:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259177.108940:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d700 00000400:00000200:0.0:1734259177.108945:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e79 [1] + 224 00000400:00000200:0.0:1734259177.108956:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259177.108958:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259177.108963:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098283264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259193 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259177.109040:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259177.109046:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259177.109048:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259177.109055:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098283264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259193 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259177.109062:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098283264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259193 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259177.109093:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734259177.109099:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dba00. 00000100:00000010:1.0:1734259177.109104:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:2.0:1734259177.109794:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259177.109800:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259177.109801:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259177.109807:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098283392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259187 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259177.109813:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098283392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259187 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259177.109843:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259177.109848:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806400. 00000100:00000010:2.0:1734259177.109850:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734259182.108655:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734259182.108677:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db100. 02000000:00000010:1.0:1734259182.108997:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000100:00000010:3.0:1734259182.109003:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 00000400:00000010:1.0:1734259182.109005:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 02000000:00000010:3.0:1734259182.109010:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:1.0:1734259182.109011:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259182.109017:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098283520, portal 25 00000400:00000010:1.0:1734259182.109021:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734259182.109023:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098283520, offset 0 00000400:00000200:1.0:1734259182.109031:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259182.109052:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259182.109056:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259182.109060:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259182.109063:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259182.109065:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259182.109068:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [947:947:256:4294967295] 192.168.202.108@tcp LPNI seq info [946:946:8:4294967295] 00000400:00000200:1.0:1734259182.109075:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259182.109080:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259182.109083:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734259182.109088:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:2.0:1734259182.109092:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000800:00000200:1.0:1734259182.109095:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:2.0:1734259182.109097:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000800:00000200:1.0:1734259182.109099:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734259182.109100:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259182.109102:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098283648, portal 10 00000400:00000010:2.0:1734259182.109106:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734259182.109108:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098283648, offset 0 00000400:00000200:2.0:1734259182.109111:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259182.109115:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259182.109118:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259182.109119:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259182.109121:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259182.109122:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259182.109124:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [948:948:255:4294967295] 192.168.202.108@tcp LPNI seq info [947:947:7:4294967295] 00000400:00000200:2.0:1734259182.109129:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259182.109132:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259182.109135:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259182.109137:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259182.109140:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259182.109141:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259182.109156:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259182.109158:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:1.0:1734259182.109162:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259182.109166:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259182.109169:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:1.0:1734259182.109170:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734259182.109176:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098283520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259198 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259182.109237:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259182.109239:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734259182.109241:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259182.109244:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259182.109246:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:1.0:1734259182.109247:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:1.0:1734259182.109250:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098283648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259192 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259182.113776:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259182.113799:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d800 00000400:00000200:0.0:1734259182.113808:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e89 [1] + 224 00000400:00000200:0.0:1734259182.113821:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259182.113826:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259182.113838:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098283520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259182.113898:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259182.113904:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d880 00000400:00000200:0.0:1734259182.113910:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e91 [1] + 0 00000400:00000200:0.0:1734259182.113934:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259182.113939:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259182.113945:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098283648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259192 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259182.114088:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259182.114095:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259182.114097:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259182.114104:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098283648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259192 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259182.114111:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098283648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259192 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259182.114156:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259182.114163:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:2.0:1734259182.114168:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:1.0:1734259182.114271:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259182.114276:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259182.114278:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259182.114293:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098283520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259198 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259182.114300:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098283520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259198 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259182.114318:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734259182.114323:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db100. 00000100:00000010:1.0:1734259182.114325:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734259187.115740:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734259187.115768:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db500. 00000100:00000010:3.0:1734259187.115825:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734259187.115831:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:1.0:1734259187.115850:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734259187.115857:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 02000000:00000010:2.0:1734259187.115857:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259187.115862:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:1.0:1734259187.115863:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000010:2.0:1734259187.115866:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:1.0:1734259187.115870:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098283776, portal 25 00000100:00000200:2.0:1734259187.115870:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098283904, portal 10 00000400:00000010:1.0:1734259187.115874:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000400:00000010:2.0:1734259187.115874:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:1.0:1734259187.115876:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098283776, offset 0 00000100:00000200:2.0:1734259187.115876:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098283904, offset 0 00000400:00000200:1.0:1734259187.115883:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259187.115888:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259187.115893:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259187.115898:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259187.115902:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259187.115905:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259187.115907:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259187.115910:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [949:949:256:4294967295] 192.168.202.108@tcp LPNI seq info [948:948:8:4294967295] 00000400:00000200:1.0:1734259187.115917:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259187.115921:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259187.115923:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259187.115925:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000400:00000200:2.0:1734259187.115925:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259187.115927:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734259187.115929:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259187.115929:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259187.115931:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259187.115933:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [950:950:255:4294967295] 192.168.202.108@tcp LPNI seq info [949:949:7:4294967295] 00000800:00000200:1.0:1734259187.115936:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259187.115938:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259187.115940:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259187.115942:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259187.115945:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259187.115948:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259187.115951:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259187.115953:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259187.116038:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259187.116042:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734259187.116046:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259187.116050:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259187.116064:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734259187.116066:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734259187.116072:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098283776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259203 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259187.116129:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259187.116130:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259187.116133:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259187.116136:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259187.116137:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734259187.116139:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734259187.116141:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098283904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259197 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259187.118297:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259187.118345:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61d900 00000400:00000200:0.0:1734259187.118354:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1e99 [1] + 224 00000400:00000200:0.0:1734259187.118365:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259187.118368:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259187.118377:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098283776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259203 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259187.118416:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259187.118421:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61d980 00000400:00000200:0.0:1734259187.118425:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1e9d [1] + 0 00000400:00000200:0.0:1734259187.118439:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259187.118442:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259187.118448:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098283904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259197 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259187.118543:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259187.118548:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259187.118550:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259187.118555:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098283776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259203 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259187.118612:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098283776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259203 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259187.118635:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734259187.118641:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db500. 00000100:00000010:1.0:1734259187.118645:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:2.0:1734259187.118842:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259187.118845:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259187.118846:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259187.118851:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098283904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259197 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259187.118856:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098283904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259197 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259187.118881:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259187.118885:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:2.0:1734259187.118887:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734259192.123691:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734259192.123711:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbe00. 00000100:00000010:3.0:1734259192.123761:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734259192.123767:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:2.0:1734259192.123796:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 02000000:00000010:3.0:1734259192.123797:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:2.0:1734259192.123803:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:3.0:1734259192.123803:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259192.123809:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000400:00000010:3.0:1734259192.123809:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259192.123814:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098284160, portal 10 00000400:00000010:3.0:1734259192.123819:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:2.0:1734259192.123824:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098284032, portal 25 00000400:00000010:2.0:1734259192.123828:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734259192.123830:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098284032, offset 0 00000400:00000200:2.0:1734259192.123838:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259192.123848:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259192.123853:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259192.123856:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259192.123859:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259192.123860:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259192.123863:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [951:951:256:4294967295] 192.168.202.108@tcp LPNI seq info [950:950:8:4294967295] 00000400:00000200:2.0:1734259192.123870:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259192.123875:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259192.123878:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259192.123883:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:3.0:1734259192.123889:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098284160, offset 0 00000800:00000200:2.0:1734259192.123890:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259192.123893:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734259192.123904:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259192.123908:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259192.123910:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259192.123912:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259192.123914:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259192.123916:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259192.123918:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [952:952:255:4294967295] 192.168.202.108@tcp LPNI seq info [951:951:7:4294967295] 00000400:00000200:3.0:1734259192.123923:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259192.123926:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259192.123928:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734259192.123931:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259192.123934:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259192.123936:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259192.124006:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259192.124009:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259192.124013:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259192.124021:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259192.124025:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734259192.124026:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734259192.124032:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098284032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259208 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259192.124087:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259192.124090:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734259192.124092:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259192.124094:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259192.124096:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734259192.124097:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734259192.124100:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098284160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259202 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259192.126940:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259192.126958:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61da80 00000400:00000200:0.0:1734259192.126965:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ea9 [1] + 0 00000400:00000200:0.0:1734259192.126975:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259192.126979:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259192.126987:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098284160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259202 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259192.127025:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259192.127030:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61da00 00000400:00000200:0.0:1734259192.127034:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ead [1] + 224 00000400:00000200:0.0:1734259192.127050:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259192.127053:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259192.127057:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098284032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259208 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259192.127120:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259192.127125:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259192.127127:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259192.127136:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098284032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259208 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259192.127143:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098284032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259208 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259192.127175:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734259192.127179:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbe00. 00000100:00000010:2.0:1734259192.127182:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:3.0:1734259192.127279:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259192.127283:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259192.127284:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259192.127289:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098284160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259202 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259192.127294:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098284160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259202 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259192.127313:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734259192.127317:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:3.0:1734259192.127319:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734259197.131699:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734259197.131722:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db000. 00000100:00000010:3.0:1734259197.131779:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734259197.131784:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:0.0:1734259197.131873:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3be00. 00000400:00000010:0.0:1734259197.131882:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50268. 00000400:00000010:0.0:1734259197.131902:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000100:00000200:0.0:1734259197.131909:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098284288, portal 25 00000400:00000010:0.0:1734259197.131914:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734259197.131916:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098284288, offset 0 00000400:00000200:0.0:1734259197.131933:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259197.131947:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259197.131952:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259197.131956:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259197.131959:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259197.131961:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259197.131963:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [953:953:256:4294967295] 192.168.202.108@tcp LPNI seq info [952:952:8:4294967295] 00000400:00000200:0.0:1734259197.131971:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259197.131976:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259197.131980:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734259197.131986:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259197.131994:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259197.131998:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259197.132091:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259197.132096:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259197.132100:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259197.132102:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098284416, portal 10 00000400:00000010:2.0:1734259197.132107:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734259197.132108:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098284416, offset 0 00000400:00000200:2.0:1734259197.132113:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259197.132117:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259197.132120:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259197.132122:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259197.132123:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259197.132125:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259197.132127:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [954:954:255:4294967295] 192.168.202.108@tcp LPNI seq info [953:953:7:4294967295] 00000400:00000200:2.0:1734259197.132133:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259197.132136:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259197.132139:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259197.132142:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259197.132146:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259197.132147:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259197.132268:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259197.132275:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:1.0:1734259197.132282:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259197.132289:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259197.132295:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:1.0:1734259197.132296:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:1.0:1734259197.132306:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098284288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259213 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259197.132390:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259197.132392:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734259197.132395:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259197.132398:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259197.132400:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:1.0:1734259197.132401:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:1.0:1734259197.132405:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098284416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259207 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259197.134502:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259197.134521:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61db80 00000400:00000200:0.0:1734259197.134530:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ec1 [1] + 0 00000400:00000200:0.0:1734259197.134540:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259197.134544:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259197.134554:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098284416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259207 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259197.134618:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259197.134623:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61db00 00000400:00000200:0.0:1734259197.134627:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1eb9 [1] + 224 00000400:00000200:0.0:1734259197.134641:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259197.134645:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259197.134657:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098284288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259213 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259197.134706:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259197.134710:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259197.134712:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259197.134720:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098284416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259207 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259197.134725:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098284416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259207 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259197.134888:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259197.134894:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:2.0:1734259197.134897:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:1.0:1734259197.134941:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50268. 00000400:00000200:1.0:1734259197.134949:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:1.0:1734259197.135015:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:1.0:1734259197.135022:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098284288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259213 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259197.135026:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098284288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259213 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259197.135036:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3be00. 02000000:00000010:1.0:1734259197.135038:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db000. 00000100:00000010:1.0:1734259197.135044:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734259202.139913:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734259202.139940:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db600. 00000100:00000010:3.0:1734259202.140008:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734259202.140029:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:1.0:1734259202.140138:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 02000000:00000010:2.0:1734259202.140180:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259202.140215:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259202.140223:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259202.140231:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098284672, portal 10 00000400:00000010:2.0:1734259202.140239:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734259202.140241:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098284672, offset 0 00000400:00000200:2.0:1734259202.140250:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259202.140266:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259202.140272:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259202.140275:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259202.140280:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259202.140282:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259202.140285:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [955:955:256:4294967295] 192.168.202.108@tcp LPNI seq info [954:954:8:4294967295] 00000400:00000200:2.0:1734259202.140294:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259202.140299:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259202.140304:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259202.140310:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259202.140319:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259202.140322:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000400:00000010:1.0:1734259202.140373:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259202.140376:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259202.140379:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098284544, portal 25 00000400:00000010:1.0:1734259202.140381:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734259202.140382:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098284544, offset 0 00000400:00000200:1.0:1734259202.140386:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259202.140390:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259202.140392:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259202.140394:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259202.140395:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259202.140397:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259202.140399:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [956:956:255:4294967295] 192.168.202.108@tcp LPNI seq info [955:955:7:4294967295] 00000400:00000200:1.0:1734259202.140404:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259202.140407:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259202.140409:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734259202.140411:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259202.140414:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259202.140415:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259202.140465:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259202.140469:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259202.140473:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259202.140477:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259202.140482:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734259202.140483:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734259202.140491:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098284672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259212 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259202.140519:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259202.140521:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734259202.140523:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259202.140525:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259202.140527:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734259202.140528:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734259202.140537:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098284544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259218 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259202.143940:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259202.143968:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61dc00 00000400:00000200:0.0:1734259202.143980:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ed1 [1] + 224 00000400:00000200:0.0:1734259202.143998:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259202.144002:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259202.144018:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098284544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259218 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259202.144064:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259202.144068:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61dc80 00000400:00000200:0.0:1734259202.144074:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ec9 [1] + 0 00000400:00000200:0.0:1734259202.144099:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259202.144102:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259202.144119:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098284672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259212 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259202.144168:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259202.144174:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259202.144176:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259202.144183:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098284544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259218 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259202.144185:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259202.144201:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000100:00000200:1.0:1734259202.144203:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098284544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259218 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259202.144203:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259202.144209:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098284672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259212 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259202.144216:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098284672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259212 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259202.144234:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259202.144242:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db600. 00000100:00000010:1.0:1734259202.144248:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 02000000:00000010:2.0:1734259202.144249:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259202.144255:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:2.0:1734259202.144259:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734259207.147762:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734259207.147782:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db700. 02000000:00000010:1.0:1734259207.147886:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734259207.147894:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259207.147901:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259207.147908:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098284800, portal 25 00000400:00000010:1.0:1734259207.147912:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734259207.147913:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098284800, offset 0 00000400:00000200:1.0:1734259207.147922:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259207.147935:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259207.147941:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259207.147945:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259207.147948:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259207.147950:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259207.147953:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [957:957:256:4294967295] 192.168.202.108@tcp LPNI seq info [956:956:8:4294967295] 00000400:00000200:1.0:1734259207.147960:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259207.147964:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259207.147967:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734259207.147972:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259207.147980:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259207.147983:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:3.0:1734259207.148023:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734259207.148031:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806400. 02000000:00000010:2.0:1734259207.148177:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259207.148182:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259207.148184:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259207.148187:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098284928, portal 10 00000400:00000010:2.0:1734259207.148191:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734259207.148192:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098284928, offset 0 00000400:00000200:2.0:1734259207.148196:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259207.148200:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259207.148202:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259207.148204:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259207.148206:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259207.148207:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259207.148210:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [958:958:255:4294967295] 192.168.202.108@tcp LPNI seq info [957:957:7:4294967295] 00000400:00000200:2.0:1734259207.148215:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259207.148218:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259207.148220:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259207.148222:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259207.148225:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259207.148227:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259207.148263:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259207.148266:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734259207.148270:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259207.148274:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259207.148278:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:0.0:1734259207.148279:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:0.0:1734259207.148286:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098284800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259223 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259207.148322:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259207.148324:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259207.148326:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259207.148329:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259207.148331:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:0.0:1734259207.148332:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734259207.148335:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098284928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259217 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259207.150720:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259207.150735:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61dd00 00000400:00000200:0.0:1734259207.150742:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ed9 [1] + 224 00000400:00000200:0.0:1734259207.150753:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259207.150756:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259207.150765:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098284800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259223 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259207.150801:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259207.150805:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61dd80 00000400:00000200:0.0:1734259207.150810:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ee1 [1] + 0 00000400:00000200:0.0:1734259207.150826:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259207.150835:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259207.150840:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098284928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259217 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259207.150932:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259207.150937:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259207.150939:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259207.150944:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098284800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259223 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259207.150950:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098284800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259223 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259207.150969:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259207.150973:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db700. 00000100:00000010:1.0:1734259207.150977:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:2.0:1734259207.151462:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259207.151468:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259207.151469:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259207.151474:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098284928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259217 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259207.151482:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098284928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259217 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734259207.151566:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:2.0:1734259207.158968:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259207.158982:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806400. 00000100:00000010:2.0:1734259207.158992:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734259212.155841:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734259212.155862:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db700. 00000100:00000010:3.0:1734259212.155908:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734259212.155912:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806400. 02000000:00000010:2.0:1734259212.155939:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 02000000:00000010:3.0:1734259212.155941:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:2.0:1734259212.155947:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:3.0:1734259212.155947:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259212.155953:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000400:00000010:3.0:1734259212.155953:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259212.155959:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098285184, portal 10 00000400:00000010:3.0:1734259212.155964:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:2.0:1734259212.155965:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098285056, portal 25 00000100:00000200:3.0:1734259212.155966:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098285184, offset 0 00000400:00000010:2.0:1734259212.155968:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000400:00000200:3.0:1734259212.155973:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259212.155977:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098285056, offset 0 00000400:00000200:2.0:1734259212.155982:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259212.155985:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259212.155989:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259212.155994:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259212.156007:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259212.156010:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259212.156012:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [959:959:256:4294967295] 192.168.202.108@tcp LPNI seq info [958:958:8:4294967295] 00000400:00000200:3.0:1734259212.156020:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259212.156027:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259212.156028:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259212.156030:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734259212.156031:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000400:00000200:2.0:1734259212.156032:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259212.156034:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259212.156035:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259212.156036:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259212.156038:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [960:960:255:4294967295] 192.168.202.108@tcp LPNI seq info [959:959:7:4294967295] 00000800:00000200:3.0:1734259212.156041:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259212.156044:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259212.156044:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259212.156047:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259212.156050:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259212.156053:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259212.156056:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259212.156058:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259212.156138:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259212.156141:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734259212.156145:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259212.156149:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259212.156153:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734259212.156154:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734259212.156160:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098285184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259222 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259212.156220:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259212.156221:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259212.156224:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259212.156226:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259212.156228:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734259212.156229:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734259212.156232:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098285056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259228 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259212.157505:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259212.157518:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61de80 00000400:00000200:0.0:1734259212.157524:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1ee9 [1] + 0 00000400:00000200:0.0:1734259212.157532:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259212.157535:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259212.157541:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098285184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259222 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259212.157566:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259212.157587:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61de00 00000400:00000200:0.0:1734259212.157591:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1eed [1] + 224 00000400:00000200:0.0:1734259212.157603:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:3.0:1734259212.157604:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259212.157609:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000200:0.0:1734259212.157611:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:3.0:1734259212.157615:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734259212.157620:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098285056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259228 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259212.157620:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098285184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259222 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259212.157627:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098285184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259222 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259212.157653:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734259212.157657:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806400. 00000100:00000010:3.0:1734259212.157659:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:2.0:1734259212.157886:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259212.157890:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259212.157891:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259212.157895:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098285056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259228 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259212.157901:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098285056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259228 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259212.157916:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734259212.157918:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db700. 00000100:00000010:2.0:1734259212.157920:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:1.0:1734259217.163805:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b24000. 02000000:00000010:1.0:1734259217.163827:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021d00. 00000100:00000010:1.0:1734259217.163963:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b24380. 02000000:00000010:1.0:1734259217.163970:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0ac00. 02000000:00000010:2.0:1734259217.164554:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734259217.164561:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259217.164593:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259217.164600:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098285312, portal 25 00000400:00000010:2.0:1734259217.164603:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734259217.164605:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098285312, offset 0 00000400:00000200:2.0:1734259217.164612:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259217.164622:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259217.164626:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259217.164629:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259217.164631:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259217.164633:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259217.164635:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [961:961:256:4294967295] 192.168.202.108@tcp LPNI seq info [960:960:8:4294967295] 00000400:00000200:2.0:1734259217.164642:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259217.164646:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259217.164649:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259217.164654:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259217.164660:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259217.164662:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259217.164865:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259217.164867:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259217.164870:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259217.164873:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259217.164876:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734259217.164877:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734259217.164883:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b24000 x1818500098285312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259233 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259217.165060:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259217.165065:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259217.165068:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259217.165071:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098285440, portal 10 00000400:00000010:3.0:1734259217.165086:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734259217.165088:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098285440, offset 0 00000400:00000200:3.0:1734259217.165091:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259217.165095:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259217.165098:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259217.165100:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259217.165101:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259217.165103:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259217.165188:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [962:962:256:4294967295] 192.168.202.108@tcp LPNI seq info [961:961:8:4294967295] 00000400:00000200:3.0:1734259217.165194:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259217.165197:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259217.165199:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734259217.165203:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259217.165206:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259217.165208:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259217.165697:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259217.165700:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734259217.165703:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259217.165706:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259217.165709:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734259217.165710:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734259217.165714:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b24380 x1818500098285440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259227 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259217.166489:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259217.166499:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61df00 00000400:00000200:0.0:1734259217.166505:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ef9 [1] + 224 00000400:00000200:0.0:1734259217.166522:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259217.166525:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259217.166532:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b24000 x1818500098285312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259233 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259217.166685:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259217.166690:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259217.166691:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259217.166695:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b24000 x1818500098285312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259233 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259217.166702:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b24000 x1818500098285312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259233 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259217.166726:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734259217.166741:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021d00. 00000100:00000010:2.0:1734259217.166745:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b24000. 00000400:00000200:0.0:1734259217.167003:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259217.167010:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61df80 00000400:00000200:0.0:1734259217.167014:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f01 [1] + 0 00000400:00000200:0.0:1734259217.167025:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259217.167036:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259217.167041:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b24380 x1818500098285440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259227 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259217.167113:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259217.167117:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259217.167118:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259217.167122:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b24380 x1818500098285440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259227 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259217.167133:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b24380 x1818500098285440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259227 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259217.167147:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259217.167149:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0ac00. 00000100:00000010:3.0:1734259217.167152:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b24380. 00000100:00000010:1.0:1734259222.171754:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b24700. 02000000:00000010:1.0:1734259222.171780:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021900. 02000000:00000010:2.0:1734259222.173396:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000100:00000010:1.0:1734259222.173405:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b24a80. 00000400:00000010:2.0:1734259222.173409:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259222.173416:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 02000000:00000010:1.0:1734259222.173417:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0bc00. 00000100:00000200:2.0:1734259222.173422:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098285568, portal 25 00000400:00000010:2.0:1734259222.173426:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734259222.173429:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098285568, offset 0 00000400:00000200:2.0:1734259222.173437:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734259222.173648:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259222.173653:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259222.173656:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259222.173659:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098285696, portal 10 00000400:00000010:3.0:1734259222.173663:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734259222.173665:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098285696, offset 0 00000400:00000200:3.0:1734259222.173670:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259222.173679:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259222.173684:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259222.173687:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259222.173690:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259222.173692:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259222.173696:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [963:963:256:4294967295] 192.168.202.108@tcp LPNI seq info [962:962:8:4294967295] 00000400:00000200:2.0:1734259222.173704:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259222.173709:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259222.173710:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259222.173712:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734259222.173713:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:3.0:1734259222.173715:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259222.173716:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259222.173718:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259222.173718:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259222.173720:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [964:964:255:4294967295] 192.168.202.108@tcp LPNI seq info [963:963:7:4294967295] 00000800:00000200:2.0:1734259222.173725:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259222.173726:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259222.173728:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734259222.173730:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259222.173732:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734259222.173735:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259222.173739:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259222.173741:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259222.173833:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259222.173837:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259222.173842:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259222.173846:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259222.173850:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734259222.173851:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734259222.173860:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b24700 x1818500098285568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259238 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259222.173987:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259222.173989:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734259222.173992:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259222.173995:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259222.173997:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734259222.173998:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734259222.174002:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b24a80 x1818500098285696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259232 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259222.178842:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259222.178866:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e000 00000400:00000200:0.0:1734259222.178875:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f09 [1] + 224 00000400:00000200:0.0:1734259222.178888:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259222.178891:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259222.178901:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b24700 x1818500098285568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259238 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259222.178940:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259222.178945:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e080 00000400:00000200:0.0:1734259222.178950:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f11 [1] + 0 00000400:00000200:0.0:1734259222.178965:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259222.178975:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259222.178980:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b24a80 x1818500098285696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259232 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259222.179203:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259222.179211:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259222.179213:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259222.179219:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b24700 x1818500098285568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259238 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259222.179225:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b24700 x1818500098285568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259238 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259222.179404:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734259222.179409:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021900. 00000100:00000010:2.0:1734259222.179413:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b24700. 00000400:00000010:3.0:1734259222.180348:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259222.180355:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259222.180357:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259222.180365:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b24a80 x1818500098285696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259232 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259222.180383:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b24a80 x1818500098285696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259232 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259222.180408:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259222.180413:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0bc00. 00000100:00000010:3.0:1734259222.180417:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b24a80. 00000100:00000010:1.0:1734259227.179929:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b24e00. 02000000:00000010:1.0:1734259227.179952:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021800. 00000100:00000010:1.0:1734259227.180043:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b25180. 02000000:00000010:1.0:1734259227.180050:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0b400. 02000000:00000010:1.0:1734259227.180098:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259227.180104:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259227.180113:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259227.180121:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098285952, portal 10 00000400:00000010:1.0:1734259227.180140:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734259227.180143:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098285952, offset 0 00000400:00000200:1.0:1734259227.180153:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259227.180169:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259227.180177:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259227.180181:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259227.180184:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259227.180186:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259227.180188:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [965:965:256:4294967295] 192.168.202.108@tcp LPNI seq info [964:964:8:4294967295] 00000400:00000200:1.0:1734259227.180196:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259227.180201:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259227.180204:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734259227.180209:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259227.180216:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259227.180219:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734259227.180492:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734259227.180497:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000010:2.0:1734259227.180501:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259227.180503:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098285824, portal 25 00000400:00000010:2.0:1734259227.180506:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734259227.180507:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098285824, offset 0 00000400:00000200:2.0:1734259227.180511:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259227.180516:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259227.180518:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259227.180520:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259227.180521:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259227.180523:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259227.180525:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [966:966:255:4294967295] 192.168.202.108@tcp LPNI seq info [965:965:7:4294967295] 00000400:00000200:2.0:1734259227.180531:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259227.180534:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259227.180537:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259227.180539:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259227.180543:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259227.180545:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259227.180820:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259227.180828:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734259227.180832:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259227.180836:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259227.180841:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:0.0:1734259227.180842:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:0.0:1734259227.180852:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b25180 x1818500098285952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259237 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259227.180920:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259227.180921:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259227.181152:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259227.181155:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259227.181158:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734259227.181159:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734259227.181163:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b24e00 x1818500098285824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259243 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259227.183465:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259227.183482:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e180 00000400:00000200:0.0:1734259227.183490:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f19 [1] + 0 00000400:00000200:0.0:1734259227.183501:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259227.183505:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259227.183515:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b25180 x1818500098285952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259237 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259227.183548:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259227.183552:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e100 00000400:00000200:0.0:1734259227.183556:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f21 [1] + 224 00000400:00000200:0.0:1734259227.183594:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259227.183605:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259227.183610:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b24e00 x1818500098285824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259243 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259227.183623:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259227.183633:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259227.183635:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259227.183645:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b25180 x1818500098285952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259237 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259227.183653:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b25180 x1818500098285952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259237 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259227.183686:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259227.183693:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0b400. 00000100:00000010:1.0:1734259227.183697:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b25180. 00000400:00000010:2.0:1734259227.184109:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:2.0:1734259227.184115:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:2.0:1734259227.184116:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259227.184122:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b24e00 x1818500098285824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259243 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259227.184128:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b24e00 x1818500098285824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259243 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259227.184149:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734259227.184153:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021800. 00000100:00000010:2.0:1734259227.184156:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b24e00. 00000100:00000010:1.0:1734259232.187909:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b25180. 02000000:00000010:1.0:1734259232.187929:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021f00. 00000100:00000010:1.0:1734259232.188012:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b25500. 02000000:00000010:1.0:1734259232.188018:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0b400. 02000000:00000010:0.0:1734259232.188112:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734259232.188119:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50210. 00000400:00000010:0.0:1734259232.188125:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734259232.188130:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098286208, portal 10 00000400:00000010:0.0:1734259232.188135:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000100:00000200:0.0:1734259232.188136:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098286208, offset 0 00000400:00000200:0.0:1734259232.188144:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259232.188155:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259232.188160:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259232.188164:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 02000000:00000010:2.0:1734259232.188164:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000200:0.0:1734259232.188166:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259232.188169:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259232.188171:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [967:967:256:4294967295] 192.168.202.108@tcp LPNI seq info [966:966:8:4294967295] 00000400:00000010:2.0:1734259232.188179:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf20. 00000400:00000200:0.0:1734259232.188180:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:2.0:1734259232.188182:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259232.188184:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098286080, portal 25 00000800:00000200:0.0:1734259232.188185:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259232.188187:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000100:00000200:2.0:1734259232.188188:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098286080, offset 0 00000800:00000010:0.0:1734259232.188189:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000400:00000200:2.0:1734259232.188193:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259232.188194:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259232.188197:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259232.188199:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1734259232.188201:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259232.188202:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259232.188203:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:0.0:1734259232.188204:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734259232.188205:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259232.188207:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [968:968:255:4294967295] 192.168.202.108@tcp LPNI seq info [967:967:7:4294967295] 00000400:00000200:2.0:1734259232.188213:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259232.188216:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259232.188219:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259232.188221:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259232.188225:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259232.188227:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259232.188420:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259232.188422:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734259232.188426:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259232.188430:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259232.188434:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:1.0:1734259232.188435:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:1.0:1734259232.188442:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b25500 x1818500098286208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259242 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259232.188501:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259232.188502:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734259232.188504:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259232.188507:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259232.188509:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:1.0:1734259232.188510:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:1.0:1734259232.188513:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b25180 x1818500098286080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259248 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259232.191768:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259232.191792:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e280 00000400:00000200:0.0:1734259232.191802:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f29 [1] + 0 00000400:00000200:0.0:1734259232.191813:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259232.191817:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259232.191828:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b25500 x1818500098286208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259242 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259232.191889:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259232.191894:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e200 00000400:00000200:0.0:1734259232.191899:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f31 [1] + 224 00000400:00000200:0.0:1734259232.191914:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259232.191917:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259232.191922:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b25180 x1818500098286080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259248 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259232.191939:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50210. 00000400:00000200:2.0:1734259232.191944:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:2.0:1734259232.191947:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:2.0:1734259232.191953:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b25500 x1818500098286208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259242 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259232.191970:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b25500 x1818500098286208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259242 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259232.192003:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:2.0:1734259232.192008:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0b400. 00000100:00000010:2.0:1734259232.192015:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b25500. 00000400:00000010:3.0:1734259232.192038:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf20. 00000400:00000200:3.0:1734259232.192051:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:3.0:1734259232.192053:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:3.0:1734259232.192065:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b25180 x1818500098286080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259248 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259232.192075:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b25180 x1818500098286080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259248 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259232.192099:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:3.0:1734259232.192104:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021f00. 00000100:00000010:3.0:1734259232.192107:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b25180. 00000100:00000010:1.0:1734259237.195707:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b25880. 02000000:00000010:1.0:1734259237.195743:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021b00. 02000000:00000010:0.0:1734259237.195873:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3be00. 00000400:00000010:0.0:1734259237.195882:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d501b8. 00000400:00000010:0.0:1734259237.195890:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000010:1.0:1734259237.195896:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b25c00. 00000100:00000200:0.0:1734259237.195899:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098286336, portal 25 02000000:00000010:1.0:1734259237.195903:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:0.0:1734259237.195904:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734259237.195906:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098286336, offset 0 00000400:00000200:0.0:1734259237.195915:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259237.195943:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259237.195950:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259237.195953:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259237.195956:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259237.195958:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259237.195961:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [969:969:256:4294967295] 192.168.202.108@tcp LPNI seq info [968:968:8:4294967295] 00000400:00000200:0.0:1734259237.195971:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259237.195977:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259237.195981:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734259237.195987:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259237.195996:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259237.196001:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734259237.196062:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259237.196074:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259237.196082:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259237.196087:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098286464, portal 10 00000400:00000010:3.0:1734259237.196093:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259237.196095:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098286464, offset 0 00000400:00000200:3.0:1734259237.196103:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259237.196117:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259237.196122:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259237.196125:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259237.196128:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259237.196130:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259237.196132:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [970:970:255:4294967295] 192.168.202.108@tcp LPNI seq info [969:969:7:4294967295] 00000400:00000200:3.0:1734259237.196140:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259237.196158:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259237.196162:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734259237.196166:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259237.196173:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259237.196177:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259237.196190:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259237.196193:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734259237.196196:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259237.196201:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259237.196205:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:1.0:1734259237.196207:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:1.0:1734259237.196214:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b25880 x1818500098286336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259253 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259237.196246:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259237.196248:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734259237.196250:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259237.196253:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259237.196255:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:1.0:1734259237.196257:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734259237.196260:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b25c00 x1818500098286464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259247 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259237.198160:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259237.198180:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e300 00000400:00000200:0.0:1734259237.198203:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f39 [1] + 224 00000400:00000200:0.0:1734259237.198216:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259237.198220:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259237.198229:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b25880 x1818500098286336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259253 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259237.198268:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259237.198272:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e380 00000400:00000200:0.0:1734259237.198277:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f41 [1] + 0 00000400:00000200:0.0:1734259237.198288:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259237.198291:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259237.198296:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b25c00 x1818500098286464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259247 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259237.198477:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d501b8. 00000400:00000200:2.0:1734259237.198483:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:2.0:1734259237.198491:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:2.0:1734259237.198496:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b25880 x1818500098286336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259253 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259237.198503:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b25880 x1818500098286336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259253 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259237.198508:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259237.198512:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259237.198513:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259237.198517:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b25c00 x1818500098286464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259247 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259237.198527:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3be00. 02000000:00000010:2.0:1734259237.198533:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021b00. 00000100:00000010:2.0:1734259237.198537:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b25880. 00000100:00000200:3.0:1734259237.199078:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b25c00 x1818500098286464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259247 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259237.199100:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259237.199104:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0bc00. 00000100:00000010:3.0:1734259237.199108:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b25c00. 00000100:00000010:1.0:1734259242.203728:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b25f80. 02000000:00000010:1.0:1734259242.203746:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021300. 00000100:00000010:1.0:1734259242.203834:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26300. 02000000:00000010:1.0:1734259242.203839:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734259242.203874:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259242.203879:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259242.203897:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259242.203902:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098286720, portal 10 00000400:00000010:1.0:1734259242.203907:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734259242.203908:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098286720, offset 0 00000400:00000200:1.0:1734259242.203915:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259242.203926:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259242.203931:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259242.203946:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259242.203949:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259242.203951:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259242.203954:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [971:971:256:4294967295] 192.168.202.108@tcp LPNI seq info [970:970:8:4294967295] 00000400:00000200:1.0:1734259242.203961:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259242.203966:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259242.203969:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734259242.203974:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259242.203981:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259242.203985:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734259242.204055:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734259242.204059:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259242.204062:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259242.204064:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098286592, portal 25 00000400:00000010:2.0:1734259242.204066:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259242.204068:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098286592, offset 0 00000400:00000200:2.0:1734259242.204071:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259242.204076:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259242.204078:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259242.204079:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259242.204081:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259242.204082:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259242.204084:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [972:972:255:4294967295] 192.168.202.108@tcp LPNI seq info [971:971:7:4294967295] 00000400:00000200:2.0:1734259242.204089:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259242.204093:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259242.204095:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259242.204097:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259242.204101:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259242.204102:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259242.204359:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259242.204363:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734259242.204367:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259242.204371:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259242.204374:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:0.0:1734259242.204376:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:0.0:1734259242.204382:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26300 x1818500098286720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259252 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259242.204439:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259242.204441:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259242.204444:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259242.204447:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259242.204449:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734259242.204450:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734259242.204453:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b25f80 x1818500098286592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259258 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259242.206213:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259242.206225:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e480 00000400:00000200:0.0:1734259242.206243:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f49 [1] + 0 00000400:00000200:0.0:1734259242.206259:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259242.206263:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259242.206269:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26300 x1818500098286720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259252 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259242.206665:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259242.206669:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259242.206671:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259242.206676:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26300 x1818500098286720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259252 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259242.206682:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26300 x1818500098286720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259252 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259242.206705:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259242.206709:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0ac00. 00000100:00000010:1.0:1734259242.206713:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26300. 00000400:00000200:0.0:1734259242.206843:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259242.206850:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e400 00000400:00000200:0.0:1734259242.206854:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f51 [1] + 224 00000400:00000200:0.0:1734259242.206864:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259242.206867:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259242.206871:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b25f80 x1818500098286592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259258 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259242.207071:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259242.207075:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259242.207077:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259242.207081:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b25f80 x1818500098286592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259258 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259242.207092:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b25f80 x1818500098286592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259258 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259242.207105:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734259242.207108:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021300. 00000100:00000010:2.0:1734259242.207110:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b25f80. 00000100:00000010:1.0:1734259247.213012:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26300. 02000000:00000010:1.0:1734259247.213039:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021100. 00000100:00000010:1.0:1734259247.213119:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26680. 02000000:00000010:1.0:1734259247.213126:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0ac00. 02000000:00000010:2.0:1734259247.213321:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734259247.213328:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 02000000:00000010:0.0:1734259247.213329:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733800. 00000400:00000010:0.0:1734259247.213334:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50160. 00000400:00000010:2.0:1734259247.213335:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000400:00000010:0.0:1734259247.213338:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734259247.213342:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098286976, portal 10 00000100:00000200:2.0:1734259247.213342:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098286848, portal 25 00000400:00000010:2.0:1734259247.213346:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000400:00000010:0.0:1734259247.213348:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:2.0:1734259247.213348:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098286848, offset 0 00000100:00000200:0.0:1734259247.213349:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098286976, offset 0 00000400:00000200:2.0:1734259247.213357:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259247.213552:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259247.213559:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259247.213563:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259247.213566:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259247.213590:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259247.213593:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [973:973:256:4294967295] 192.168.202.108@tcp LPNI seq info [972:972:8:4294967295] 00000400:00000200:2.0:1734259247.213601:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259247.213607:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259247.213610:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259247.213616:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259247.213624:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259247.213629:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259247.214009:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259247.214013:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259247.214016:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259247.214021:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259247.214031:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259247.214035:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000200:0.0:1734259247.214037:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734259247.214037:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000400:00000200:0.0:1734259247.214039:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259247.214041:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259247.214043:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259247.214045:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259247.214046:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [974:974:255:4294967295] 192.168.202.108@tcp LPNI seq info [973:973:7:4294967295] 00000100:00000200:1.0:1734259247.214059:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26300 x1818500098286848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259263 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259247.214245:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259247.214250:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259247.214253:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734259247.214256:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259247.214265:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259247.214267:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259247.214291:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259247.214294:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734259247.214296:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259247.214299:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259247.214301:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:1.0:1734259247.214302:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:1.0:1734259247.214306:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26680 x1818500098286976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259257 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259247.216853:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259247.216870:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e500 00000400:00000200:0.0:1734259247.216878:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f59 [1] + 224 00000400:00000200:0.0:1734259247.216888:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259247.216891:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259247.216901:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26300 x1818500098286848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259263 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259247.216940:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259247.216945:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e580 00000400:00000200:0.0:1734259247.216950:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f5d [1] + 0 00000400:00000200:0.0:1734259247.216967:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259247.216970:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259247.216975:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26680 x1818500098286976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259257 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259247.217377:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50160. 00000400:00000200:1.0:1734259247.217383:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:1.0:1734259247.217385:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:1.0:1734259247.217390:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26680 x1818500098286976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259257 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259247.217396:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26680 x1818500098286976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259257 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259247.217424:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733800. 02000000:00000010:1.0:1734259247.217428:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0ac00. 00000100:00000010:1.0:1734259247.217433:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26680. 00000400:00000010:2.0:1734259247.217499:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259247.217503:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259247.217504:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259247.217509:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26300 x1818500098286848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259263 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259247.217525:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26300 x1818500098286848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259263 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259247.217538:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734259247.217541:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021100. 00000100:00000010:2.0:1734259247.217542:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26300. 00000100:00000010:1.0:1734259252.219708:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26680. 02000000:00000010:1.0:1734259252.219728:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021000. 00000100:00000010:1.0:1734259252.219790:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26a00. 02000000:00000010:1.0:1734259252.219796:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0ac00. 02000000:00000010:3.0:1734259252.219865:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259252.219873:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259252.219880:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259252.219886:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098287104, portal 25 00000400:00000010:3.0:1734259252.219890:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734259252.219892:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098287104, offset 0 00000400:00000200:3.0:1734259252.219900:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259252.219912:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259252.219917:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259252.219920:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259252.219923:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259252.219925:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259252.219927:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [975:975:256:4294967295] 192.168.202.108@tcp LPNI seq info [974:974:8:4294967295] 02000000:00000010:0.0:1734259252.219928:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734259252.219933:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50108. 00000400:00000200:3.0:1734259252.219934:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:0.0:1734259252.219937:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000100:00000200:0.0:1734259252.219939:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098287232, portal 10 00000800:00000200:3.0:1734259252.219939:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:0.0:1734259252.219944:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000100:00000200:0.0:1734259252.219945:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098287232, offset 0 00000400:00000200:0.0:1734259252.219949:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259252.219955:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259252.219955:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734259252.219957:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259252.219959:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259252.219961:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259252.219961:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259252.219962:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259252.219965:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [976:976:255:4294967295] 192.168.202.108@tcp LPNI seq info [975:975:7:4294967295] 00000800:00000200:3.0:1734259252.219968:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259252.219972:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734259252.219976:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259252.219979:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259252.219982:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734259252.219984:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259252.219988:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259252.219990:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259252.220237:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259252.220240:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:1.0:1734259252.220244:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259252.220247:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259252.220251:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:1.0:1734259252.220252:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:1.0:1734259252.220259:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26680 x1818500098287104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259268 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259252.220479:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259252.220481:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734259252.220483:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259252.220486:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259252.220488:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:1.0:1734259252.220489:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:1.0:1734259252.220493:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26a00 x1818500098287232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259262 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259252.222620:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259252.222637:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e600 00000400:00000200:0.0:1734259252.222644:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f69 [1] + 224 00000400:00000200:0.0:1734259252.222655:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259252.222658:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259252.222667:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26680 x1818500098287104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259268 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259252.222704:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259252.222708:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e680 00000400:00000200:0.0:1734259252.222712:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f71 [1] + 0 00000400:00000200:0.0:1734259252.222725:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259252.222728:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259252.222732:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26a00 x1818500098287232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259262 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259252.222925:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50108. 00000400:00000200:1.0:1734259252.222930:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:1.0:1734259252.222931:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:1.0:1734259252.222936:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26a00 x1818500098287232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259262 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259252.222936:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259252.222940:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259252.222941:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:1.0:1734259252.222942:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26a00 x1818500098287232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259262 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259252.222949:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26680 x1818500098287104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259268 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259252.222956:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26680 x1818500098287104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259268 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259252.222971:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:3.0:1734259252.222971:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:1.0:1734259252.222975:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:3.0:1734259252.222975:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021000. 00000100:00000010:1.0:1734259252.222978:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26a00. 00000100:00000010:3.0:1734259252.222978:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26680. 00000100:00000010:1.0:1734259257.227714:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26a00. 02000000:00000010:1.0:1734259257.227735:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021500. 00000100:00000010:1.0:1734259257.227827:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26d80. 02000000:00000010:1.0:1734259257.227834:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0ac00. 02000000:00000010:3.0:1734259257.227858:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259257.227868:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259257.227874:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259257.227880:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098287360, portal 25 00000400:00000010:3.0:1734259257.227884:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734259257.227886:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098287360, offset 0 00000400:00000200:3.0:1734259257.227894:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:0.0:1734259257.227896:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734259257.227905:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50108. 00000400:00000200:3.0:1734259257.227906:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:0.0:1734259257.227908:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734259257.227911:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098287488, portal 10 00000400:00000200:3.0:1734259257.227911:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:0.0:1734259257.227915:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000400:00000200:3.0:1734259257.227915:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:0.0:1734259257.227916:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098287488, offset 0 00000400:00000200:3.0:1734259257.227918:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259257.227920:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259257.227921:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259257.227923:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [977:977:256:4294967295] 192.168.202.108@tcp LPNI seq info [976:976:8:4294967295] 00000400:00000200:3.0:1734259257.227931:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259257.227935:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259257.227936:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259257.227939:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734259257.227946:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259257.227948:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259257.227950:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259257.227950:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259257.227951:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259257.227953:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [978:978:255:4294967295] 192.168.202.108@tcp LPNI seq info [977:977:7:4294967295] 00000800:00000200:3.0:1734259257.227956:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734259257.227959:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259257.227959:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259257.227962:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259257.227964:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734259257.227967:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259257.227970:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259257.227972:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259257.228289:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259257.228293:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:1.0:1734259257.228297:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259257.228301:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259257.228305:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:1.0:1734259257.228306:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:1.0:1734259257.228313:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26a00 x1818500098287360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259273 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259257.228447:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259257.228454:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:1.0:1734259257.228457:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259257.228460:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259257.228462:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:1.0:1734259257.228463:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:1.0:1734259257.228468:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26d80 x1818500098287488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259267 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259257.231554:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259257.231691:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e780 00000400:00000200:0.0:1734259257.231700:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f81 [1] + 0 00000400:00000200:0.0:1734259257.231713:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259257.231716:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259257.231725:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26d80 x1818500098287488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259267 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259257.231762:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259257.231777:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e700 00000400:00000200:0.0:1734259257.231781:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f79 [1] + 224 00000400:00000200:0.0:1734259257.231796:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259257.231799:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259257.231803:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26a00 x1818500098287360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259257.231840:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50108. 00000400:00000200:2.0:1734259257.231845:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:2.0:1734259257.231847:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:2.0:1734259257.231853:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26d80 x1818500098287488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259267 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259257.231860:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26d80 x1818500098287488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259267 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259257.231885:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734259257.231890:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0ac00. 00000100:00000010:2.0:1734259257.231894:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26d80. 00000400:00000010:3.0:1734259257.231942:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259257.231946:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259257.231947:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259257.231951:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26a00 x1818500098287360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259273 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259257.231957:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26a00 x1818500098287360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259273 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259257.231967:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259257.231970:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021500. 00000100:00000010:3.0:1734259257.231972:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26a00. 00000100:00000010:1.0:1734259262.235815:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27100. 02000000:00000010:1.0:1734259262.235833:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021a00. 00000100:00000010:1.0:1734259262.235881:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27480. 02000000:00000010:1.0:1734259262.235887:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259262.235925:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0b400. 02000000:00000010:2.0:1734259262.235928:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:1.0:1734259262.235931:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:2.0:1734259262.235934:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:1.0:1734259262.235937:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000010:2.0:1734259262.235937:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259262.235944:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098287616, portal 25 00000400:00000010:2.0:1734259262.235947:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:1.0:1734259262.235950:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098287744, portal 10 00000100:00000200:2.0:1734259262.235950:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098287616, offset 0 00000400:00000010:1.0:1734259262.235955:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000400:00000200:2.0:1734259262.235958:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:1.0:1734259262.235964:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098287744, offset 0 00000400:00000200:1.0:1734259262.235968:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259262.235969:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259262.235974:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259262.235978:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259262.235981:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259262.235983:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259262.235986:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [979:979:256:4294967295] 192.168.202.108@tcp LPNI seq info [978:978:8:4294967295] 00000400:00000200:2.0:1734259262.235993:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259262.236010:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259262.236013:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259262.236018:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259262.236024:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259262.236028:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734259262.236050:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259262.236052:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259262.236055:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259262.236056:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259262.236058:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259262.236060:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [980:980:255:4294967295] 192.168.202.108@tcp LPNI seq info [979:979:7:4294967295] 00000400:00000200:1.0:1734259262.236065:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259262.236069:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259262.236073:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734259262.236076:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259262.236079:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259262.236081:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259262.236144:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259262.236147:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259262.236151:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259262.236160:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259262.236164:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734259262.236165:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734259262.236172:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27100 x1818500098287616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259262.236231:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259262.236233:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734259262.236235:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259262.236238:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259262.236240:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:0.0:1734259262.236241:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734259262.236245:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27480 x1818500098287744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259272 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259262.238378:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259262.238394:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e800 00000400:00000200:0.0:1734259262.238402:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f89 [1] + 224 00000400:00000200:0.0:1734259262.238412:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259262.238416:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259262.238424:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27100 x1818500098287616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259262.238942:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259262.238948:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e880 00000400:00000200:0.0:1734259262.238952:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1f8d [1] + 0 00000400:00000200:0.0:1734259262.238967:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259262.238970:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259262.238976:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27480 x1818500098287744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259272 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259262.239061:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259262.239066:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259262.239068:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000400:00000010:1.0:1734259262.239073:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000100:00000200:2.0:1734259262.239073:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27100 x1818500098287616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259262.239080:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27100 x1818500098287616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259278 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734259262.239083:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259262.239084:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259262.239089:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27480 x1818500098287744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259272 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259262.239095:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27480 x1818500098287744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259272 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259262.239101:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734259262.239105:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021a00. 00000100:00000010:2.0:1734259262.239109:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27100. 02000000:00000010:1.0:1734259262.239112:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0b400. 02000000:00000010:1.0:1734259262.239116:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0bc00. 00000100:00000010:1.0:1734259262.239118:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27480. 00000100:00000010:1.0:1734259267.243856:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27480. 02000000:00000010:1.0:1734259267.243874:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021500. 00000100:00000010:1.0:1734259267.243929:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27800. 02000000:00000010:1.0:1734259267.243935:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0bc00. 02000000:00000010:2.0:1734259267.244007:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734259267.244014:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259267.244019:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259267.244025:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098287872, portal 25 00000400:00000010:2.0:1734259267.244028:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734259267.244030:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098287872, offset 0 00000400:00000200:2.0:1734259267.244037:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259267.244049:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259267.244053:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259267.244057:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259267.244060:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259267.244062:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259267.244064:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [981:981:256:4294967295] 192.168.202.108@tcp LPNI seq info [980:980:8:4294967295] 00000400:00000200:2.0:1734259267.244071:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259267.244076:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259267.244089:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259267.244094:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259267.244101:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259267.244104:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:0.0:1734259267.244186:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734259267.244191:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50160. 00000400:00000010:0.0:1734259267.244201:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000100:00000200:0.0:1734259267.244203:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098288000, portal 10 00000400:00000010:0.0:1734259267.244207:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734259267.244208:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098288000, offset 0 00000400:00000200:0.0:1734259267.244213:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259267.244217:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259267.244220:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259267.244222:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259267.244223:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259267.244225:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259267.244227:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [982:982:255:4294967295] 192.168.202.108@tcp LPNI seq info [981:981:7:4294967295] 00000400:00000200:0.0:1734259267.244233:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259267.244237:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259267.244240:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734259267.244243:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259267.244246:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259267.244248:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259267.244610:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259267.244613:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259267.244617:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259267.244620:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259267.244624:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:1.0:1734259267.244626:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:1.0:1734259267.244631:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27480 x1818500098287872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259267.244671:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259267.244673:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734259267.244675:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259267.244678:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259267.244680:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:1.0:1734259267.244681:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:1.0:1734259267.244683:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27800 x1818500098288000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259277 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259267.246038:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259267.246056:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61e900 00000400:00000200:0.0:1734259267.246066:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1f99 [1] + 224 00000400:00000200:0.0:1734259267.246078:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259267.246081:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259267.246091:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27480 x1818500098287872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259283 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259267.246461:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259267.246466:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61e980 00000400:00000200:0.0:1734259267.246471:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1fa1 [1] + 0 00000400:00000200:0.0:1734259267.246489:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259267.246492:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259267.246506:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27800 x1818500098288000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259277 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259267.246749:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50160. 00000400:00000200:1.0:1734259267.246754:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:1.0:1734259267.246756:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:1.0:1734259267.246766:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27800 x1818500098288000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259277 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259267.246772:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27800 x1818500098288000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259277 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259267.246802:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:1.0:1734259267.246808:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0bc00. 00000100:00000010:1.0:1734259267.246813:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27800. 00000400:00000010:2.0:1734259267.247068:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259267.247072:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259267.247073:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259267.247078:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27480 x1818500098287872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259267.247085:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27480 x1818500098287872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259283 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259267.247096:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 02000000:00000010:2.0:1734259267.247099:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021500. 00000100:00000010:2.0:1734259267.247101:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27480. 00000100:00000010:1.0:1734259272.251783:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27800. 02000000:00000010:1.0:1734259272.251803:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021000. 00000100:00000010:1.0:1734259272.251858:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27b80. 02000000:00000010:1.0:1734259272.251864:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0bc00. 02000000:00000010:2.0:1734259272.251885:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bde00. 00000400:00000010:2.0:1734259272.251893:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259272.251899:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259272.251905:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098288128, portal 25 00000400:00000010:2.0:1734259272.251909:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734259272.251911:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098288128, offset 0 00000400:00000200:2.0:1734259272.251919:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259272.251932:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259272.251937:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259272.251940:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259272.251943:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259272.251945:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259272.251947:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [983:983:256:4294967295] 192.168.202.108@tcp LPNI seq info [982:982:8:4294967295] 00000400:00000200:2.0:1734259272.251955:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259272.251961:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259272.251965:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259272.251987:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259272.251994:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259272.251997:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:0.0:1734259272.252008:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734259272.252012:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d501b8. 00000400:00000010:0.0:1734259272.252015:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734259272.252017:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098288256, portal 10 00000400:00000010:0.0:1734259272.252021:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000100:00000200:0.0:1734259272.252023:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098288256, offset 0 00000400:00000200:0.0:1734259272.252026:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259272.252030:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259272.252032:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259272.252034:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259272.252035:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259272.252037:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259272.252039:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [984:984:255:4294967295] 192.168.202.108@tcp LPNI seq info [983:983:7:4294967295] 00000400:00000200:0.0:1734259272.252044:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259272.252047:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259272.252049:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000800:00000200:0.0:1734259272.252052:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259272.252054:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259272.252056:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259272.252135:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259272.252138:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259272.252142:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259272.252146:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259272.252150:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:1.0:1734259272.252151:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:1.0:1734259272.252158:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27800 x1818500098288128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259288 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259272.252343:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259272.252346:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:1.0:1734259272.252348:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259272.252351:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259272.252354:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:1.0:1734259272.252355:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000100:00000200:1.0:1734259272.252358:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27b80 x1818500098288256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259272.253853:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259272.253869:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ea00 00000400:00000200:0.0:1734259272.253876:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1fa9 [1] + 224 00000400:00000200:0.0:1734259272.253888:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259272.253891:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259272.253900:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27800 x1818500098288128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259288 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259272.254001:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259272.254019:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ea80 00000400:00000200:0.0:1734259272.254025:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1fb1 [1] + 0 00000400:00000200:0.0:1734259272.254038:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259272.254040:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259272.254045:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27b80 x1818500098288256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259282 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259272.254088:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259272.254092:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259272.254095:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259272.254104:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27800 x1818500098288128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259288 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259272.254109:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27800 x1818500098288128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259288 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259272.254130:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d501b8. 02000000:00000010:2.0:1734259272.254130:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bde00. 00000400:00000200:1.0:1734259272.254133:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:1.0:1734259272.254134:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 02000000:00000010:2.0:1734259272.254134:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021000. 00000100:00000200:1.0:1734259272.254138:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27b80 x1818500098288256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734259272.254138:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27800. 00000100:00000200:1.0:1734259272.254154:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27b80 x1818500098288256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259282 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259272.254169:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734259272.254171:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0bc00. 00000100:00000010:1.0:1734259272.254174:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27b80. 00000100:00000010:1.0:1734259277.259786:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27b80. 02000000:00000010:1.0:1734259277.259811:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021700. 00000100:00000010:1.0:1734259277.259881:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27800. 02000000:00000010:1.0:1734259277.259889:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0bc00. 02000000:00000010:2.0:1734259277.259984:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 02000000:00000010:0.0:1734259277.259990:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:2.0:1734259277.259993:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:0.0:1734259277.259996:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50210. 00000400:00000010:0.0:1734259277.260001:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000400:00000010:2.0:1734259277.260001:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734259277.260008:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098288512, portal 10 00000100:00000200:2.0:1734259277.260012:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098288384, portal 25 00000400:00000010:0.0:1734259277.260014:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000400:00000010:2.0:1734259277.260015:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734259277.260016:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098288512, offset 0 00000100:00000200:2.0:1734259277.260017:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098288384, offset 0 00000400:00000200:0.0:1734259277.260024:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259277.260044:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259277.260049:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259277.260054:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259277.260056:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259277.260059:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259277.260062:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [985:985:256:4294967295] 192.168.202.108@tcp LPNI seq info [984:984:8:4294967295] 00000400:00000200:0.0:1734259277.260071:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259277.260077:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259277.260081:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000800:00000200:0.0:1734259277.260087:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259277.260092:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259277.260096:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259277.260097:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:0.0:1734259277.260099:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734259277.260100:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259277.260102:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259277.260103:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259277.260105:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259277.260107:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [986:986:255:4294967295] 192.168.202.108@tcp LPNI seq info [985:985:7:4294967295] 00000400:00000200:2.0:1734259277.260113:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259277.260116:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259277.260119:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259277.260122:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259277.260125:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259277.260141:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259277.260294:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259277.260301:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734259277.260307:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259277.260315:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259277.260320:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:1.0:1734259277.260322:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:1.0:1734259277.260332:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27800 x1818500098288512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259277.260397:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259277.260399:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734259277.260402:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259277.260405:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259277.260407:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:1.0:1734259277.260408:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:1.0:1734259277.260412:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27b80 x1818500098288384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259277.263356:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259277.263376:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61eb00 00000400:00000200:0.0:1734259277.263385:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1fbd [1] + 224 00000400:00000200:0.0:1734259277.263396:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259277.263405:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259277.263417:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27b80 x1818500098288384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259293 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259277.263459:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259277.263464:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61eb80 00000400:00000200:0.0:1734259277.263470:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1fb9 [1] + 0 00000400:00000200:0.0:1734259277.263486:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259277.263489:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259277.263495:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27800 x1818500098288512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259287 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259277.263602:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50210. 00000400:00000200:1.0:1734259277.263607:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:1.0:1734259277.263609:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:1.0:1734259277.263624:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27800 x1818500098288512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259277.263640:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27800 x1818500098288512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259287 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259277.263652:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259277.263662:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259277.263664:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 02000000:00000010:1.0:1734259277.263672:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 00000100:00000200:2.0:1734259277.263675:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27b80 x1818500098288384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259277.263679:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0bc00. 00000100:00000010:1.0:1734259277.263684:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27800. 00000100:00000200:2.0:1734259277.263685:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27b80 x1818500098288384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259293 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259277.263708:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734259277.263713:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021700. 00000100:00000010:2.0:1734259277.263716:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27b80. 00000100:00000010:1.0:1734259282.267691:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27800. 02000000:00000010:1.0:1734259282.267709:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021300. 00000100:00000010:1.0:1734259282.267755:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27480. 02000000:00000010:1.0:1734259282.267760:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0bc00. 02000000:00000010:2.0:1734259282.267787:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734259282.267793:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259282.267798:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259282.267803:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098288640, portal 25 00000400:00000010:2.0:1734259282.267805:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734259282.267806:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098288640, offset 0 00000400:00000200:2.0:1734259282.267812:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:0.0:1734259282.267822:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000200:2.0:1734259282.267822:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259282.267825:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:0.0:1734259282.267827:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50268. 00000400:00000200:2.0:1734259282.267828:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:0.0:1734259282.267831:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1088. 00000400:00000200:2.0:1734259282.267831:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259282.267832:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:0.0:1734259282.267834:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098288768, portal 10 00000400:00000200:2.0:1734259282.267834:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [987:987:256:4294967295] 192.168.202.108@tcp LPNI seq info [986:986:8:4294967295] 00000400:00000010:0.0:1734259282.267837:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000100:00000200:0.0:1734259282.267839:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098288768, offset 0 00000400:00000200:2.0:1734259282.267839:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:0.0:1734259282.267843:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734259282.267843:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259282.267846:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259282.267848:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259282.267850:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:2.0:1734259282.267851:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259282.267852:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259282.267853:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259282.267854:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259282.267856:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [988:988:255:4294967295] 192.168.202.108@tcp LPNI seq info [987:987:7:4294967295] 00000800:00000200:2.0:1734259282.267857:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734259282.267860:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259282.267860:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259282.267862:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259282.267864:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734259282.267866:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259282.267868:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259282.267870:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259282.267932:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259282.267936:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734259282.267940:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259282.267944:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259282.267947:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:1.0:1734259282.267949:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:1.0:1734259282.267955:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27800 x1818500098288640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259298 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259282.268014:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259282.268016:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734259282.268018:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259282.268021:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259282.268023:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:1.0:1734259282.268024:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:1.0:1734259282.268027:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27480 x1818500098288768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259292 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259282.269476:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259282.269494:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ec00 00000400:00000200:0.0:1734259282.269503:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1fc9 [1] + 224 00000400:00000200:0.0:1734259282.269515:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259282.269518:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259282.269528:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27800 x1818500098288640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259298 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259282.269563:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259282.269618:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ec80 00000400:00000010:2.0:1734259282.269623:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259282.269628:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259282.269630:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000400:00000200:0.0:1734259282.269636:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1fd1 [1] + 0 00000100:00000200:2.0:1734259282.269636:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27800 x1818500098288640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259298 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259282.269644:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27800 x1818500098288640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259298 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259282.269655:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259282.269658:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259282.269664:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27480 x1818500098288768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259292 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259282.269669:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:2.0:1734259282.269673:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021300. 00000100:00000010:2.0:1734259282.269677:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27800. 00000400:00000010:1.0:1734259282.269731:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50268. 00000400:00000200:1.0:1734259282.269736:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1088 00000400:00000010:1.0:1734259282.269737:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1088. 00000100:00000200:1.0:1734259282.269742:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27480 x1818500098288768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259292 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259282.269763:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27480 x1818500098288768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259292 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259282.269782:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:1.0:1734259282.269786:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0bc00. 00000100:00000010:1.0:1734259282.269794:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27480. 00000100:00000010:1.0:1734259287.275887:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27480. 02000000:00000010:1.0:1734259287.275905:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021400. 02000000:00000010:3.0:1734259287.275975:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259287.275982:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259287.275989:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259287.275996:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098288896, portal 25 00000400:00000010:3.0:1734259287.275999:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734259287.276001:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098288896, offset 0 00000400:00000200:3.0:1734259287.276009:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259287.276020:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259287.276025:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259287.276028:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259287.276031:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259287.276033:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259287.276036:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [989:989:256:4294967295] 192.168.202.108@tcp LPNI seq info [988:988:8:4294967295] 00000400:00000200:3.0:1734259287.276043:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259287.276048:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259287.276051:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734259287.276055:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259287.276062:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259287.276076:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259287.276232:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259287.276235:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734259287.276239:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259287.276243:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259287.276246:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:0.0:1734259287.276247:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734259287.276253:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27480 x1818500098288896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259303 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:1.0:1734259287.277006:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b27100. 02000000:00000010:1.0:1734259287.277017:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0bc00. 02000000:00000010:0.0:1734259287.277094:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734259287.277099:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d502c0. 00000400:00000010:0.0:1734259287.277104:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1000. 00000100:00000200:0.0:1734259287.277107:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098289024, portal 10 00000400:00000010:0.0:1734259287.277112:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1088. 00000100:00000200:0.0:1734259287.277114:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098289024, offset 0 00000400:00000200:0.0:1734259287.277119:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259287.277336:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259287.277339:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259287.277342:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259287.277345:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259287.277347:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259287.277349:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [990:990:256:4294967295] 192.168.202.108@tcp LPNI seq info [989:989:8:4294967295] 00000400:00000200:0.0:1734259287.277355:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259287.277359:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259287.277362:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734259287.277366:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259287.277371:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259287.277374:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259287.277616:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259287.277619:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734259287.277621:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259287.277624:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259287.277627:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1088 00000400:00000010:1.0:1734259287.277629:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1088. 00000100:00000200:1.0:1734259287.277633:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b27100 x1818500098289024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259297 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259287.278122:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259287.278131:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ed00 00000400:00000200:0.0:1734259287.278137:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1fd9 [1] + 224 00000400:00000200:0.0:1734259287.278152:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259287.278155:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259287.278161:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27480 x1818500098288896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259287.278315:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259287.278319:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259287.278320:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259287.278324:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27480 x1818500098288896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259303 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259287.278330:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27480 x1818500098288896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259303 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259287.278347:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259287.278352:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021400. 00000100:00000010:3.0:1734259287.278354:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27480. 00000400:00000200:0.0:1734259287.279617:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259287.279629:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ed80 00000400:00000200:0.0:1734259287.279635:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1fe1 [1] + 0 00000400:00000200:0.0:1734259287.279648:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259287.279651:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259287.279659:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b27100 x1818500098289024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259297 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259287.279816:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d502c0. 00000400:00000200:2.0:1734259287.279820:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1000 00000400:00000010:2.0:1734259287.279821:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1000. 00000100:00000200:2.0:1734259287.279826:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b27100 x1818500098289024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259297 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259287.279831:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b27100 x1818500098289024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259297 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259287.279849:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734259287.279853:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0bc00. 00000100:00000010:2.0:1734259287.279857:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b27100. 00000100:00000010:1.0:1734259292.283753:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26a00. 02000000:00000010:1.0:1734259292.283775:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021f00. 00000100:00000010:1.0:1734259292.283835:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26d80. 02000000:00000010:1.0:1734259292.283842:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0b400. 02000000:00000010:1.0:1734259292.283887:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259292.283895:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259292.283903:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259292.283910:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098289280, portal 10 00000400:00000010:1.0:1734259292.283916:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734259292.283917:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098289280, offset 0 00000400:00000200:1.0:1734259292.283926:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259292.283938:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259292.283942:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259292.283960:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259292.283963:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259292.283965:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259292.283968:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [991:991:256:4294967295] 192.168.202.108@tcp LPNI seq info [990:990:8:4294967295] 00000400:00000200:1.0:1734259292.283976:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259292.283981:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259292.283984:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734259292.283989:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259292.283997:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259292.284000:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734259292.284323:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000400:00000010:2.0:1734259292.284328:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259292.284332:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259292.284335:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098289152, portal 25 00000400:00000010:2.0:1734259292.284338:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734259292.284339:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098289152, offset 0 00000400:00000200:2.0:1734259292.284343:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259292.284348:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259292.284350:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259292.284352:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259292.284354:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259292.284361:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259292.284363:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [992:992:255:4294967295] 192.168.202.108@tcp LPNI seq info [991:991:7:4294967295] 00000400:00000200:2.0:1734259292.284368:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259292.284372:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259292.284374:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259292.284377:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259292.284381:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259292.284382:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259292.284535:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259292.284539:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734259292.284560:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259292.284564:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259292.284590:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:0.0:1734259292.284591:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:0.0:1734259292.284599:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26d80 x1818500098289280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259302 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259292.284666:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259292.284668:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259292.284671:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259292.284674:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259292.284676:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734259292.284677:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734259292.284680:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26a00 x1818500098289152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259308 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259292.289016:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259292.289033:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ee80 00000400:00000200:0.0:1734259292.289041:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x1fe9 [1] + 0 00000400:00000200:0.0:1734259292.289060:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259292.289063:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259292.289073:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26d80 x1818500098289280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259302 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259292.289170:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259292.289175:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ee00 00000400:00000200:0.0:1734259292.289180:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ff1 [1] + 224 00000400:00000200:0.0:1734259292.289188:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259292.289191:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259292.289196:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26a00 x1818500098289152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259308 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259292.289215:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259292.289220:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259292.289223:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259292.289228:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26d80 x1818500098289280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259302 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259292.289234:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26d80 x1818500098289280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259302 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259292.289262:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259292.289268:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0b400. 00000100:00000010:1.0:1734259292.289272:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26d80. 00000400:00000010:2.0:1734259292.289388:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259292.289392:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259292.289393:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259292.289398:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26a00 x1818500098289152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259308 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259292.289404:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26a00 x1818500098289152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259308 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259292.289414:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:2.0:1734259292.289417:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021f00. 00000100:00000010:2.0:1734259292.289418:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26a00. 00000100:00000010:1.0:1734259297.291877:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26d80. 02000000:00000010:1.0:1734259297.291905:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021600. 00000100:00000010:1.0:1734259297.291964:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26680. 02000000:00000010:1.0:1734259297.291972:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0b400. 02000000:00000010:3.0:1734259297.291989:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259297.291997:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259297.292003:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259297.292009:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098289408, portal 25 00000400:00000010:3.0:1734259297.292013:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734259297.292015:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098289408, offset 0 00000400:00000200:3.0:1734259297.292024:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259297.292037:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259297.292041:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259297.292045:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259297.292048:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259297.292050:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259297.292052:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [993:993:256:4294967295] 192.168.202.108@tcp LPNI seq info [992:992:8:4294967295] 00000400:00000200:3.0:1734259297.292060:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259297.292065:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259297.292068:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734259297.292073:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:0.0:1734259297.292077:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000800:00000200:3.0:1734259297.292081:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259297.292085:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:0.0:1734259297.292094:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50318. 00000400:00000010:0.0:1734259297.292097:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000100:00000200:0.0:1734259297.292100:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098289536, portal 10 00000400:00000010:0.0:1734259297.292104:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000100:00000200:0.0:1734259297.292105:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098289536, offset 0 00000400:00000200:0.0:1734259297.292110:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259297.292114:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259297.292117:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259297.292119:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259297.292120:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259297.292122:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259297.292129:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [994:994:255:4294967295] 192.168.202.108@tcp LPNI seq info [993:993:7:4294967295] 00000400:00000200:0.0:1734259297.292135:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259297.292138:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259297.292140:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734259297.292143:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259297.292149:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259297.292151:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259297.292191:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259297.292193:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:1.0:1734259297.292198:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259297.292203:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259297.292206:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:1.0:1734259297.292208:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:1.0:1734259297.292220:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26d80 x1818500098289408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259313 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259297.292492:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259297.292495:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734259297.292497:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259297.292500:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259297.292502:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:1.0:1734259297.292505:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:1.0:1734259297.292509:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26680 x1818500098289536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259307 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259297.294861:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259297.294880:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ef80 00000400:00000200:0.0:1734259297.294888:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2001 [1] + 0 00000400:00000200:0.0:1734259297.294899:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259297.294902:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259297.294912:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26680 x1818500098289536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259307 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259297.294955:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259297.294959:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ef00 00000400:00000200:0.0:1734259297.294963:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x1ff9 [1] + 224 00000400:00000200:0.0:1734259297.294979:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259297.294987:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259297.294992:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26d80 x1818500098289408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259313 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259297.295084:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50318. 00000400:00000200:2.0:1734259297.295089:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:2.0:1734259297.295090:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:2.0:1734259297.295095:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26680 x1818500098289536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259307 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259297.295102:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26680 x1818500098289536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259307 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259297.295131:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734259297.295135:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0b400. 00000100:00000010:2.0:1734259297.295139:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26680. 00000400:00000010:3.0:1734259297.295154:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259297.295159:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259297.295160:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259297.295166:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26d80 x1818500098289408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259313 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259297.295173:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26d80 x1818500098289408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259313 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259297.295185:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259297.295189:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021600. 00000100:00000010:3.0:1734259297.295190:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26d80. 00000100:00000010:1.0:1734259302.299769:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b26300. 02000000:00000010:1.0:1734259302.299803:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b4021d00. 00000100:00000010:1.0:1734259302.299872:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff880136b25f80. 02000000:00000010:1.0:1734259302.299881:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259302.299934:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734259302.299942:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259302.299949:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259302.299956:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098289792, portal 10 00000400:00000010:1.0:1734259302.299963:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734259302.299965:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098289792, offset 0 00000400:00000200:1.0:1734259302.299975:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259302.299991:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259302.299997:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259302.300001:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259302.300005:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259302.300007:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259302.300010:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [995:995:256:4294967295] 192.168.202.108@tcp LPNI seq info [994:994:8:4294967295] 00000400:00000200:1.0:1734259302.300020:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259302.300026:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259302.300031:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734259302.300037:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259302.300059:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259302.300063:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:2.0:1734259302.300073:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc400. 00000400:00000010:2.0:1734259302.300083:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:2.0:1734259302.300098:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259302.300105:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098289664, portal 25 00000400:00000010:2.0:1734259302.300109:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734259302.300111:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098289664, offset 0 00000400:00000200:2.0:1734259302.300118:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259302.300128:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259302.300133:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259302.300136:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259302.300139:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259302.300141:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259302.300144:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [996:996:255:4294967295] 192.168.202.108@tcp LPNI seq info [995:995:7:4294967295] 00000400:00000200:2.0:1734259302.300151:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259302.300156:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259302.300159:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259302.300163:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259302.300169:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259302.300172:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259302.300459:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259302.300463:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734259302.300469:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259302.300474:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259302.300478:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734259302.300479:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734259302.300488:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b25f80 x1818500098289792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259312 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259302.300560:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259302.300561:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259302.300564:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259302.300592:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259302.300595:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734259302.300596:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734259302.300601:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff880136b26300 x1818500098289664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259318 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259302.302252:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259302.302268:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f080 00000400:00000200:0.0:1734259302.302275:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2009 [1] + 0 00000400:00000200:0.0:1734259302.302285:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259302.302288:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259302.302627:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b25f80 x1818500098289792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259312 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259302.302667:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259302.302671:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f000 00000400:00000200:0.0:1734259302.302676:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2011 [1] + 224 00000400:00000200:0.0:1734259302.302692:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259302.302700:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259302.302705:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff880136b26300 x1818500098289664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259318 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259302.302892:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259302.302898:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259302.302900:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259302.302904:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b25f80 x1818500098289792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259312 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259302.302910:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b25f80 x1818500098289792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259312 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259302.302935:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734259302.302939:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b6d0bc00. 00000100:00000010:1.0:1734259302.302944:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b25f80. 00000400:00000010:2.0:1734259302.303090:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:2.0:1734259302.303093:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259302.303094:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259302.303099:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff880136b26300 x1818500098289664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259318 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259302.303104:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff880136b26300 x1818500098289664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259318 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259302.303116:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc400. 02000000:00000010:2.0:1734259302.303118:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b4021d00. 00000100:00000010:2.0:1734259302.303121:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff880136b26300. 00000100:00000010:2.0:1734259307.307961:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259307.307981:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259307.308033:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259307.308050:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259307.308077:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3a600. 00000400:00000010:0.0:1734259307.308084:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50370. 00000400:00000010:0.0:1734259307.308091:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734259307.308097:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098289920, portal 25 00000400:00000010:0.0:1734259307.308101:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734259307.308103:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098289920, offset 0 00000400:00000200:0.0:1734259307.308110:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259307.308122:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259307.308127:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259307.308130:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259307.308133:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259307.308135:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259307.308137:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [997:997:256:4294967295] 192.168.202.108@tcp LPNI seq info [996:996:8:4294967295] 00000400:00000200:0.0:1734259307.308144:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259307.308149:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259307.308152:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734259307.308157:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259307.308164:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259307.308166:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259307.308627:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259307.308630:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:0.0:1734259307.308633:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259307.308637:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259307.308641:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:0.0:1734259307.308642:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734259307.308647:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098289920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259323 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259307.308714:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259307.308719:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259307.308722:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259307.308725:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098290048, portal 10 00000400:00000010:1.0:1734259307.308729:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 00000100:00000200:1.0:1734259307.308730:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098290048, offset 0 00000400:00000200:1.0:1734259307.308733:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259307.308738:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259307.308740:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259307.308742:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259307.308744:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259307.308746:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259307.308747:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [998:998:256:4294967295] 192.168.202.108@tcp LPNI seq info [997:997:8:4294967295] 00000400:00000200:1.0:1734259307.308753:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259307.308756:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259307.308758:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734259307.308761:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259307.308765:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259307.308774:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259307.308871:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259307.308876:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734259307.308879:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259307.308882:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259307.308884:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:0.0:1734259307.308885:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:0.0:1734259307.308889:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098290048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259317 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259307.311444:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259307.311462:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f100 00000400:00000200:0.0:1734259307.311469:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2019 [1] + 224 00000400:00000200:0.0:1734259307.311479:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259307.311482:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259307.311493:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098289920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259323 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259307.311535:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259307.311539:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f180 00000400:00000200:0.0:1734259307.311543:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2021 [1] + 0 00000400:00000200:0.0:1734259307.311558:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259307.311561:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259307.311566:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098290048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259317 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259307.311778:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50370. 00000400:00000200:2.0:1734259307.311784:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:2.0:1734259307.311785:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:2.0:1734259307.311790:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098289920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259323 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259307.311795:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098289920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259323 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259307.311814:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3a600. 02000000:00000010:2.0:1734259307.311818:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259307.311822:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000010:1.0:1734259307.311955:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259307.311958:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259307.311959:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259307.311964:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098290048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259317 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259307.311969:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098290048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259317 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259307.311985:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259307.311988:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259307.311991:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734259312.315682:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259312.315700:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259312.315762:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259312.315768:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259312.315817:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734259312.315824:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d503c8. 00000400:00000010:0.0:1734259312.315829:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734259312.315835:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098290176, portal 25 00000400:00000010:0.0:1734259312.315839:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000100:00000200:0.0:1734259312.315841:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098290176, offset 0 00000400:00000200:0.0:1734259312.315848:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259312.315859:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259312.315863:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259312.315876:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259312.315879:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259312.315881:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259312.315884:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [999:999:256:4294967295] 192.168.202.108@tcp LPNI seq info [998:998:8:4294967295] 00000400:00000200:0.0:1734259312.315891:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259312.315896:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259312.315899:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000800:00000200:0.0:1734259312.315903:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259312.315910:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259312.315913:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259312.316022:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259312.316024:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:2.0:1734259312.316028:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259312.316033:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259312.316036:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:2.0:1734259312.316037:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000100:00000200:2.0:1734259312.316043:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098290176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259328 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259312.316320:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259312.316324:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259312.316328:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259312.316331:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098290304, portal 10 00000400:00000010:1.0:1734259312.316334:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734259312.316336:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098290304, offset 0 00000400:00000200:1.0:1734259312.316340:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259312.316373:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259312.316376:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259312.316378:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259312.316380:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259312.316381:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259312.316384:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1000:1000:256:4294967295] 192.168.202.108@tcp LPNI seq info [999:999:8:4294967295] 00000400:00000200:1.0:1734259312.316390:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259312.316393:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259312.316395:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734259312.316398:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259312.316402:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259312.316404:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259312.317066:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259312.317070:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734259312.317072:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259312.317076:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259312.317079:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:0.0:1734259312.317080:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:0.0:1734259312.317085:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098290304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259322 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259312.319449:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259312.319465:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f200 00000400:00000200:0.0:1734259312.319472:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2029 [1] + 224 00000400:00000200:0.0:1734259312.319481:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259312.319484:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259312.319492:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098290176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259328 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259312.319527:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259312.319531:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f280 00000400:00000200:0.0:1734259312.319535:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2031 [1] + 0 00000400:00000200:0.0:1734259312.319550:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259312.319558:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259312.319562:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098290304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259322 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259312.319751:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d503c8. 00000400:00000200:2.0:1734259312.319756:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:2.0:1734259312.319757:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:2.0:1734259312.319762:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098290176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259328 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259312.319768:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098290176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259328 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259312.319786:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734259312.319794:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259312.319798:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000010:1.0:1734259312.319864:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259312.319867:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259312.319868:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259312.319872:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098290304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259322 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259312.319877:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098290304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259322 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259312.319890:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259312.319893:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259312.319896:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:2.0:1734259317.323711:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259317.323732:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259317.323794:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259317.323803:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259317.323983:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734259317.323991:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50420. 00000400:00000010:0.0:1734259317.323996:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000100:00000200:0.0:1734259317.324003:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098290432, portal 25 00000400:00000010:0.0:1734259317.324008:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734259317.324010:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098290432, offset 0 00000400:00000200:0.0:1734259317.324019:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259317.324032:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259317.324038:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259317.324042:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259317.324045:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259317.324048:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259317.324050:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1001:1001:256:4294967295] 192.168.202.108@tcp LPNI seq info [1000:1000:8:4294967295] 00000400:00000200:0.0:1734259317.324059:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259317.324076:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259317.324080:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734259317.324086:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259317.324094:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259317.324098:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734259317.324177:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259317.324182:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259317.324185:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259317.324187:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098290560, portal 10 00000400:00000010:1.0:1734259317.324191:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:1.0:1734259317.324193:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098290560, offset 0 00000400:00000200:1.0:1734259317.324196:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259317.324200:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259317.324203:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259317.324205:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259317.324207:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259317.324208:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259317.324210:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1002:1002:255:4294967295] 192.168.202.108@tcp LPNI seq info [1001:1001:7:4294967295] 00000400:00000200:1.0:1734259317.324216:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259317.324219:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259317.324221:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734259317.324224:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259317.324227:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259317.324229:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259317.324482:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259317.324484:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:2.0:1734259317.324488:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259317.324493:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259317.324496:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:2.0:1734259317.324498:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:2.0:1734259317.324506:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098290432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259333 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259317.324597:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259317.324598:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:2.0:1734259317.324601:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259317.324604:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259317.324606:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:2.0:1734259317.324607:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:2.0:1734259317.324610:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098290560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259327 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259317.327942:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259317.327963:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f300 00000400:00000200:0.0:1734259317.327972:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2039 [1] + 224 00000400:00000200:0.0:1734259317.327982:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259317.327987:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259317.327998:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098290432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259333 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259317.328060:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259317.328066:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f380 00000400:00000200:0.0:1734259317.328072:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2041 [1] + 0 00000400:00000200:0.0:1734259317.328086:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259317.328088:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259317.328093:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098290560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259327 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259317.328154:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259317.328163:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259317.328165:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259317.328170:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098290560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259327 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259317.328177:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098290560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259327 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259317.328203:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259317.328208:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259317.328212:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000400:00000010:2.0:1734259317.328457:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50420. 00000400:00000200:2.0:1734259317.328461:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:2.0:1734259317.328462:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:2.0:1734259317.328467:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098290432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259333 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259317.328473:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098290432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259333 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259317.328486:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734259317.328489:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259317.328492:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:2.0:1734259322.331744:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259322.331765:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259322.331895:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259322.331902:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259322.331917:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 00000400:00000010:0.0:1734259322.331925:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50478. 00000400:00000010:0.0:1734259322.331933:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734259322.331940:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098290688, portal 25 00000400:00000010:0.0:1734259322.331945:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:0.0:1734259322.331946:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098290688, offset 0 02000000:00000010:1.0:1734259322.331954:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000200:0.0:1734259322.331955:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734259322.331958:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259322.331961:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259322.331963:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098290816, portal 10 00000400:00000010:1.0:1734259322.331966:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734259322.331967:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098290816, offset 0 00000400:00000200:0.0:1734259322.331968:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259322.331971:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259322.331972:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259322.331976:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259322.331979:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259322.331981:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259322.331983:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1003:1003:256:4294967295] 192.168.202.108@tcp LPNI seq info [1002:1002:8:4294967295] 00000400:00000200:0.0:1734259322.331992:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259322.331997:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259322.331997:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259322.331999:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734259322.332001:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734259322.332001:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259322.332002:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259322.332003:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259322.332004:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1004:1004:255:4294967295] 192.168.202.108@tcp LPNI seq info [1003:1003:7:4294967295] 00000800:00000200:0.0:1734259322.332007:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259322.332008:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259322.332010:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259322.332013:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:1.0:1734259322.332013:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734259322.332015:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259322.332017:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259322.332017:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259322.332019:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259322.332112:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259322.332115:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:2.0:1734259322.332119:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259322.332123:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259322.332126:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:2.0:1734259322.332128:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:2.0:1734259322.332135:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098290688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259338 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259322.332200:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259322.332202:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:2.0:1734259322.332205:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259322.332207:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259322.332209:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:2.0:1734259322.332210:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:2.0:1734259322.332214:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098290816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259332 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259322.334283:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259322.334306:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f400 00000400:00000200:0.0:1734259322.334329:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2049 [1] + 224 00000400:00000200:0.0:1734259322.334344:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259322.334347:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259322.334357:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098290688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259338 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259322.334397:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259322.334402:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f480 00000400:00000200:0.0:1734259322.334406:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2051 [1] + 0 00000400:00000200:0.0:1734259322.334419:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259322.334422:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259322.334427:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098290816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259332 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259322.334618:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50478. 00000400:00000200:2.0:1734259322.334642:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:2.0:1734259322.334644:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:2.0:1734259322.334657:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098290688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259338 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259322.334667:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098290688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259338 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259322.334692:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 00000400:00000010:1.0:1734259322.334695:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 02000000:00000010:2.0:1734259322.334698:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000400:00000200:1.0:1734259322.334700:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000100:00000010:2.0:1734259322.334702:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000010:1.0:1734259322.334715:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259322.334720:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098290816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259332 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259322.334727:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098290816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259332 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259322.334747:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259322.334751:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259322.334754:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734259327.339691:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259327.339711:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259327.339774:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259327.339781:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259327.339794:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259327.339803:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259327.339809:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259327.339814:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098290944, portal 25 00000400:00000010:3.0:1734259327.339817:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734259327.339819:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098290944, offset 0 00000400:00000200:3.0:1734259327.339826:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259327.339838:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259327.339842:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259327.339846:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259327.339848:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259327.339850:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259327.339853:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1005:1005:256:4294967295] 192.168.202.108@tcp LPNI seq info [1004:1004:8:4294967295] 00000400:00000200:3.0:1734259327.339859:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259327.339864:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259327.339867:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 02000000:00000010:1.0:1734259327.339907:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259327.339912:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259327.339915:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259327.339917:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098291072, portal 10 00000400:00000010:1.0:1734259327.339921:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734259327.339923:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098291072, offset 0 00000400:00000200:1.0:1734259327.339926:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259327.339931:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259327.339933:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259327.339939:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259327.339941:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259327.339942:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259327.339944:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1006:1006:255:4294967295] 192.168.202.108@tcp LPNI seq info [1005:1005:7:4294967295] 00000800:00000200:3.0:1734259327.339944:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259327.339949:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259327.339951:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259327.339952:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734259327.339954:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:1.0:1734259327.339955:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734259327.339957:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259327.339960:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259327.339961:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259327.340041:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259327.340044:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734259327.340048:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259327.340052:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259327.340055:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:0.0:1734259327.340056:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:0.0:1734259327.340063:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098290944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259343 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259327.340123:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259327.340125:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734259327.340128:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259327.340131:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259327.340132:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:0.0:1734259327.340133:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:0.0:1734259327.340136:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098291072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259337 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259327.342379:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259327.342396:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f500 00000400:00000200:0.0:1734259327.342413:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2059 [1] + 224 00000400:00000200:0.0:1734259327.342428:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259327.342432:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259327.342440:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098290944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259343 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259327.342472:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259327.342476:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f580 00000400:00000200:0.0:1734259327.342480:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2061 [1] + 0 00000400:00000200:0.0:1734259327.342490:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259327.342493:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259327.342498:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098291072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259337 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259327.342505:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259327.342514:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259327.342516:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259327.342521:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098290944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259343 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259327.342527:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098290944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259343 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259327.342546:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259327.342557:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734259327.342561:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000010:1.0:1734259327.342647:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259327.342651:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259327.342652:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259327.342661:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098291072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259337 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259327.342666:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098291072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259337 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259327.342681:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259327.342684:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259327.342687:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259332.347686:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259332.347706:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259332.347765:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259332.347770:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259332.347836:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259332.347843:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259332.347848:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259332.347853:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098291328, portal 10 00000400:00000010:1.0:1734259332.347858:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734259332.347859:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098291328, offset 0 00000400:00000200:1.0:1734259332.347866:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734259332.347874:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000200:1.0:1734259332.347875:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259332.347878:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734259332.347878:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000200:1.0:1734259332.347881:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:3.0:1734259332.347881:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000200:1.0:1734259332.347884:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:3.0:1734259332.347884:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098291200, portal 25 00000400:00000200:1.0:1734259332.347885:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259332.347887:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1007:1007:256:4294967295] 192.168.202.108@tcp LPNI seq info [1006:1006:8:4294967295] 00000400:00000010:3.0:1734259332.347887:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734259332.347888:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098291200, offset 0 00000400:00000200:3.0:1734259332.347892:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259332.347893:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259332.347896:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259332.347897:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259332.347899:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000400:00000200:3.0:1734259332.347900:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259332.347902:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734259332.347903:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259332.347904:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259332.347905:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259332.347907:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1008:1008:255:4294967295] 192.168.202.108@tcp LPNI seq info [1007:1007:7:4294967295] 00000800:00000200:1.0:1734259332.347909:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259332.347911:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734259332.347913:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259332.347916:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259332.347918:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734259332.347921:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259332.347924:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259332.347926:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259332.347958:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259332.347960:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:1.0:1734259332.347963:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259332.347966:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259332.347981:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:1.0:1734259332.347982:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734259332.347988:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098291328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259342 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259332.348219:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259332.348221:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734259332.348224:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259332.348227:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259332.348229:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:1.0:1734259332.348230:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:1.0:1734259332.348234:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098291200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259348 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259332.350212:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259332.350228:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f600 00000400:00000200:0.0:1734259332.350236:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2071 [1] + 224 00000400:00000200:0.0:1734259332.350246:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259332.350249:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259332.350258:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098291200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259348 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259332.350296:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259332.350300:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f680 00000400:00000200:0.0:1734259332.350305:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2069 [1] + 0 00000400:00000200:0.0:1734259332.350321:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259332.350324:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259332.350329:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098291328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259342 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259332.350598:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259332.350602:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259332.350604:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259332.350608:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098291328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259342 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259332.350614:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098291328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259342 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259332.350618:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259332.350621:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259332.350622:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259332.350632:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098291200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259348 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259332.350637:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098291200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259348 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259332.350639:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259332.350643:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259332.350645:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 00000100:00000010:1.0:1734259332.350647:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 02000000:00000010:3.0:1734259332.350648:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734259332.350650:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:2.0:1734259337.355687:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259337.355705:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259337.355762:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734259337.355769:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259337.355857:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259337.355865:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259337.355870:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259337.355875:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098291456, portal 25 00000400:00000010:3.0:1734259337.355879:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734259337.355881:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098291456, offset 0 00000400:00000200:3.0:1734259337.355888:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259337.355898:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259337.355903:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259337.355907:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259337.355909:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259337.355911:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259337.355914:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1009:1009:256:4294967295] 192.168.202.108@tcp LPNI seq info [1008:1008:8:4294967295] 00000400:00000200:3.0:1734259337.355921:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259337.355926:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259337.355929:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734259337.355934:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259337.355940:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259337.355944:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734259337.355991:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259337.355995:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259337.355998:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259337.356000:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098291584, portal 10 00000400:00000010:1.0:1734259337.356004:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734259337.356006:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098291584, offset 0 00000400:00000200:1.0:1734259337.356009:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259337.356014:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259337.356016:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259337.356028:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259337.356030:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259337.356031:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259337.356034:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1010:1010:255:4294967295] 192.168.202.108@tcp LPNI seq info [1009:1009:7:4294967295] 00000400:00000200:1.0:1734259337.356039:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259337.356042:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259337.356045:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734259337.356047:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259337.356050:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259337.356052:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259337.356366:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259337.356373:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734259337.356378:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259337.356382:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259337.356386:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734259337.356387:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734259337.356393:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098291456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259337.356451:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259337.356452:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734259337.356455:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259337.356458:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259337.356460:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:0.0:1734259337.356461:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:0.0:1734259337.356464:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098291584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259347 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259337.358780:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259337.358800:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f700 00000400:00000200:0.0:1734259337.358809:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2079 [1] + 224 00000400:00000200:0.0:1734259337.358821:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259337.358825:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259337.358837:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098291456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259353 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259337.358888:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259337.358893:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f780 00000400:00000200:0.0:1734259337.358897:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2081 [1] + 0 00000400:00000200:0.0:1734259337.358916:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259337.358919:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259337.358924:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098291584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259347 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259337.359180:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259337.359185:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259337.359187:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259337.359192:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098291456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259337.359213:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098291456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259353 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259337.359237:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259337.359243:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734259337.359247:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000400:00000010:1.0:1734259337.359317:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259337.359320:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259337.359331:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259337.359337:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098291584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259347 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259337.359343:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098291584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259347 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259337.359361:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259337.359364:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259337.359367:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734259342.363888:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259342.363911:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259342.363971:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734259342.363978:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259342.364000:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3ae00. 00000400:00000010:0.0:1734259342.364020:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d504d0. 00000400:00000010:0.0:1734259342.364027:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000100:00000200:0.0:1734259342.364035:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098291712, portal 25 02000000:00000010:1.0:1734259342.364037:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:0.0:1734259342.364040:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000100:00000200:0.0:1734259342.364042:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098291712, offset 0 00000400:00000010:1.0:1734259342.364043:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259342.364046:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000200:0.0:1734259342.364053:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:1.0:1734259342.364058:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098291840, portal 10 00000400:00000010:1.0:1734259342.364063:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000100:00000200:1.0:1734259342.364065:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098291840, offset 0 00000400:00000200:0.0:1734259342.364069:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259342.364069:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259342.364075:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259342.364079:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259342.364082:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259342.364085:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259342.364088:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1011:1011:256:4294967295] 192.168.202.108@tcp LPNI seq info [1010:1010:8:4294967295] 00000400:00000200:0.0:1734259342.364096:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259342.364100:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259342.364102:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734259342.364104:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734259342.364104:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259342.364106:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:0.0:1734259342.364110:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259342.364134:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259342.364139:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734259342.364162:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259342.364164:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259342.364165:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1012:1012:255:4294967295] 192.168.202.108@tcp LPNI seq info [1011:1011:7:4294967295] 00000400:00000200:1.0:1734259342.364171:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259342.364174:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259342.364177:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734259342.364180:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259342.364183:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259342.364185:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259342.364263:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259342.364266:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:2.0:1734259342.364271:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259342.364275:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259342.364279:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:2.0:1734259342.364280:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:2.0:1734259342.364288:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098291712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259358 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259342.364503:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259342.364701:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:2.0:1734259342.364704:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259342.364708:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259342.364710:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:2.0:1734259342.364711:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:2.0:1734259342.364715:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098291840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259352 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259342.366540:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259342.366557:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f880 00000400:00000200:0.0:1734259342.366566:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2091 [1] + 0 00000400:00000200:0.0:1734259342.366627:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259342.366631:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259342.366640:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098291840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259352 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259342.366706:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259342.366711:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259342.366712:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259342.366717:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098291840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259352 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259342.366724:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098291840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259352 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259342.366749:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259342.366754:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259342.366759:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000400:00000200:0.0:1734259342.366934:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259342.366940:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f800 00000400:00000200:0.0:1734259342.366945:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2089 [1] + 224 00000400:00000200:0.0:1734259342.366955:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259342.366964:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259342.366969:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098291712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259358 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259342.367065:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d504d0. 00000400:00000200:2.0:1734259342.367068:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:2.0:1734259342.367075:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:2.0:1734259342.367079:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098291712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259358 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259342.367085:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098291712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259358 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259342.367096:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3ae00. 02000000:00000010:2.0:1734259342.367100:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259342.367102:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000100:00000010:2.0:1734259347.372242:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259347.372265:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259347.372335:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259347.372343:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259347.372450:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259347.372457:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259347.372464:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259347.372471:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098291968, portal 25 00000400:00000010:3.0:1734259347.372476:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734259347.372478:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098291968, offset 0 00000400:00000200:3.0:1734259347.372485:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259347.372497:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259347.372502:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259347.372506:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259347.372509:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259347.372511:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259347.372514:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1013:1013:256:4294967295] 192.168.202.108@tcp LPNI seq info [1012:1012:8:4294967295] 00000400:00000200:3.0:1734259347.372521:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259347.372527:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259347.372531:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734259347.372536:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259347.372543:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259347.372547:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734259347.372662:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259347.372667:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259347.372671:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259347.372673:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098292096, portal 10 00000400:00000010:1.0:1734259347.372678:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000100:00000200:1.0:1734259347.372679:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098292096, offset 0 00000400:00000200:1.0:1734259347.372683:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259347.372688:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259347.372690:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259347.372692:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259347.372694:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259347.372708:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259347.372710:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1014:1014:255:4294967295] 192.168.202.108@tcp LPNI seq info [1013:1013:7:4294967295] 00000400:00000200:1.0:1734259347.372716:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259347.372719:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259347.372722:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734259347.372725:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259347.372728:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259347.372730:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259347.372828:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259347.372831:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:2.0:1734259347.372835:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259347.372839:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259347.372843:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:2.0:1734259347.372844:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:2.0:1734259347.372852:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098291968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259363 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259347.372931:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259347.372934:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:2.0:1734259347.372936:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259347.372939:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259347.372941:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:2.0:1734259347.372942:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:2.0:1734259347.372946:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098292096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259357 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259347.374927:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259347.374946:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61f900 00000400:00000200:0.0:1734259347.374954:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2099 [1] + 224 00000400:00000200:0.0:1734259347.374964:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259347.374968:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259347.374977:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098291968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259363 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259347.375018:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259347.375023:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61f980 00000400:00000200:0.0:1734259347.375028:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x20a1 [1] + 0 00000400:00000200:0.0:1734259347.375048:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259347.375050:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259347.375056:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098292096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259357 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259347.375104:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259347.375110:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259347.375112:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259347.375117:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098291968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259363 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259347.375137:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098291968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259363 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259347.375161:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259347.375167:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734259347.375180:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000400:00000010:1.0:1734259347.375238:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259347.375242:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259347.375244:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259347.375249:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098292096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259357 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259347.375255:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098292096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259357 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259347.375272:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259347.375277:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259347.375280:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734259352.380474:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259352.380496:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259352.380553:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259352.380560:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259352.380690:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259352.380697:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259352.380702:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259352.380708:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098292224, portal 25 00000400:00000010:3.0:1734259352.380712:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734259352.380714:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098292224, offset 0 00000400:00000200:3.0:1734259352.380722:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259352.380732:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259352.380736:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259352.380740:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259352.380742:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259352.380744:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259352.380746:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1015:1015:256:4294967295] 192.168.202.108@tcp LPNI seq info [1014:1014:8:4294967295] 00000400:00000200:3.0:1734259352.380753:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259352.380758:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259352.380762:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734259352.380767:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259352.380775:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259352.380779:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734259352.380882:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734259352.380884:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:3.0:1734259352.380887:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734259352.380890:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734259352.380893:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:3.0:1734259352.380898:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734259352.380904:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098292224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259368 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259352.380978:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259352.380982:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259352.380986:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259352.380988:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098292352, portal 10 00000400:00000010:1.0:1734259352.380992:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734259352.380993:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098292352, offset 0 00000400:00000200:1.0:1734259352.380997:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259352.381001:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259352.381003:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259352.381005:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259352.381007:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259352.381008:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259352.381015:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1016:1016:256:4294967295] 192.168.202.108@tcp LPNI seq info [1015:1015:8:4294967295] 00000400:00000200:1.0:1734259352.381021:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259352.381024:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259352.381027:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734259352.381030:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259352.381033:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259352.381061:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259352.381178:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259352.381180:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:2.0:1734259352.381183:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259352.381186:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259352.381188:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:2.0:1734259352.381189:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:2.0:1734259352.381193:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098292352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259362 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259352.382734:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259352.382749:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61fa00 00000400:00000200:0.0:1734259352.382756:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x20a9 [1] + 224 00000400:00000200:0.0:1734259352.382774:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259352.382778:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259352.382785:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098292224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259368 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259352.382866:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259352.382871:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259352.382872:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259352.382878:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098292224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259368 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259352.382884:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098292224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259368 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259352.382904:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259352.382907:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259352.382911:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000200:0.0:1734259352.383291:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259352.383298:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61fa80 00000400:00000200:0.0:1734259352.383303:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x20b1 [1] + 0 00000400:00000200:0.0:1734259352.383322:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259352.383325:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259352.383330:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098292352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259352.383406:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259352.383410:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259352.383411:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259352.383417:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098292352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259362 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259352.383422:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098292352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259362 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259352.383441:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259352.383445:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259352.383449:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000100:00000010:2.0:1734259357.387706:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259357.387726:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259357.387797:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259357.387805:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259357.387880:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259357.387890:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259357.387897:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259357.387903:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098292608, portal 10 00000400:00000010:1.0:1734259357.387908:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734259357.387910:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098292608, offset 0 00000400:00000200:1.0:1734259357.387918:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259357.387929:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259357.387934:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259357.387938:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259357.387941:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259357.387942:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259357.387944:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1017:1017:256:4294967295] 192.168.202.108@tcp LPNI seq info [1016:1016:8:4294967295] 00000400:00000200:1.0:1734259357.387964:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259357.387969:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259357.387973:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734259357.387978:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259357.387985:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259357.387989:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259357.388090:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259357.388095:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259357.388098:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259357.388100:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098292480, portal 25 00000400:00000010:3.0:1734259357.388103:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734259357.388104:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098292480, offset 0 00000400:00000200:3.0:1734259357.388108:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259357.388112:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259357.388114:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259357.388116:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259357.388118:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259357.388119:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259357.388121:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1018:1018:255:4294967295] 192.168.202.108@tcp LPNI seq info [1017:1017:7:4294967295] 00000400:00000200:3.0:1734259357.388127:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259357.388130:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259357.388133:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734259357.388136:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259357.388139:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259357.388152:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259357.388186:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259357.388195:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:2.0:1734259357.388199:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259357.388203:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259357.388207:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:2.0:1734259357.388208:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:2.0:1734259357.388215:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098292608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259367 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259357.388279:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259357.388281:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:2.0:1734259357.388283:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259357.388285:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259357.388287:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:2.0:1734259357.388288:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:2.0:1734259357.388291:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098292480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259373 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259357.390199:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259357.390215:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61fb00 00000400:00000200:0.0:1734259357.390222:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x20c1 [1] + 224 00000400:00000200:0.0:1734259357.390231:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259357.390234:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259357.390242:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098292480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259373 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259357.390383:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259357.390388:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259357.390389:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259357.390394:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098292480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259373 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259357.390401:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098292480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259373 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259357.390419:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259357.390423:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259357.390426:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000200:0.0:1734259357.390485:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259357.390491:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61fb80 00000400:00000200:0.0:1734259357.390495:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x20b9 [1] + 0 00000400:00000200:0.0:1734259357.390509:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259357.390513:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259357.390517:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098292608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259357.390632:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259357.390636:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259357.390637:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259357.390641:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098292608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259367 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259357.390647:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098292608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259367 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:1.0:1734259357.390658:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:1.0:1734259357.390665:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259357.390669:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259357.390672:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:2.0:1734259362.395731:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259362.395754:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259362.395813:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259362.395820:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259362.395837:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3be00. 00000400:00000010:0.0:1734259362.395845:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50528. 00000400:00000010:0.0:1734259362.395851:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734259362.395857:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098292736, portal 25 00000400:00000010:0.0:1734259362.395861:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:0.0:1734259362.395863:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098292736, offset 0 00000400:00000200:0.0:1734259362.395870:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259362.395881:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259362.395885:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259362.395888:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259362.395890:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259362.395895:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:1.0:1734259362.395895:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000200:0.0:1734259362.395898:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1019:1019:256:4294967295] 192.168.202.108@tcp LPNI seq info [1018:1018:8:4294967295] 00000400:00000010:1.0:1734259362.395899:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259362.395902:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000200:0.0:1734259362.395903:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:1.0:1734259362.395904:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098292864, portal 10 00000800:00000200:0.0:1734259362.395907:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734259362.395907:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734259362.395908:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098292864, offset 0 00000800:00000010:0.0:1734259362.395910:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734259362.395912:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259362.395914:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259362.395916:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259362.395917:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259362.395919:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:0.0:1734259362.395920:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734259362.395920:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259362.395921:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734259362.395923:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734259362.395923:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1020:1020:255:4294967295] 192.168.202.108@tcp LPNI seq info [1019:1019:7:4294967295] 00000400:00000200:1.0:1734259362.395931:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259362.395934:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259362.395936:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734259362.395938:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259362.395941:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259362.395942:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259362.396016:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259362.396018:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:2.0:1734259362.396023:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259362.396026:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259362.396029:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:2.0:1734259362.396030:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:2.0:1734259362.396037:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098292736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259378 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259362.396103:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259362.396105:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:2.0:1734259362.396107:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259362.396110:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259362.396112:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:2.0:1734259362.396113:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:2.0:1734259362.396116:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098292864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259372 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259362.398104:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259362.398121:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61fc00 00000400:00000200:0.0:1734259362.398128:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x20c9 [1] + 224 00000400:00000200:0.0:1734259362.398139:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259362.398143:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259362.398152:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098292736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259378 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259362.398188:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259362.398193:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61fc80 00000400:00000200:0.0:1734259362.398197:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x20d1 [1] + 0 00000400:00000200:0.0:1734259362.398212:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259362.398215:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259362.398220:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098292864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259372 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259362.398292:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259362.398296:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259362.398298:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259362.398303:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098292864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259372 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259362.398309:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098292864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259372 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259362.398309:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50528. 00000400:00000200:2.0:1734259362.398314:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:2.0:1734259362.398316:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:2.0:1734259362.398322:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098292736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259378 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259362.398328:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098292736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259378 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259362.398343:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:2.0:1734259362.398344:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3be00. 02000000:00000010:1.0:1734259362.398350:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259362.398350:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:1.0:1734259362.398355:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734259362.398355:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734259367.403815:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259367.403846:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259367.403913:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259367.403959:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259367.404075:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259367.404085:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259367.404092:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259367.404100:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098292992, portal 25 00000400:00000010:3.0:1734259367.404104:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734259367.404106:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098292992, offset 0 00000400:00000200:3.0:1734259367.404113:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259367.404127:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259367.404132:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259367.404135:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259367.404138:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259367.404140:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259367.404143:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1021:1021:256:4294967295] 192.168.202.108@tcp LPNI seq info [1020:1020:8:4294967295] 00000400:00000200:3.0:1734259367.404151:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259367.404157:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259367.404160:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734259367.404166:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259367.404174:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259367.404178:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734259367.404276:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259367.404282:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259367.404286:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259367.404289:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098293120, portal 10 00000400:00000010:1.0:1734259367.404293:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:1.0:1734259367.404295:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098293120, offset 0 00000400:00000200:1.0:1734259367.404299:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259367.404304:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259367.404306:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259367.404308:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259367.404310:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259367.404311:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259367.404314:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1022:1022:255:4294967295] 192.168.202.108@tcp LPNI seq info [1021:1021:7:4294967295] 00000400:00000200:1.0:1734259367.404320:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259367.404330:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259367.404333:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734259367.404335:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259367.404339:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259367.404341:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259367.404387:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259367.404389:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734259367.404392:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259367.404396:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259367.404400:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:0.0:1734259367.404401:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:0.0:1734259367.404412:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098292992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259383 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259367.404440:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259367.404442:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734259367.404444:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259367.404447:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259367.404448:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:0.0:1734259367.404449:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:0.0:1734259367.404452:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098293120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259377 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259367.407857:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259367.407880:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61fd00 00000400:00000200:0.0:1734259367.407889:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x20d9 [1] + 224 00000400:00000200:0.0:1734259367.407899:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259367.407903:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259367.407913:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098292992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259383 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259367.407956:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259367.407961:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61fd80 00000400:00000200:0.0:1734259367.407965:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x20e1 [1] + 0 00000400:00000200:0.0:1734259367.407979:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259367.407982:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259367.407986:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098293120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259377 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259367.408187:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259367.408194:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259367.408196:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259367.408203:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098292992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259383 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259367.408210:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098292992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259383 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259367.408238:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259367.408243:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259367.408248:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000400:00000010:1.0:1734259367.408326:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259367.408330:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259367.408331:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259367.408335:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098293120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259377 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259367.408339:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098293120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259377 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259367.408354:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259367.408357:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259367.408359:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:2.0:1734259372.411709:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259372.411729:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259372.411789:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259372.411794:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259372.411858:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3ae00. 00000400:00000010:0.0:1734259372.411872:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50580. 00000400:00000010:0.0:1734259372.411911:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734259372.411921:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098293248, portal 25 00000400:00000010:0.0:1734259372.411927:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734259372.411938:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098293248, offset 0 00000400:00000200:0.0:1734259372.411949:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259372.411965:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259372.411971:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259372.411975:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259372.411978:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259372.411981:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259372.411989:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1023:1023:256:4294967295] 192.168.202.108@tcp LPNI seq info [1022:1022:8:4294967295] 00000400:00000200:0.0:1734259372.411998:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259372.412004:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259372.412009:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734259372.412016:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259372.412030:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259372.412035:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259372.412216:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259372.412220:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:2.0:1734259372.412224:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259372.412229:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259372.412234:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:2.0:1734259372.412236:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:2.0:1734259372.412242:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098293248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259388 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259372.412358:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259372.412365:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259372.412371:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259372.412377:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098293376, portal 10 00000400:00000010:1.0:1734259372.412382:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734259372.412384:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098293376, offset 0 00000400:00000200:1.0:1734259372.412393:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259372.412407:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259372.412412:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259372.412416:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259372.412418:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259372.412420:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259372.412422:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1024:1024:256:4294967295] 192.168.202.108@tcp LPNI seq info [1023:1023:8:4294967295] 00000400:00000200:1.0:1734259372.412430:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259372.412435:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259372.412446:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734259372.412452:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259372.412458:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259372.412462:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259372.413153:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259372.413157:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734259372.413160:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259372.413164:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259372.413168:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:0.0:1734259372.413169:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:0.0:1734259372.413176:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098293376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259382 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259372.416092:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259372.416114:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61fe00 00000400:00000200:0.0:1734259372.416124:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x20e9 [1] + 224 00000400:00000200:0.0:1734259372.416151:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259372.416156:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259372.416168:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098293248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259388 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259372.417000:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259372.417019:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61fe80 00000400:00000200:0.0:1734259372.417024:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x20f1 [1] + 0 00000400:00000200:0.0:1734259372.417036:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:2.0:1734259372.417345:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50580. 00000400:00000200:2.0:1734259372.417352:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:2.0:1734259372.417355:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:2.0:1734259372.417364:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098293248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259388 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259372.417373:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098293248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259388 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259372.417399:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3ae00. 02000000:00000010:2.0:1734259372.417405:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259372.417410:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000400:00000200:0.0:1734259372.417676:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259372.417684:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098293376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259372.417967:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259372.417971:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259372.417973:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259372.417978:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098293376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259382 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259372.417984:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098293376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259382 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259372.418004:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259372.418008:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259372.418012:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:2.0:1734259377.419687:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259377.419707:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259377.419802:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259377.419811:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259377.419920:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259377.419928:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259377.419934:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259377.419939:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098293504, portal 25 00000400:00000010:3.0:1734259377.419943:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734259377.419945:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098293504, offset 0 00000400:00000200:3.0:1734259377.419952:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259377.419963:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259377.419968:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:1.0:1734259377.419969:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000200:3.0:1734259377.419971:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:1.0:1734259377.419973:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000200:3.0:1734259377.419974:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:1.0:1734259377.419976:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000200:3.0:1734259377.419976:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259377.419978:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1025:1025:256:4294967295] 192.168.202.108@tcp LPNI seq info [1024:1024:8:4294967295] 00000100:00000200:1.0:1734259377.419979:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098293632, portal 10 00000400:00000010:1.0:1734259377.419983:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 00000100:00000200:1.0:1734259377.419984:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098293632, offset 0 00000400:00000200:3.0:1734259377.419985:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734259377.419988:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734259377.419991:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259377.419993:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259377.419994:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734259377.419995:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259377.419997:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259377.419999:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259377.419999:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259377.420001:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259377.420002:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1026:1026:255:4294967295] 192.168.202.108@tcp LPNI seq info [1025:1025:7:4294967295] 00000800:00000200:3.0:1734259377.420006:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734259377.420008:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259377.420009:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259377.420011:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259377.420014:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734259377.420026:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259377.420029:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259377.420031:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259377.420321:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259377.420325:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:2.0:1734259377.420329:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259377.420333:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259377.420336:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:2.0:1734259377.420337:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:2.0:1734259377.420344:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098293504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259393 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259377.420405:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259377.420407:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:2.0:1734259377.420409:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259377.420412:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259377.420414:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:2.0:1734259377.420415:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:2.0:1734259377.420418:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098293632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259387 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259377.422347:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259377.422363:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c61ff00 00000400:00000200:0.0:1734259377.422371:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x20f9 [1] + 224 00000400:00000200:0.0:1734259377.422389:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259377.422394:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259377.422403:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098293504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259393 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259377.422478:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259377.422490:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259377.422492:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259377.422497:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098293504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259393 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259377.422503:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098293504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259393 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259377.422524:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259377.422529:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734259377.422533:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000400:00000200:0.0:1734259377.423613:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259377.423624:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c61ff80 00000400:00000200:0.0:1734259377.423631:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2101 [1] + 0 00000400:00000200:0.0:1734259377.423646:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259377.423649:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259377.423656:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098293632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259387 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259377.425148:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259377.425159:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259377.425162:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259377.425171:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098293632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259387 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259377.425179:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098293632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259387 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259377.425202:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259377.425207:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259377.425211:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259382.427691:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259382.427711:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259382.427763:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259382.427769:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259382.427779:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 00000400:00000010:0.0:1734259382.427786:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d505d8. 00000400:00000010:0.0:1734259382.427791:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734259382.427797:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098293760, portal 25 00000400:00000010:0.0:1734259382.427800:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000100:00000200:0.0:1734259382.427802:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098293760, offset 0 00000400:00000200:0.0:1734259382.427821:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259382.427833:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259382.427847:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259382.427851:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259382.427853:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259382.427855:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259382.427857:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1027:1027:256:4294967295] 192.168.202.108@tcp LPNI seq info [1026:1026:8:4294967295] 00000400:00000200:0.0:1734259382.427865:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259382.427869:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259382.427872:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734259382.427876:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:1.0:1734259382.427877:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000800:00000200:0.0:1734259382.427882:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:1.0:1734259382.427883:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000800:00000200:0.0:1734259382.427885:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:1.0:1734259382.427886:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259382.427888:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098293888, portal 10 00000400:00000010:1.0:1734259382.427892:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734259382.427894:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098293888, offset 0 00000400:00000200:1.0:1734259382.427898:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259382.427903:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259382.427905:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259382.427907:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259382.427909:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259382.427911:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259382.427913:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1028:1028:255:4294967295] 192.168.202.108@tcp LPNI seq info [1027:1027:7:4294967295] 00000400:00000200:1.0:1734259382.427918:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259382.427922:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259382.427924:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734259382.427927:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259382.427936:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259382.427938:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259382.427947:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259382.427950:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:2.0:1734259382.427954:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259382.427961:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259382.427965:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:2.0:1734259382.427966:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:2.0:1734259382.427973:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098293760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259398 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259382.428035:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259382.428037:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:2.0:1734259382.428040:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259382.428043:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259382.428045:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:2.0:1734259382.428046:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:2.0:1734259382.428049:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098293888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259392 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259382.429842:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259382.429856:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620000 00000400:00000200:0.0:1734259382.429862:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2109 [1] + 224 00000400:00000200:0.0:1734259382.429881:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259382.429884:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259382.429893:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098293760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259398 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259382.430073:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d505d8. 00000400:00000200:2.0:1734259382.430078:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:2.0:1734259382.430079:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:2.0:1734259382.430091:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098293760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259398 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259382.430097:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098293760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259398 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259382.430117:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 02000000:00000010:2.0:1734259382.430121:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259382.430125:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000400:00000200:0.0:1734259382.432392:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259382.432408:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620080 00000400:00000200:0.0:1734259382.432415:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2111 [1] + 0 00000400:00000200:0.0:1734259382.432435:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259382.432439:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259382.432448:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098293888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259392 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259382.432636:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259382.432641:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259382.432643:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259382.432648:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098293888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259392 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259382.432654:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098293888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259392 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259382.432676:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259382.432681:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259382.432685:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734259387.435714:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259387.435740:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259387.435839:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259387.435848:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259387.435849:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259387.435858:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259387.435867:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259387.435875:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098294016, portal 25 00000400:00000010:3.0:1734259387.435879:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734259387.435881:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098294016, offset 0 00000400:00000200:3.0:1734259387.435890:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259387.435906:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259387.435912:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259387.435916:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259387.435920:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259387.435922:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259387.435925:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1029:1029:256:4294967295] 192.168.202.108@tcp LPNI seq info [1028:1028:8:4294967295] 00000400:00000200:3.0:1734259387.435935:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259387.435940:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259387.435944:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734259387.435951:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:1.0:1734259387.435958:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000800:00000200:3.0:1734259387.435960:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:1.0:1734259387.435963:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000800:00000200:3.0:1734259387.435963:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:1.0:1734259387.435967:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259387.435969:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098294144, portal 10 00000400:00000010:1.0:1734259387.435975:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734259387.435976:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098294144, offset 0 00000400:00000200:1.0:1734259387.435981:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259387.435985:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259387.435988:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259387.435990:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259387.435992:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259387.435995:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259387.435997:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1030:1030:255:4294967295] 192.168.202.108@tcp LPNI seq info [1029:1029:7:4294967295] 00000400:00000200:1.0:1734259387.436003:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259387.436007:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259387.436010:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734259387.436013:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259387.436016:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259387.436036:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259387.436069:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259387.436072:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:2.0:1734259387.436078:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259387.436082:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259387.436086:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:2.0:1734259387.436087:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:2.0:1734259387.436095:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098294016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259403 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259387.436182:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259387.436185:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:2.0:1734259387.436187:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259387.436190:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259387.436192:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:2.0:1734259387.436193:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:2.0:1734259387.436197:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098294144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259387.438327:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259387.438345:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620100 00000400:00000200:0.0:1734259387.438352:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2119 [1] + 224 00000400:00000200:0.0:1734259387.438374:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259387.438376:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259387.438390:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098294016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259403 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259387.438564:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259387.438610:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620180 00000400:00000200:0.0:1734259387.438615:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2121 [1] + 0 00000400:00000200:0.0:1734259387.438630:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259387.438633:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259387.438639:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098294144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259397 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259387.438703:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259387.438708:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259387.438709:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259387.438715:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098294144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259387.438722:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098294144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259397 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259387.438723:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259387.438726:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259387.438728:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259387.438737:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098294016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259403 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259387.438743:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098294016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259403 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259387.438748:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259387.438754:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259387.438755:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259387.438758:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259387.438759:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:3.0:1734259387.438760:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000100:00000010:2.0:1734259392.443702:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259392.443722:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 02000000:00000010:0.0:1734259392.445414:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734259392.445428:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509f8. 00000400:00000010:0.0:1734259392.445435:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000100:00000200:0.0:1734259392.445443:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098294272, portal 25 00000400:00000010:0.0:1734259392.445447:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734259392.445450:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098294272, offset 0 00000400:00000200:0.0:1734259392.445459:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259392.445473:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259392.445480:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259392.445483:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259392.445487:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259392.445489:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259392.445492:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1031:1031:256:4294967295] 192.168.202.108@tcp LPNI seq info [1030:1030:8:4294967295] 00000400:00000200:0.0:1734259392.445500:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259392.445505:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259392.445509:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734259392.445516:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259392.445526:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259392.445545:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:2.0:1734259392.446303:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259392.446321:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259392.446390:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734259392.446394:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509a0. 00000400:00000010:0.0:1734259392.446398:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734259392.446401:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098294400, portal 10 00000400:00000010:0.0:1734259392.446405:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:0.0:1734259392.446407:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098294400, offset 0 00000400:00000200:0.0:1734259392.446412:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259392.446417:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259392.446421:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259392.446423:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259392.446425:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259392.446426:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259392.446428:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1032:1032:255:4294967295] 192.168.202.108@tcp LPNI seq info [1031:1031:7:4294967295] 00000400:00000200:0.0:1734259392.446433:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259392.446437:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259392.446439:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734259392.446442:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259392.446446:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259392.446449:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259392.446529:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259392.446532:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734259392.446536:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259392.446540:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259392.446544:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:1.0:1734259392.446545:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:1.0:1734259392.446553:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098294272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259408 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259392.446699:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259392.446702:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:1.0:1734259392.446704:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259392.446707:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259392.446709:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:1.0:1734259392.446711:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:1.0:1734259392.446714:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098294400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259402 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259392.448849:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259392.448866:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620200 00000400:00000200:0.0:1734259392.448876:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2129 [1] + 224 00000400:00000200:0.0:1734259392.448898:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259392.448902:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259392.448913:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098294272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259408 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259392.449059:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509f8. 00000400:00000200:2.0:1734259392.449064:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:2.0:1734259392.449066:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:2.0:1734259392.449071:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098294272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259408 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259392.449076:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098294272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259408 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259392.449099:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734259392.449104:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259392.449108:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000400:00000200:0.0:1734259392.449435:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259392.449441:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620280 00000400:00000200:0.0:1734259392.449454:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2131 [1] + 0 00000400:00000200:0.0:1734259392.449465:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259392.449468:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259392.449475:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098294400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259402 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259392.449557:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509a0. 00000400:00000200:2.0:1734259392.449560:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:2.0:1734259392.449561:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:2.0:1734259392.449566:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098294400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259402 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259392.449597:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098294400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259402 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259392.449617:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734259392.449620:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259392.449623:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734259397.451841:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259397.451864:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259397.451923:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259397.451930:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259397.451965:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259397.451967:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3be00. 00000400:00000010:0.0:1734259397.451973:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50948. 00000400:00000010:2.0:1734259397.451973:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cf78. 00000400:00000010:0.0:1734259397.451978:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000400:00000010:2.0:1734259397.451978:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734259397.451984:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098294528, portal 25 00000400:00000010:0.0:1734259397.451988:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000100:00000200:0.0:1734259397.451992:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098294528, offset 0 00000100:00000200:2.0:1734259397.451992:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098294656, portal 10 00000400:00000010:2.0:1734259397.451996:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000400:00000200:0.0:1734259397.452000:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259397.452006:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098294656, offset 0 00000400:00000200:2.0:1734259397.452010:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259397.452011:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259397.452016:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259397.452020:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259397.452023:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259397.452025:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259397.452028:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1033:1033:256:4294967295] 192.168.202.108@tcp LPNI seq info [1032:1032:8:4294967295] 00000400:00000200:0.0:1734259397.452035:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259397.452040:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259397.452041:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734259397.452042:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000400:00000200:2.0:1734259397.452043:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259397.452045:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259397.452047:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259397.452048:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734259397.452049:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259397.452051:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1034:1034:255:4294967295] 192.168.202.108@tcp LPNI seq info [1033:1033:7:4294967295] 00000800:00000200:0.0:1734259397.452057:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259397.452057:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259397.452060:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259397.452061:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:2.0:1734259397.452063:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259397.452065:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259397.452068:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259397.452071:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259397.452165:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259397.452168:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734259397.452172:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259397.452176:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259397.452180:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:1.0:1734259397.452186:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:1.0:1734259397.452197:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098294528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259413 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259397.452265:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259397.452267:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734259397.452270:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259397.452272:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259397.452274:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:1.0:1734259397.452275:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:1.0:1734259397.452278:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098294656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259407 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259397.454013:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259397.454029:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620300 00000400:00000200:0.0:1734259397.454038:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2139 [1] + 224 00000400:00000200:0.0:1734259397.454047:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259397.454050:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259397.454071:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098294528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259413 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259397.454110:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259397.454114:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620380 00000400:00000200:0.0:1734259397.454119:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x213d [1] + 0 00000400:00000200:0.0:1734259397.454131:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259397.454134:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259397.454139:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098294656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259407 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259397.454144:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50948. 00000400:00000200:2.0:1734259397.454149:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:2.0:1734259397.454151:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:2.0:1734259397.454156:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098294528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259413 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259397.454162:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098294528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259413 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259397.454183:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3be00. 02000000:00000010:2.0:1734259397.454187:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259397.454191:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000400:00000010:3.0:1734259397.454245:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cf78. 00000400:00000200:3.0:1734259397.454249:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:3.0:1734259397.454251:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:3.0:1734259397.454255:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098294656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259407 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259397.454261:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098294656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259407 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259397.454276:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259397.454280:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259397.454282:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000100:00000010:2.0:1734259402.460002:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259402.460027:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259402.460108:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259402.460117:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259402.460164:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259402.460172:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734259402.460178:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259402.460187:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098294912, portal 10 00000400:00000010:2.0:1734259402.460208:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734259402.460210:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098294912, offset 0 00000400:00000200:2.0:1734259402.460220:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259402.460233:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259402.460239:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259402.460243:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259402.460246:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259402.460249:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259402.460252:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1035:1035:256:4294967295] 192.168.202.108@tcp LPNI seq info [1034:1034:8:4294967295] 00000400:00000200:2.0:1734259402.460261:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259402.460267:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259402.460270:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259402.460276:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259402.460285:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259402.460290:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259402.460409:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259402.460414:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259402.460418:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259402.460420:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098294784, portal 25 00000400:00000010:3.0:1734259402.460423:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734259402.460424:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098294784, offset 0 00000400:00000200:3.0:1734259402.460428:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259402.460432:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259402.460435:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259402.460437:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259402.460439:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259402.460440:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259402.460443:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1036:1036:255:4294967295] 192.168.202.108@tcp LPNI seq info [1035:1035:7:4294967295] 00000400:00000200:3.0:1734259402.460449:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259402.460458:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259402.460460:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734259402.460463:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259402.460466:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259402.460469:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259402.460695:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259402.460703:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734259402.460709:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259402.460717:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259402.460722:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:1.0:1734259402.460724:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:1.0:1734259402.460733:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098294912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259412 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259402.460818:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259402.460821:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:1.0:1734259402.460824:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259402.460827:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259402.460830:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:1.0:1734259402.460831:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:1.0:1734259402.460837:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098294784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259418 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259402.465627:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259402.465647:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620480 00000400:00000200:0.0:1734259402.465671:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2149 [1] + 0 00000400:00000200:0.0:1734259402.465684:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259402.465688:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259402.465697:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098294912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259412 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259402.465738:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259402.465743:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620400 00000400:00000200:0.0:1734259402.465748:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2151 [1] + 224 00000400:00000200:0.0:1734259402.465766:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259402.465770:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259402.465777:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098294784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259418 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259402.465978:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259402.465989:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259402.465991:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259402.466001:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098294784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259418 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259402.466011:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098294784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259418 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259402.466038:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259402.466044:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734259402.466049:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000400:00000010:2.0:1734259402.466065:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734259402.466071:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:2.0:1734259402.466073:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259402.466079:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098294912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259412 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259402.466086:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098294912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259412 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259402.466114:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259402.466120:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259402.466124:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734259407.467718:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259407.467738:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259407.467796:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259407.467802:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259407.467827:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259407.467828:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259407.467836:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259407.467841:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:3.0:1734259407.467841:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259407.467846:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098295040, portal 25 00000400:00000010:2.0:1734259407.467847:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259407.467849:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098295168, portal 10 00000400:00000010:3.0:1734259407.467850:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734259407.467851:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098295040, offset 0 00000400:00000010:2.0:1734259407.467853:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000400:00000200:3.0:1734259407.467859:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259407.467867:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098295168, offset 0 00000400:00000200:3.0:1734259407.467868:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259407.467873:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259407.467875:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259407.467876:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259407.467879:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259407.467881:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259407.467883:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1037:1037:256:4294967295] 192.168.202.108@tcp LPNI seq info [1036:1036:8:4294967295] 00000400:00000200:3.0:1734259407.467890:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259407.467895:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259407.467896:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259407.467898:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259407.467900:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259407.467902:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259407.467903:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000010:3.0:1734259407.467904:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000400:00000200:2.0:1734259407.467905:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1038:1038:255:4294967295] 192.168.202.108@tcp LPNI seq info [1037:1037:7:4294967295] 00000800:00000200:3.0:1734259407.467909:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259407.467911:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259407.467915:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734259407.467916:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:2.0:1734259407.467917:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:3.0:1734259407.467919:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259407.467920:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259407.467924:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259407.467926:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259407.467983:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259407.467986:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734259407.467989:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259407.467992:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259407.467996:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734259407.468001:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734259407.468007:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098295040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259423 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259407.468056:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259407.468058:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259407.468059:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259407.468061:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259407.468062:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734259407.468063:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734259407.468066:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098295168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259417 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259407.470109:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259407.470123:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620500 00000400:00000200:0.0:1734259407.470129:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2159 [1] + 224 00000400:00000200:0.0:1734259407.470138:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259407.470141:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259407.470148:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098295040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259423 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259407.470178:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259407.470182:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620580 00000400:00000200:0.0:1734259407.470186:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x215d [1] + 0 00000400:00000200:0.0:1734259407.470199:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259407.470201:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259407.470205:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098295168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259417 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259407.470500:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259407.470505:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259407.470506:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259407.470511:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098295040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259423 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259407.470518:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098295040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259423 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259407.470536:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259407.470541:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259407.470544:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000400:00000010:2.0:1734259407.470590:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734259407.470593:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:2.0:1734259407.470595:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259407.470599:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098295168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259417 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259407.470608:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098295168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259417 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259407.470636:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259407.470639:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259407.470641:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259412.475821:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259412.475953:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259412.476458:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259412.476464:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259412.476498:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259412.476505:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734259412.476511:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259412.476516:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098295424, portal 10 00000400:00000010:2.0:1734259412.476522:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734259412.476524:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098295424, offset 0 00000400:00000200:2.0:1734259412.476535:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259412.476548:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259412.476553:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259412.476557:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259412.476559:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259412.476562:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259412.476564:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1039:1039:256:4294967295] 192.168.202.108@tcp LPNI seq info [1038:1038:8:4294967295] 00000400:00000200:2.0:1734259412.476621:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259412.476627:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259412.476630:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259412.476635:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259412.476641:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259412.476645:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259412.476863:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259412.476868:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259412.476871:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259412.476873:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098295296, portal 25 00000400:00000010:3.0:1734259412.476876:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259412.476877:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098295296, offset 0 00000400:00000200:3.0:1734259412.476881:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259412.476885:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259412.476887:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259412.476889:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259412.476891:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259412.476892:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259412.476894:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1040:1040:255:4294967295] 192.168.202.108@tcp LPNI seq info [1039:1039:7:4294967295] 00000400:00000200:3.0:1734259412.476899:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259412.476902:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259412.476904:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734259412.476913:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259412.476916:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259412.476918:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259412.477060:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259412.477065:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259412.477070:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259412.477075:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259412.477079:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:1.0:1734259412.477085:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:1.0:1734259412.477095:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098295424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259422 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259412.477166:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259412.477168:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:1.0:1734259412.477170:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259412.477172:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259412.477174:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:1.0:1734259412.477175:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734259412.477179:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098295296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259428 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259412.479390:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259412.479410:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620600 00000400:00000200:0.0:1734259412.479420:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2171 [1] + 224 00000400:00000200:0.0:1734259412.479431:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259412.479448:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259412.479460:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098295296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259428 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259412.479502:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259412.479507:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620680 00000400:00000200:0.0:1734259412.479512:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2169 [1] + 0 00000400:00000200:0.0:1734259412.479528:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259412.479531:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259412.479536:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098295424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259412.479626:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259412.479632:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259412.479633:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000400:00000010:2.0:1734259412.479638:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000100:00000200:3.0:1734259412.479638:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098295296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259428 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734259412.479642:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:2.0:1734259412.479644:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:3.0:1734259412.479644:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098295296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259428 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259412.479650:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098295424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259422 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259412.479657:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098295424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259422 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259412.479668:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259412.479673:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 02000000:00000010:2.0:1734259412.479675:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734259412.479677:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259412.479680:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259412.479687:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734259417.484022:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259417.484043:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259417.484104:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259417.484111:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259417.484148:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259417.484154:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734259417.484161:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259417.484167:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098295680, portal 10 00000400:00000010:2.0:1734259417.484173:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734259417.484175:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098295680, offset 0 00000400:00000200:2.0:1734259417.484183:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259417.484198:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259417.484203:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259417.484207:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259417.484210:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259417.484212:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:3.0:1734259417.484219:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259417.484224:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259417.484227:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259417.484229:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098295552, portal 25 00000400:00000010:3.0:1734259417.484231:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734259417.484232:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098295552, offset 0 00000400:00000200:3.0:1734259417.484236:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259417.484385:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1041:1041:256:4294967295] 192.168.202.108@tcp LPNI seq info [1040:1040:8:4294967295] 00000400:00000200:2.0:1734259417.484394:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259417.484399:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259417.484400:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259417.484402:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734259417.484403:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734259417.484404:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259417.484405:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259417.484407:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734259417.484408:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259417.484409:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1042:1042:255:4294967295] 192.168.202.108@tcp LPNI seq info [1041:1041:7:4294967295] 00000400:00000200:3.0:1734259417.484413:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259417.484415:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259417.484416:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259417.484418:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:2.0:1734259417.484419:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734259417.484421:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259417.484435:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259417.484437:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259417.484520:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259417.484524:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259417.484528:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259417.484531:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259417.484534:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734259417.484557:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734259417.484564:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098295680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259427 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259417.484643:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259417.484644:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734259417.484646:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259417.484648:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259417.484649:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734259417.484649:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734259417.484651:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098295552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259433 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259417.486551:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259417.486589:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620780 00000400:00000200:0.0:1734259417.486596:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2179 [1] + 0 00000400:00000200:0.0:1734259417.486606:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259417.486618:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259417.486627:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098295680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259427 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259417.486663:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259417.486667:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620700 00000400:00000200:0.0:1734259417.486671:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2181 [1] + 224 00000400:00000200:0.0:1734259417.486684:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259417.486687:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259417.486692:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098295552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259433 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259417.486815:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259417.486819:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259417.486821:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259417.486825:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098295552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259433 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259417.486826:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734259417.486831:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:2.0:1734259417.486832:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:3.0:1734259417.486832:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098295552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259433 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259417.486837:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098295680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259427 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259417.486844:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098295680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259427 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259417.486850:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259417.486855:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734259417.486859:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259417.486865:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259417.486869:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259417.486871:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:2.0:1734259422.492759:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259422.492779:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259422.492964:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259422.492971:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259422.493003:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259422.493009:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:2.0:1734259422.493014:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259422.493021:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098295936, portal 10 00000400:00000010:2.0:1734259422.493027:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734259422.493029:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098295936, offset 0 00000400:00000200:2.0:1734259422.493037:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259422.493048:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259422.493053:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259422.493056:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259422.493059:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259422.493061:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259422.493063:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1043:1043:256:4294967295] 192.168.202.108@tcp LPNI seq info [1042:1042:8:4294967295] 00000400:00000200:2.0:1734259422.493071:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259422.493076:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259422.493080:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259422.493085:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259422.493091:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259422.493094:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259422.493180:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259422.493185:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259422.493187:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259422.493190:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098295808, portal 25 00000400:00000010:3.0:1734259422.493192:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734259422.493194:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098295808, offset 0 00000400:00000200:3.0:1734259422.493198:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259422.493202:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259422.493204:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259422.493206:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259422.493207:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259422.493209:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259422.493211:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1044:1044:255:4294967295] 192.168.202.108@tcp LPNI seq info [1043:1043:7:4294967295] 00000400:00000200:3.0:1734259422.493216:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259422.493220:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259422.493222:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734259422.493224:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259422.493227:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259422.493238:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259422.493616:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259422.493619:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259422.493624:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259422.493628:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259422.493631:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:1.0:1734259422.493633:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:1.0:1734259422.493638:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098295936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259432 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259422.493913:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259422.493916:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734259422.493919:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259422.493922:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259422.493925:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:1.0:1734259422.493926:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:1.0:1734259422.493929:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098295808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259438 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259422.496256:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259422.496272:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620880 00000400:00000200:0.0:1734259422.496280:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2189 [1] + 0 00000400:00000200:0.0:1734259422.496289:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259422.496292:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259422.496301:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098295936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259432 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259422.496338:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259422.496342:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620800 00000400:00000200:0.0:1734259422.496346:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2191 [1] + 224 00000400:00000200:0.0:1734259422.496360:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259422.496363:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259422.496367:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098295808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259438 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259422.496490:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:2.0:1734259422.496495:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:2.0:1734259422.496507:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259422.496520:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098295936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259432 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259422.496528:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098295936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259432 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259422.496533:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259422.496537:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259422.496538:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259422.496541:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098295808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259438 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259422.496546:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098295808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259438 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259422.496552:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259422.496554:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:2.0:1734259422.496557:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259422.496557:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259422.496561:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:3.0:1734259422.496561:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:2.0:1734259427.499730:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259427.499758:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259427.499824:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259427.499831:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259427.499878:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259427.499880:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3ae00. 00000400:00000010:0.0:1734259427.499886:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d508f0. 00000400:00000010:2.0:1734259427.499886:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cec8. 00000400:00000010:0.0:1734259427.499893:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000400:00000010:2.0:1734259427.499893:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259427.499901:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098296192, portal 10 00000100:00000200:0.0:1734259427.499904:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098296064, portal 25 00000400:00000010:2.0:1734259427.499907:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734259427.499910:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098296192, offset 0 00000400:00000200:2.0:1734259427.499920:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:0.0:1734259427.499924:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000100:00000200:0.0:1734259427.499926:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098296064, offset 0 00000400:00000200:0.0:1734259427.499930:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259427.499937:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259427.499944:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259427.499948:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259427.499952:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259427.499954:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259427.499956:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1045:1045:256:4294967295] 192.168.202.108@tcp LPNI seq info [1044:1044:8:4294967295] 00000400:00000200:2.0:1734259427.499966:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:0.0:1734259427.499973:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734259427.499974:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259427.499976:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734259427.499977:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259427.499978:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259427.499980:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259427.499982:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734259427.499984:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259427.499985:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1046:1046:255:4294967295] 192.168.202.108@tcp LPNI seq info [1045:1045:7:4294967295] 00000400:00000200:0.0:1734259427.499990:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259427.499993:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734259427.499993:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:0.0:1734259427.499996:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:2.0:1734259427.499997:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259427.499999:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259427.500002:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259427.500004:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259427.500277:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259427.500281:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734259427.500287:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259427.500291:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259427.500295:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:1.0:1734259427.500302:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:1.0:1734259427.500309:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098296064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259443 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259427.500764:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259427.500766:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259427.500770:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259427.500773:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259427.500776:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:1.0:1734259427.500778:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:1.0:1734259427.500782:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098296192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259437 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259427.503706:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259427.503727:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620900 00000400:00000200:0.0:1734259427.503737:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x219d [1] + 224 00000400:00000200:0.0:1734259427.503750:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259427.503754:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259427.503764:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098296064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259443 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259427.503803:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259427.503806:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620980 00000400:00000200:0.0:1734259427.503811:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2199 [1] + 0 00000400:00000200:0.0:1734259427.503828:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259427.503831:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259427.503835:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098296192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259427.503837:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d508f0. 00000400:00000200:2.0:1734259427.503842:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:2.0:1734259427.503845:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:2.0:1734259427.503850:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098296064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259443 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259427.503858:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098296064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259443 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259427.503886:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3ae00. 02000000:00000010:2.0:1734259427.503893:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259427.503897:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:3.0:1734259427.504190:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cec8. 00000400:00000200:3.0:1734259427.504201:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:3.0:1734259427.504203:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:3.0:1734259427.504214:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098296192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259437 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259427.504223:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098296192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259437 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259427.504249:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259427.504256:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259427.504259:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734259432.507680:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259432.507702:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259432.507802:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259432.507811:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259432.507822:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3a600. 00000400:00000010:0.0:1734259432.507830:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50898. 00000400:00000010:0.0:1734259432.507837:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734259432.507844:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098296320, portal 25 00000400:00000010:0.0:1734259432.507848:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734259432.507850:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098296320, offset 0 02000000:00000010:2.0:1734259432.507857:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:0.0:1734259432.507859:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259432.507860:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce70. 00000400:00000010:2.0:1734259432.507864:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734259432.507865:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098296448, portal 10 00000400:00000010:2.0:1734259432.507870:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734259432.507871:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098296448, offset 0 00000400:00000200:0.0:1734259432.507873:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259432.507874:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259432.507879:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259432.507882:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259432.507941:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259432.507944:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259432.507947:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1047:1047:256:4294967295] 192.168.202.108@tcp LPNI seq info [1046:1046:8:4294967295] 00000400:00000200:0.0:1734259432.507954:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259432.507960:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259432.507960:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259432.507962:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734259432.507964:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000400:00000200:2.0:1734259432.507964:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259432.507966:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259432.507967:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734259432.507969:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259432.507969:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1048:1048:255:4294967295] 192.168.202.108@tcp LPNI seq info [1047:1047:7:4294967295] 00000400:00000200:2.0:1734259432.507973:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259432.507976:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259432.507977:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:2.0:1734259432.507978:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:0.0:1734259432.507981:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259432.507981:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259432.507996:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259432.507998:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259432.508074:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259432.508080:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734259432.508086:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259432.508092:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259432.508097:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:1.0:1734259432.508099:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:1.0:1734259432.508108:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098296320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259448 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259432.508174:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259432.508176:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259432.508179:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259432.508182:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259432.508185:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:1.0:1734259432.508186:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:1.0:1734259432.508190:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098296448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259442 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259432.510682:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259432.510701:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620a00 00000400:00000200:0.0:1734259432.510709:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x21a9 [1] + 224 00000400:00000200:0.0:1734259432.510720:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259432.510724:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259432.510732:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098296320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259448 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259432.510773:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259432.510777:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620a80 00000400:00000200:0.0:1734259432.510794:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x21b1 [1] + 0 00000400:00000200:0.0:1734259432.510809:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259432.510811:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259432.510815:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098296448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259442 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259432.510896:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce70. 00000400:00000200:3.0:1734259432.510906:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:3.0:1734259432.510908:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:3.0:1734259432.510917:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098296448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259442 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259432.510925:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098296448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259442 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259432.510951:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259432.510957:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259432.510960:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000400:00000010:2.0:1734259432.511025:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50898. 00000400:00000200:2.0:1734259432.511030:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:2.0:1734259432.511032:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:2.0:1734259432.511037:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098296320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259448 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259432.511044:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098296320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259448 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259432.511062:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3a600. 02000000:00000010:2.0:1734259432.511067:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259432.511070:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:2.0:1734259437.516077:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259437.516099:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259437.516155:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259437.516161:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259437.516193:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 02000000:00000010:2.0:1734259437.516194:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259437.516200:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:3.0:1734259437.516200:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259437.516207:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259437.516207:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259437.516215:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098296704, portal 10 00000100:00000200:3.0:1734259437.516221:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098296576, portal 25 00000400:00000010:3.0:1734259437.516226:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734259437.516228:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098296576, offset 0 00000400:00000200:3.0:1734259437.516237:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259437.516251:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259437.516258:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259437.516261:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259437.516264:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259437.516267:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259437.516270:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1049:1049:256:4294967295] 192.168.202.108@tcp LPNI seq info [1048:1048:8:4294967295] 00000400:00000200:3.0:1734259437.516278:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259437.516283:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259437.516287:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734259437.516293:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259437.516302:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259437.516306:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734259437.516321:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734259437.516324:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098296704, offset 0 00000400:00000200:2.0:1734259437.516329:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259437.516334:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259437.516336:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259437.516339:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259437.516340:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259437.516342:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259437.516344:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1050:1050:255:4294967295] 192.168.202.108@tcp LPNI seq info [1049:1049:7:4294967295] 00000400:00000200:2.0:1734259437.516350:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259437.516353:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259437.516468:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259437.516476:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259437.516480:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259437.516482:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259437.516535:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259437.516541:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:1.0:1734259437.516546:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259437.516553:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259437.516558:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:1.0:1734259437.516618:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:1.0:1734259437.516628:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098296576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259453 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259437.516664:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259437.516666:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734259437.516669:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259437.516672:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259437.516674:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:1.0:1734259437.516675:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:1.0:1734259437.516679:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098296704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259447 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259437.517990:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259437.518006:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620b00 00000400:00000200:0.0:1734259437.518014:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x21bd [1] + 224 00000400:00000200:0.0:1734259437.518037:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259437.518041:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259437.518051:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098296576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259453 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259437.518109:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259437.518113:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259437.518114:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259437.518119:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098296576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259453 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259437.518127:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098296576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259453 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259437.518149:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259437.518154:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259437.518157:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000200:0.0:1734259437.518398:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259437.518404:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620b80 00000400:00000200:0.0:1734259437.518409:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x21b9 [1] + 0 00000400:00000200:0.0:1734259437.518418:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259437.518421:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259437.518426:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098296704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259447 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259437.518513:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259437.518516:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259437.518518:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259437.518654:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098296704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259447 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259437.518661:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098296704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259447 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259437.518678:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259437.518682:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259437.518685:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:2.0:1734259442.524027:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259442.524052:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259442.524117:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259442.524124:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259442.524169:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259442.524177:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259442.524185:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259442.524193:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098296960, portal 10 00000400:00000010:2.0:1734259442.524201:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259442.524203:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098296960, offset 0 00000400:00000200:2.0:1734259442.524214:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734259442.524214:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000200:2.0:1734259442.524229:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259442.524236:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734259442.524238:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000200:2.0:1734259442.524239:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259442.524243:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:3.0:1734259442.524244:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000200:2.0:1734259442.524245:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259442.524248:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1051:1051:256:4294967295] 192.168.202.108@tcp LPNI seq info [1050:1050:8:4294967295] 00000100:00000200:3.0:1734259442.524249:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098296832, portal 25 00000400:00000010:3.0:1734259442.524254:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734259442.524256:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098296832, offset 0 00000400:00000200:3.0:1734259442.524263:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259442.524267:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259442.524274:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259442.524278:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259442.524284:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259442.524284:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259442.524289:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259442.524292:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734259442.524293:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259442.524294:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259442.524297:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734259442.524297:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259442.524299:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1052:1052:255:4294967295] 192.168.202.108@tcp LPNI seq info [1051:1051:7:4294967295] 00000400:00000200:3.0:1734259442.524306:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259442.524311:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259442.524314:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734259442.524319:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259442.524326:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259442.524329:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259442.524480:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259442.524484:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259442.524489:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259442.524493:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259442.524497:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:1.0:1734259442.524499:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:1.0:1734259442.524506:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098296960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259452 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259442.524637:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259442.524640:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:1.0:1734259442.524642:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259442.524646:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259442.524648:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:1.0:1734259442.524649:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:1.0:1734259442.524653:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098296832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259442.529541:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259442.529562:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620c80 00000400:00000200:0.0:1734259442.529620:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x21c9 [1] + 0 00000400:00000200:0.0:1734259442.529635:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259442.529638:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259442.529651:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098296960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259452 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259442.529691:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259442.529708:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620c00 00000400:00000200:0.0:1734259442.529713:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x21d1 [1] + 224 00000400:00000200:0.0:1734259442.529725:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259442.529728:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259442.529733:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098296832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259458 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259442.529845:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259442.529857:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259442.529860:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259442.529873:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098296832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259442.529884:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098296832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259458 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259442.529910:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259442.529915:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734259442.529920:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000010:2.0:1734259442.530133:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259442.530138:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259442.530140:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259442.530147:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098296960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259452 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259442.530155:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098296960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259452 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259442.530174:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259442.530182:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259442.530184:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259447.531711:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259447.531743:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259447.531806:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259447.531812:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259447.531848:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259447.531854:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 02000000:00000010:3.0:1734259447.531855:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:2.0:1734259447.531860:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259447.531861:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000100:00000200:2.0:1734259447.531869:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098297216, portal 10 00000400:00000010:2.0:1734259447.531874:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734259447.531876:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098297216, offset 0 00000400:00000010:3.0:1734259447.531879:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000200:2.0:1734259447.531885:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734259447.531894:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098297088, portal 25 00000400:00000010:3.0:1734259447.531898:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734259447.531899:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098297088, offset 0 00000400:00000200:2.0:1734259447.531902:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259447.531904:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259447.531908:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259447.531914:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259447.531923:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259447.531925:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259447.531927:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1053:1053:256:4294967295] 192.168.202.108@tcp LPNI seq info [1052:1052:8:4294967295] 00000400:00000200:2.0:1734259447.531938:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259447.531944:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259447.531944:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259447.531947:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734259447.531948:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734259447.531949:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259447.531950:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259447.531952:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734259447.531954:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259447.531954:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1054:1054:255:4294967295] 192.168.202.108@tcp LPNI seq info [1053:1053:7:4294967295] 00000400:00000200:3.0:1734259447.531960:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259447.531963:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259447.531964:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734259447.531967:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000010:3.0:1734259447.531967:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734259447.531970:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259447.531974:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259447.531976:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259447.532355:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259447.532362:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259447.532369:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259447.532376:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259447.532381:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:1.0:1734259447.532393:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:1.0:1734259447.532403:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098297216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259457 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259447.532470:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259447.532472:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:1.0:1734259447.532474:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259447.532477:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259447.532479:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:1.0:1734259447.532480:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:1.0:1734259447.532484:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098297088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259463 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259447.537743:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259447.537765:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620d80 00000400:00000200:0.0:1734259447.537775:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x21d9 [1] + 0 00000400:00000200:0.0:1734259447.537789:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259447.537793:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259447.537803:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098297216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259457 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259447.538867:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259447.538875:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620d00 00000400:00000200:0.0:1734259447.538881:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x21e1 [1] + 224 00000400:00000200:0.0:1734259447.538902:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259447.538906:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259447.538912:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098297088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259463 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259447.539097:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259447.539103:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259447.539104:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259447.539110:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098297216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259457 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259447.539118:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098297216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259457 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259447.539151:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259447.539158:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259447.539163:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000400:00000010:3.0:1734259447.539293:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259447.539298:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259447.539299:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259447.539304:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098297088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259463 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259447.539318:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098297088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259463 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259447.539330:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259447.539334:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734259447.539336:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259452.539682:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259452.539701:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259452.539780:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259452.539786:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259452.539812:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259452.539813:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:2.0:1734259452.539819:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:3.0:1734259452.539819:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259452.539824:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259452.539824:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259452.539830:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098297472, portal 10 00000400:00000010:2.0:1734259452.539834:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:3.0:1734259452.539834:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098297344, portal 25 00000100:00000200:2.0:1734259452.539836:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098297472, offset 0 00000400:00000200:2.0:1734259452.539843:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734259452.539846:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000400:00000200:2.0:1734259452.540235:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259452.540240:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259452.540243:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259452.540246:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259452.540248:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259452.540250:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1055:1055:256:4294967295] 192.168.202.108@tcp LPNI seq info [1054:1054:8:4294967295] 00000400:00000200:2.0:1734259452.540259:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259452.540264:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259452.540294:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259452.540300:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259452.540306:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259452.540309:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:3.0:1734259452.540504:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098297344, offset 0 00000400:00000200:3.0:1734259452.540514:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259452.540521:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259452.540523:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259452.540526:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259452.540528:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259452.540530:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259452.540532:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1056:1056:255:4294967295] 192.168.202.108@tcp LPNI seq info [1055:1055:7:4294967295] 00000400:00000200:3.0:1734259452.540539:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259452.540543:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259452.540546:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734259452.540549:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259452.540554:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259452.540556:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259452.540749:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259452.540752:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259452.540757:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259452.540760:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259452.540765:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734259452.540766:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734259452.540773:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098297472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259462 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259452.540814:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259452.540816:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734259452.540818:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259452.540820:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259452.540822:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734259452.540823:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734259452.540826:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098297344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259468 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259452.542647:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259452.542662:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620e80 00000400:00000200:0.0:1734259452.542670:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x21e9 [1] + 0 00000400:00000200:0.0:1734259452.542688:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259452.542692:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259452.542700:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098297472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259462 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259452.542802:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259452.542807:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259452.542809:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259452.542813:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098297472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259462 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259452.542819:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098297472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259462 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259452.542847:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259452.542852:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259452.542855:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000200:0.0:1734259452.543502:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259452.543511:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620e00 00000400:00000200:0.0:1734259452.543731:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x21ed [1] + 224 00000400:00000200:0.0:1734259452.543747:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259452.543750:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259452.543758:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098297344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259468 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259452.544083:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259452.544087:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259452.544088:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259452.544092:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098297344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259468 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259452.544098:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098297344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259468 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259452.544112:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259452.544116:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259452.544119:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000100:00000010:2.0:1734259457.547817:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259457.547842:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259457.547911:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259457.547918:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259457.547953:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259457.547988:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259457.547998:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259457.548005:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098297728, portal 10 00000400:00000010:2.0:1734259457.548027:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734259457.548029:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098297728, offset 0 00000400:00000200:2.0:1734259457.548037:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259457.548053:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259457.548059:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259457.548063:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259457.548067:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259457.548069:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259457.548072:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1057:1057:256:4294967295] 192.168.202.108@tcp LPNI seq info [1056:1056:8:4294967295] 00000400:00000200:2.0:1734259457.548080:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259457.548085:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259457.548088:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259457.548095:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259457.548102:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259457.548106:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:0.0:1734259457.548145:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 00000400:00000010:0.0:1734259457.548150:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50840. 00000400:00000010:0.0:1734259457.548153:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734259457.548155:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098297600, portal 25 00000400:00000010:0.0:1734259457.548161:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734259457.548162:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098297600, offset 0 00000400:00000200:0.0:1734259457.548173:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259457.548177:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259457.548179:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259457.548181:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259457.548182:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259457.548184:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259457.548186:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1058:1058:255:4294967295] 192.168.202.108@tcp LPNI seq info [1057:1057:7:4294967295] 00000400:00000200:0.0:1734259457.548191:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259457.548195:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259457.548198:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000800:00000200:0.0:1734259457.548200:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259457.548203:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259457.548205:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259457.548262:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259457.548265:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734259457.548270:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259457.548275:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259457.548278:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:1.0:1734259457.548280:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:1.0:1734259457.548286:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098297728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259467 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259457.548641:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259457.548644:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:1.0:1734259457.548647:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259457.548650:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259457.548653:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:1.0:1734259457.548654:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:1.0:1734259457.548658:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098297600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259473 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259457.550405:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259457.550431:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c620f80 00000400:00000200:0.0:1734259457.550442:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x21f9 [1] + 0 00000400:00000200:0.0:1734259457.550457:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259457.550461:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259457.550473:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098297728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259467 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259457.550522:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259457.550528:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c620f00 00000400:00000200:0.0:1734259457.550534:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2201 [1] + 224 00000400:00000200:0.0:1734259457.550556:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259457.550559:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259457.550565:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098297600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259473 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259457.550724:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259457.550730:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259457.550732:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259457.550737:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098297728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259467 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259457.550743:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098297728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259467 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259457.550777:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259457.550785:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259457.550790:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000400:00000010:1.0:1734259457.551025:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50840. 00000400:00000200:1.0:1734259457.551030:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:1.0:1734259457.551031:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:1.0:1734259457.551036:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098297600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259473 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259457.551542:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098297600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259473 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259457.551660:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 02000000:00000010:1.0:1734259457.551668:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:1.0:1734259457.551672:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:2.0:1734259462.555710:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259462.555733:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 02000000:00000010:1.0:1734259462.556148:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0200. 00000400:00000010:1.0:1734259462.556157:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259462.556163:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259462.556170:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098297856, portal 25 00000400:00000010:1.0:1734259462.556174:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734259462.556176:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098297856, offset 0 00000400:00000200:1.0:1734259462.556185:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259462.556231:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259462.556235:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259462.556239:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259462.556242:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259462.556245:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259462.556247:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1059:1059:256:4294967295] 192.168.202.108@tcp LPNI seq info [1058:1058:8:4294967295] 00000400:00000200:1.0:1734259462.556255:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259462.556260:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259462.556264:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734259462.556269:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259462.556276:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259462.556280:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:2.0:1734259462.556357:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259462.556364:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259462.556389:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259462.556403:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259462.556407:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259462.556409:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098297984, portal 10 00000400:00000010:2.0:1734259462.556413:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734259462.556414:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098297984, offset 0 00000400:00000200:2.0:1734259462.556419:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259462.556423:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259462.556425:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259462.556426:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259462.556428:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259462.556430:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259462.556432:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1060:1060:255:4294967295] 192.168.202.108@tcp LPNI seq info [1059:1059:7:4294967295] 00000400:00000200:2.0:1734259462.556437:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259462.556439:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259462.556442:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259462.556444:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259462.556447:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259462.556449:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259462.556556:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259462.556564:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734259462.556594:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259462.556598:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259462.556602:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:0.0:1734259462.556603:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734259462.556609:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098297856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259478 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259462.556649:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259462.556651:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259462.556653:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259462.556656:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259462.556657:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734259462.556659:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734259462.556662:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098297984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259472 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259462.558323:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259462.558342:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621000 00000400:00000200:0.0:1734259462.558349:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2209 [1] + 224 00000400:00000200:0.0:1734259462.558360:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259462.558364:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259462.558372:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098297856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259478 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259462.558408:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259462.558412:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621080 00000400:00000200:0.0:1734259462.558416:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2211 [1] + 0 00000400:00000200:0.0:1734259462.558428:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259462.558431:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259462.558435:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098297984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259472 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259462.558462:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259462.558466:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259462.558468:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259462.558473:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098297856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259478 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259462.558479:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098297856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259478 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259462.558499:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0200. 02000000:00000010:1.0:1734259462.558511:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000400:00000010:2.0:1734259462.558515:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259462.558520:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259462.558521:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259462.558526:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098297984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259472 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259462.558534:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098297984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259472 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259462.558550:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259462.558555:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259462.558558:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000100:00000010:1.0:1734259462.558730:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734259467.563728:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259467.563753:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259467.563836:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734259467.563842:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259467.563864:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 02000000:00000010:2.0:1734259467.563873:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:3.0:1734259467.563874:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259467.563877:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259467.563881:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259467.563881:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259467.563888:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098298240, portal 10 00000400:00000010:2.0:1734259467.563894:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:3.0:1734259467.563901:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098298112, portal 25 00000100:00000200:2.0:1734259467.563903:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098298240, offset 0 00000400:00000010:3.0:1734259467.563904:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000400:00000200:2.0:1734259467.563913:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734259467.563919:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098298112, offset 0 00000400:00000200:3.0:1734259467.563924:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259467.563928:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259467.563934:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259467.563938:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259467.563941:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259467.563943:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259467.563946:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1061:1061:256:4294967295] 192.168.202.108@tcp LPNI seq info [1060:1060:8:4294967295] 00000400:00000200:2.0:1734259467.563953:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259467.563959:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259467.563959:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259467.563962:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734259467.563963:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734259467.563964:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259467.563966:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259467.563968:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259467.563968:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259467.563969:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1062:1062:255:4294967295] 192.168.202.108@tcp LPNI seq info [1061:1061:7:4294967295] 00000400:00000200:3.0:1734259467.563975:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259467.563976:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259467.563978:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734259467.563980:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000010:3.0:1734259467.563980:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734259467.563983:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259467.563986:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259467.563988:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259467.564041:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259467.564048:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259467.564052:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259467.564056:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259467.564059:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734259467.564060:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734259467.564067:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098298240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259477 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259467.564134:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259467.564135:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734259467.564138:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259467.564141:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259467.564142:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734259467.564144:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734259467.564147:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098298112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259483 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259467.565822:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259467.565837:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621180 00000400:00000200:0.0:1734259467.565845:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2219 [1] + 0 00000400:00000200:0.0:1734259467.565855:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259467.565857:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259467.565866:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098298240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259477 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259467.565905:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259467.565910:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621100 00000400:00000200:0.0:1734259467.565915:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x221d [1] + 224 00000400:00000200:0.0:1734259467.565935:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259467.565938:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259467.565942:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098298112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259483 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259467.565964:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259467.565968:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259467.565969:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259467.565973:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098298240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259477 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259467.565979:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098298240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259477 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259467.566009:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259467.566014:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259467.566025:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000400:00000010:3.0:1734259467.566078:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259467.566081:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259467.566083:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259467.566087:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098298112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259483 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259467.566092:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098298112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259483 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259467.566103:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259467.566105:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734259467.566108:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000100:00000010:2.0:1734259472.571687:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734259472.571711:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259472.571766:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259472.571773:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259472.571808:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259472.571815:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259472.571822:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259472.571828:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098298496, portal 10 00000400:00000010:2.0:1734259472.571835:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734259472.571837:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098298496, offset 0 00000400:00000200:2.0:1734259472.571846:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259472.571864:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259472.571869:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259472.571872:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259472.571875:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259472.571877:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259472.571879:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1063:1063:256:4294967295] 192.168.202.108@tcp LPNI seq info [1062:1062:8:4294967295] 00000400:00000200:2.0:1734259472.571888:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259472.571894:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259472.571897:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259472.571902:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259472.571909:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259472.571913:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:0.0:1734259472.571929:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734259472.571956:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d507e8. 00000400:00000010:0.0:1734259472.571962:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734259472.571967:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098298368, portal 25 00000400:00000010:0.0:1734259472.571971:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000100:00000200:0.0:1734259472.571973:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098298368, offset 0 00000400:00000200:0.0:1734259472.571979:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259472.572067:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259472.572071:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259472.572074:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259472.572076:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259472.572078:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259472.572080:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1064:1064:255:4294967295] 192.168.202.108@tcp LPNI seq info [1063:1063:7:4294967295] 00000400:00000200:0.0:1734259472.572086:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259472.572090:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259472.572093:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734259472.572096:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259472.572100:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259472.572102:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259472.572163:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259472.572167:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259472.572170:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259472.572174:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259472.572178:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:1.0:1734259472.572180:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:1.0:1734259472.572186:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098298496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259482 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259472.572215:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259472.572217:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734259472.572219:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259472.572221:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259472.572223:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:1.0:1734259472.572224:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:1.0:1734259472.572228:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098298368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259488 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259472.574288:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259472.574305:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621280 00000400:00000200:0.0:1734259472.574312:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2229 [1] + 0 00000400:00000200:0.0:1734259472.574322:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259472.574325:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259472.574334:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098298496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259482 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259472.574374:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259472.574378:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621200 00000400:00000200:0.0:1734259472.574383:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2231 [1] + 224 00000400:00000200:0.0:1734259472.574405:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259472.574415:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259472.574420:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098298368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259488 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259472.574427:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259472.574432:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259472.574434:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259472.574438:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098298496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259482 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259472.574444:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098298496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259482 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259472.574474:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259472.574479:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259472.574482:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000400:00000010:1.0:1734259472.574520:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d507e8. 00000400:00000200:1.0:1734259472.574524:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:1.0:1734259472.574525:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:1.0:1734259472.574529:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098298368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259488 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259472.574534:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098298368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259488 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259472.574544:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:1.0:1734259472.574548:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259472.574550:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734259477.579943:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259477.579964:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259477.580016:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259477.580021:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259477.580069:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259477.580110:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 02000000:00000010:2.0:1734259477.580112:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:3.0:1734259477.580116:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000010:2.0:1734259477.580117:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000100:00000200:3.0:1734259477.580122:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098298624, portal 25 00000400:00000010:2.0:1734259477.580123:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259477.580126:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:2.0:1734259477.580127:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098298752, portal 10 00000100:00000200:3.0:1734259477.580128:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098298624, offset 0 00000400:00000010:2.0:1734259477.580132:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000400:00000200:3.0:1734259477.580135:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259477.580155:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259477.580160:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259477.580163:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259477.580165:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259477.580167:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259477.580170:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1065:1065:256:4294967295] 192.168.202.108@tcp LPNI seq info [1064:1064:8:4294967295] 00000400:00000200:3.0:1734259477.580178:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259477.580183:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259477.580186:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734259477.580190:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259477.580197:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259477.580200:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:2.0:1734259477.580216:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098298752, offset 0 00000400:00000200:2.0:1734259477.580225:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259477.580239:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259477.580245:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259477.580248:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259477.580251:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259477.580253:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259477.580255:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1066:1066:255:4294967295] 192.168.202.108@tcp LPNI seq info [1065:1065:7:4294967295] 00000400:00000200:2.0:1734259477.580262:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259477.580266:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259477.580270:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259477.580274:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259477.580279:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259477.580282:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259477.580292:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259477.580296:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734259477.580301:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259477.580306:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259477.580309:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734259477.580311:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734259477.580320:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098298624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259493 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259477.580398:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259477.580400:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259477.580403:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259477.580406:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259477.580408:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734259477.580409:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734259477.580413:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098298752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259487 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259477.582728:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259477.582744:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621300 00000400:00000200:0.0:1734259477.582751:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2239 [1] + 224 00000400:00000200:0.0:1734259477.582767:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259477.582770:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259477.582780:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098298624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259493 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259477.582814:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259477.582818:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621380 00000400:00000200:0.0:1734259477.582823:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x223d [1] + 0 00000400:00000200:0.0:1734259477.582837:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259477.582846:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259477.582850:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098298752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259487 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259477.582971:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259477.582980:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259477.582982:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259477.582999:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000100:00000200:2.0:1734259477.583001:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098298752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259487 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734259477.583003:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259477.583005:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259477.583008:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098298752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259487 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259477.583009:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098298624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259493 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259477.583015:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098298624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259493 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259477.583033:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:2.0:1734259477.583035:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259477.583037:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259477.583041:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259477.583042:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259477.583049:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734259482.587800:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259482.587824:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259482.588149:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259482.588157:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259482.588200:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259482.588207:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259482.588213:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259482.588220:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098299008, portal 10 00000400:00000010:2.0:1734259482.588227:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259482.588229:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098299008, offset 0 00000400:00000200:2.0:1734259482.588237:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:0.0:1734259482.588242:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3a600. 00000400:00000010:0.0:1734259482.588248:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50790. 00000400:00000200:2.0:1734259482.588248:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:0.0:1734259482.588252:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000400:00000200:2.0:1734259482.588253:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:0.0:1734259482.588254:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098298880, portal 25 00000400:00000010:0.0:1734259482.588257:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000400:00000200:2.0:1734259482.588257:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:0.0:1734259482.588258:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098298880, offset 0 00000400:00000200:2.0:1734259482.588260:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259482.588263:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259482.588263:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259482.588266:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1067:1067:256:4294967295] 192.168.202.108@tcp LPNI seq info [1066:1066:8:4294967295] 00000400:00000200:2.0:1734259482.588273:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259482.588278:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259482.588281:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259482.588286:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259482.588293:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259482.588297:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734259482.588411:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259482.588414:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259482.588416:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259482.588418:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259482.588419:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259482.588422:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1068:1068:255:4294967295] 192.168.202.108@tcp LPNI seq info [1067:1067:7:4294967295] 00000400:00000200:0.0:1734259482.588427:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259482.588431:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259482.588433:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734259482.588436:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259482.588439:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259482.588441:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259482.588886:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259482.588890:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259482.588894:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259482.588898:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259482.588908:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:1.0:1734259482.588909:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:1.0:1734259482.588917:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098299008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259492 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259482.588986:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259482.588987:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734259482.588990:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259482.588992:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259482.588994:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:1.0:1734259482.588995:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:1.0:1734259482.588998:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098298880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259498 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259482.591899:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259482.591921:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621480 00000400:00000200:0.0:1734259482.591930:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2249 [1] + 0 00000400:00000200:0.0:1734259482.591952:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259482.591956:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259482.591967:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098299008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259492 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259482.592999:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259482.593008:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259482.593011:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259482.593018:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098299008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259492 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259482.593026:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098299008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259492 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259482.593063:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259482.593070:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259482.593073:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000200:0.0:1734259482.593225:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259482.593233:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621400 00000400:00000200:0.0:1734259482.593238:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2251 [1] + 224 00000400:00000200:0.0:1734259482.593251:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259482.593254:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259482.593260:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098298880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259498 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259482.593522:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50790. 00000400:00000200:1.0:1734259482.593527:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:1.0:1734259482.593528:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:1.0:1734259482.593533:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098298880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259498 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259482.593552:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098298880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259498 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259482.593566:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3a600. 02000000:00000010:1.0:1734259482.593588:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:1.0:1734259482.593591:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734259487.596141:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259487.596164:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259487.596276:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259487.596284:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259487.596322:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259487.596328:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259487.596335:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259487.596348:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098299264, portal 10 00000400:00000010:2.0:1734259487.596354:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734259487.596357:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098299264, offset 0 00000400:00000200:2.0:1734259487.596366:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259487.596378:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259487.596383:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259487.596387:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259487.596390:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259487.596392:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259487.596395:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1069:1069:256:4294967295] 192.168.202.108@tcp LPNI seq info [1068:1068:8:4294967295] 00000400:00000200:2.0:1734259487.596403:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259487.596408:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259487.596413:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259487.596432:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259487.596440:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259487.596443:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734259487.596488:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734259487.596499:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259487.596505:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259487.596511:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098299136, portal 25 00000400:00000010:1.0:1734259487.596515:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734259487.596517:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098299136, offset 0 00000400:00000200:1.0:1734259487.596534:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259487.596544:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259487.596548:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259487.596552:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259487.596564:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259487.596566:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259487.596608:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1070:1070:255:4294967295] 192.168.202.108@tcp LPNI seq info [1069:1069:7:4294967295] 00000400:00000200:1.0:1734259487.596616:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259487.596621:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259487.596624:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734259487.596628:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259487.596635:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259487.596638:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259487.596830:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259487.596834:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259487.596839:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259487.596843:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259487.596847:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:0.0:1734259487.596849:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:0.0:1734259487.596857:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098299264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259497 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259487.596925:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259487.596927:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734259487.596930:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259487.596933:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259487.596934:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:0.0:1734259487.596936:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:0.0:1734259487.596940:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098299136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259503 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259487.598833:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259487.598851:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621580 00000400:00000200:0.0:1734259487.598859:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2259 [1] + 0 00000400:00000200:0.0:1734259487.598883:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259487.598886:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259487.598895:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098299264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259497 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259487.599014:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259487.599018:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259487.599020:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259487.599025:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098299264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259497 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259487.599031:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098299264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259497 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259487.599055:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259487.599060:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259487.599063:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000400:00000200:0.0:1734259487.600632:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259487.600652:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621500 00000400:00000200:0.0:1734259487.600660:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2261 [1] + 224 00000400:00000200:0.0:1734259487.600680:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259487.600684:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259487.600693:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098299136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259503 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259487.600890:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259487.600896:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259487.600898:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259487.600903:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098299136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259503 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259487.600909:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098299136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259503 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259487.600928:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259487.600933:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:1.0:1734259487.600936:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:2.0:1734259492.603716:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259492.603742:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259492.603809:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259492.603816:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259492.603860:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 02000000:00000010:2.0:1734259492.603860:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:1.0:1734259492.603867:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:2.0:1734259492.603867:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:1.0:1734259492.603873:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000010:2.0:1734259492.603873:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:1.0:1734259492.603880:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098299392, portal 25 00000400:00000010:1.0:1734259492.603883:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:2.0:1734259492.603885:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098299520, portal 10 00000100:00000200:1.0:1734259492.603886:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098299392, offset 0 00000400:00000010:2.0:1734259492.603891:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000400:00000200:1.0:1734259492.603895:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259492.603899:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098299520, offset 0 00000400:00000200:2.0:1734259492.603904:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259492.603909:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259492.603916:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259492.603919:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259492.603922:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259492.603925:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259492.603941:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1071:1071:256:4294967295] 192.168.202.108@tcp LPNI seq info [1070:1070:8:4294967295] 00000400:00000200:1.0:1734259492.603949:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259492.603955:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259492.603956:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259492.603971:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000400:00000200:2.0:1734259492.603971:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259492.603974:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259492.603976:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734259492.603977:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259492.603978:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259492.603980:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1072:1072:255:4294967295] 192.168.202.108@tcp LPNI seq info [1071:1071:7:4294967295] 00000800:00000200:1.0:1734259492.603985:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259492.603986:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259492.603989:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259492.603997:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259492.603999:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259492.604002:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259492.604006:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259492.604008:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259492.604157:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259492.604160:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734259492.604166:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259492.604170:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259492.604174:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:0.0:1734259492.604175:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:0.0:1734259492.604183:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098299392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259508 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259492.604415:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259492.604417:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259492.604420:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259492.604424:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259492.604426:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734259492.604427:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734259492.604430:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098299520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259502 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259492.606277:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259492.606296:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621600 00000400:00000200:0.0:1734259492.606403:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2269 [1] + 224 00000400:00000200:0.0:1734259492.606428:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259492.606432:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259492.606441:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098299392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259508 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259492.606551:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259492.606607:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259492.606610:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259492.606616:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098299392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259508 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259492.606623:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098299392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259508 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259492.606647:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259492.606651:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:1.0:1734259492.606657:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000400:00000200:0.0:1734259492.606996:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259492.607001:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621680 00000400:00000200:0.0:1734259492.607007:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x226d [1] + 0 00000400:00000200:0.0:1734259492.607017:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259492.607019:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259492.607024:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098299520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259502 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259492.607099:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259492.607102:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259492.607103:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259492.607108:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098299520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259502 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259492.607114:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098299520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259502 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259492.607131:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259492.607135:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259492.607137:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259497.611707:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259497.611727:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259497.612480:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259497.612490:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259497.612519:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259497.612520:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:2.0:1734259497.612525:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:3.0:1734259497.612525:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259497.612530:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259497.612530:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259497.612535:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098299776, portal 10 00000100:00000200:3.0:1734259497.612535:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098299648, portal 25 00000400:00000010:3.0:1734259497.612538:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734259497.612540:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098299648, offset 0 00000400:00000200:3.0:1734259497.612547:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259497.612549:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734259497.612551:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098299776, offset 0 00000400:00000200:2.0:1734259497.612555:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259497.612557:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259497.612561:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259497.612634:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259497.612637:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259497.612638:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259497.612641:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1073:1073:256:4294967295] 192.168.202.108@tcp LPNI seq info [1072:1072:8:4294967295] 00000400:00000200:3.0:1734259497.612647:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259497.612652:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259497.612654:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734259497.612659:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259497.612665:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259497.612668:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259497.612740:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259497.612743:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259497.612744:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259497.612746:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259497.612753:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259497.612755:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1074:1074:255:4294967295] 192.168.202.108@tcp LPNI seq info [1073:1073:7:4294967295] 00000400:00000200:2.0:1734259497.612761:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259497.612764:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259497.612767:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259497.612769:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259497.612773:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259497.612775:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259497.612790:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259497.612793:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734259497.612797:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259497.612800:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259497.612804:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734259497.612805:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734259497.612812:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098299648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259513 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259497.612869:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259497.612871:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259497.612873:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259497.612876:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259497.612878:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734259497.612879:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734259497.612882:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098299776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259507 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259497.614858:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259497.614874:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621780 00000400:00000200:0.0:1734259497.614881:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x227d [1] + 0 00000400:00000200:0.0:1734259497.614890:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259497.614893:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259497.614902:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098299776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259507 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259497.614958:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259497.614963:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621700 00000400:00000200:0.0:1734259497.614968:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2279 [1] + 224 00000400:00000200:0.0:1734259497.614980:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259497.614983:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259497.614988:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098299648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259513 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259497.615281:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259497.615286:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259497.615287:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259497.615292:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098299776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259507 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259497.615298:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098299776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259507 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259497.615322:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259497.615326:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259497.615330:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000010:3.0:1734259497.615519:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259497.615523:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259497.615524:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259497.615528:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098299648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259513 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259497.615533:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098299648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259513 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259497.615544:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259497.615547:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734259497.615550:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259502.622639:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259502.622661:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259502.622717:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259502.622723:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259502.622743:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 02000000:00000010:2.0:1734259502.622750:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:1.0:1734259502.622751:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:2.0:1734259502.622754:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:1.0:1734259502.622757:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000010:2.0:1734259502.622758:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:1.0:1734259502.622764:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098299904, portal 25 00000400:00000010:1.0:1734259502.622768:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734259502.623846:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098299904, offset 0 00000100:00000200:2.0:1734259502.623846:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098300032, portal 10 00000400:00000010:2.0:1734259502.623855:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000400:00000200:1.0:1734259502.623859:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259502.623862:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098300032, offset 0 00000400:00000200:2.0:1734259502.623866:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259502.623872:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259502.623877:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259502.623881:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259502.623892:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259502.623894:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259502.623896:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1075:1075:256:4294967295] 192.168.202.108@tcp LPNI seq info [1074:1074:8:4294967295] 00000400:00000200:1.0:1734259502.623916:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259502.623921:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259502.623921:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259502.623925:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000400:00000200:2.0:1734259502.623928:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734259502.623930:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259502.623930:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259502.623931:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259502.623932:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259502.623934:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1076:1076:255:4294967295] 192.168.202.108@tcp LPNI seq info [1075:1075:7:4294967295] 00000800:00000200:1.0:1734259502.623937:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259502.623939:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259502.623940:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259502.623942:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259502.623944:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259502.623945:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259502.623948:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259502.623950:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259502.624194:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259502.624197:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734259502.624202:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259502.624206:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259502.624210:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:0.0:1734259502.624212:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:0.0:1734259502.624221:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098299904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259518 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259502.624294:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259502.624296:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259502.624298:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259502.624301:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259502.624303:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734259502.624304:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734259502.624307:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098300032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259512 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259502.631111:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259502.631130:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621880 00000400:00000200:0.0:1734259502.631138:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x228d [1] + 0 00000400:00000200:0.0:1734259502.631149:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259502.631153:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259502.631162:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098300032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259502.632714:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259502.632726:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621800 00000400:00000200:0.0:1734259502.632735:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2289 [1] + 224 00000400:00000200:0.0:1734259502.632757:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259502.632761:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259502.632769:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098299904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259518 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259502.632860:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259502.632867:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259502.632869:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259502.632877:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098300032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259512 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259502.632894:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098300032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259512 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259502.632927:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259502.632933:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259502.632937:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:1.0:1734259502.633000:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259502.633004:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259502.633006:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259502.633010:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098299904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259518 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259502.633016:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098299904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259518 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259502.633031:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259502.633034:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:1.0:1734259502.633037:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:2.0:1734259507.627743:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259507.627769:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259507.627834:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259507.627842:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259507.627896:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259507.627911:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 02000000:00000010:2.0:1734259507.627918:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:3.0:1734259507.627921:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000010:2.0:1734259507.627926:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000100:00000200:3.0:1734259507.627930:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098300160, portal 25 00000400:00000010:2.0:1734259507.627933:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259507.627936:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:2.0:1734259507.627940:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098300288, portal 10 00000100:00000200:3.0:1734259507.627940:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098300160, offset 0 00000400:00000010:2.0:1734259507.627946:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000400:00000200:3.0:1734259507.627950:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259507.627960:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098300288, offset 0 00000400:00000200:3.0:1734259507.627966:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259507.627967:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259507.627973:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259507.627977:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259507.627981:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259507.627992:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259507.627995:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1077:1077:256:4294967295] 192.168.202.108@tcp LPNI seq info [1076:1076:8:4294967295] 00000400:00000200:3.0:1734259507.628005:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259507.628012:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259507.628017:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259507.628017:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000400:00000200:2.0:1734259507.628023:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:3.0:1734259507.628024:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259507.628028:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259507.628031:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259507.628033:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734259507.628036:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259507.628037:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1078:1078:255:4294967295] 192.168.202.108@tcp LPNI seq info [1077:1077:7:4294967295] 00000800:00000200:3.0:1734259507.628041:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259507.628045:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259507.628052:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259507.628059:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259507.628065:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259507.628073:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259507.628078:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259507.628261:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259507.628266:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734259507.628272:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259507.628277:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259507.628281:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734259507.628283:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734259507.628293:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098300160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259523 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259507.628383:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259507.628384:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259507.628387:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259507.628390:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259507.628392:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734259507.628393:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734259507.628397:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098300288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259517 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259507.630780:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259507.630797:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621900 00000400:00000200:0.0:1734259507.630805:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2299 [1] + 224 00000400:00000200:0.0:1734259507.630816:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259507.630820:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259507.630831:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098300160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259523 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259507.630903:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259507.630907:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621980 00000400:00000200:0.0:1734259507.630913:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x229d [1] + 0 00000400:00000200:0.0:1734259507.630930:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259507.630933:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259507.630938:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098300288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259517 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259507.630972:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259507.630980:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259507.630982:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259507.630988:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098300160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259523 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259507.630995:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098300160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259523 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259507.631019:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259507.631025:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259507.631031:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:2.0:1734259507.631273:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259507.631278:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259507.631279:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259507.631284:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098300288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259517 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259507.631291:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098300288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259517 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734259507.631307:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:2.0:1734259507.631317:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259507.631322:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259507.631324:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734259512.636018:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259512.636038:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259512.636595:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259512.636602:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259512.636769:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259512.636776:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259512.636782:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259512.636788:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098300416, portal 25 00000400:00000010:3.0:1734259512.636791:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734259512.636793:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098300416, offset 0 00000400:00000200:3.0:1734259512.636800:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259512.636837:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259512.636841:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259512.636845:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259512.636847:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259512.636849:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259512.636851:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1079:1079:256:4294967295] 192.168.202.108@tcp LPNI seq info [1078:1078:8:4294967295] 00000400:00000200:3.0:1734259512.636869:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259512.636874:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259512.636878:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734259512.636882:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259512.636889:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259512.636892:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259512.637448:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259512.637458:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259512.637461:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259512.637463:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098300544, portal 10 00000400:00000010:2.0:1734259512.637468:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734259512.637469:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098300544, offset 0 00000400:00000200:2.0:1734259512.637473:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259512.637478:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259512.637480:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259512.637482:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259512.637484:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259512.637486:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259512.637487:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1080:1080:255:4294967295] 192.168.202.108@tcp LPNI seq info [1079:1079:7:4294967295] 00000400:00000200:2.0:1734259512.637493:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259512.637496:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259512.637499:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259512.637502:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259512.637506:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259512.637508:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259512.639519:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259512.639527:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734259512.639533:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259512.639540:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259512.639545:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734259512.639546:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734259512.639554:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098300416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259528 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259512.640231:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259512.640234:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259512.640238:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259512.640243:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259512.640246:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734259512.640248:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734259512.640253:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098300544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259522 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259512.642010:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259512.642031:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621a00 00000400:00000200:0.0:1734259512.642038:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x22a9 [1] + 224 00000400:00000200:0.0:1734259512.642048:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259512.642051:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259512.642061:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098300416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259528 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259512.642113:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259512.642118:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621a80 00000400:00000200:0.0:1734259512.642122:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x22b1 [1] + 0 00000400:00000200:0.0:1734259512.642135:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259512.642138:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259512.642142:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098300544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259512.642252:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259512.642257:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259512.642259:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259512.642264:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098300544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259522 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259512.642271:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098300544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259522 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259512.642296:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259512.642301:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259512.642304:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000400:00000010:3.0:1734259512.642464:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259512.642468:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259512.642469:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259512.642474:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098300416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259528 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259512.642479:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098300416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259528 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259512.642489:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259512.642492:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734259512.642494:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734259517.644128:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259517.644149:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259517.644220:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259517.644226:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259517.644258:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259517.644265:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259517.644270:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259517.644276:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098300800, portal 10 00000400:00000010:2.0:1734259517.644281:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259517.644284:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098300800, offset 0 00000400:00000200:2.0:1734259517.644292:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259517.644304:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259517.644309:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259517.644312:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259517.644315:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259517.644317:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259517.644319:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1081:1081:256:4294967295] 192.168.202.108@tcp LPNI seq info [1080:1080:8:4294967295] 00000400:00000200:2.0:1734259517.644328:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259517.644333:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259517.644337:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259517.644341:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259517.644348:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259517.644351:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259517.644448:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259517.644452:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259517.644455:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259517.644458:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098300672, portal 25 00000400:00000010:3.0:1734259517.644460:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259517.644461:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098300672, offset 0 00000400:00000200:3.0:1734259517.644464:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259517.644468:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259517.644470:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259517.644472:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259517.644473:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259517.644475:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259517.644477:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1082:1082:255:4294967295] 192.168.202.108@tcp LPNI seq info [1081:1081:7:4294967295] 00000400:00000200:3.0:1734259517.644495:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259517.644504:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259517.644506:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734259517.644509:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259517.644512:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259517.644514:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259517.644716:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259517.644719:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259517.644725:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259517.644729:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259517.644734:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:0.0:1734259517.644735:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734259517.644742:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098300800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259527 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259517.644839:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259517.644841:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734259517.644843:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259517.644846:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259517.644847:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:0.0:1734259517.644849:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:0.0:1734259517.644852:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098300672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259533 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259517.647030:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259517.647045:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621b00 00000400:00000200:0.0:1734259517.647051:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x22c1 [1] + 224 00000400:00000200:0.0:1734259517.647060:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259517.647062:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259517.647069:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098300672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259533 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259517.647109:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259517.647114:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621b80 00000400:00000200:0.0:1734259517.647118:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x22b9 [1] + 0 00000400:00000200:0.0:1734259517.647130:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259517.647132:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259517.647137:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098300800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259527 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259517.647168:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259517.647173:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259517.647174:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259517.647180:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098300672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259533 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259517.647187:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098300672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259533 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259517.647206:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259517.647211:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734259517.647215:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000400:00000010:2.0:1734259517.647275:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259517.647279:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259517.647280:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259517.647284:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098300800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259527 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259517.647290:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098300800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259527 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259517.647306:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259517.647309:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259517.647315:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:2.0:1734259522.651706:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259522.651759:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259522.651816:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259522.651823:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259522.651861:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259522.651867:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259522.651873:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259522.651881:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098301056, portal 10 00000400:00000010:2.0:1734259522.651887:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734259522.651889:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098301056, offset 0 00000400:00000200:2.0:1734259522.651898:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259522.651910:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259522.651916:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259522.651919:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259522.651922:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259522.651924:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259522.651927:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1083:1083:256:4294967295] 192.168.202.108@tcp LPNI seq info [1082:1082:8:4294967295] 00000400:00000200:2.0:1734259522.651940:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259522.651945:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259522.651948:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259522.651954:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259522.651962:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259522.651965:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734259522.652000:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734259522.652010:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259522.652015:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259522.652022:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098300928, portal 25 00000400:00000010:1.0:1734259522.652026:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734259522.652027:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098300928, offset 0 00000400:00000200:1.0:1734259522.652036:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259522.652046:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259522.652050:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259522.652052:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259522.652055:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259522.652056:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259522.652059:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1084:1084:255:4294967295] 192.168.202.108@tcp LPNI seq info [1083:1083:7:4294967295] 00000400:00000200:1.0:1734259522.652065:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259522.652080:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259522.652084:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734259522.652088:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259522.652093:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259522.652096:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259522.652286:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259522.652289:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259522.652293:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259522.652298:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259522.652302:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734259522.652303:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734259522.652309:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098301056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259532 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259522.652654:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259522.652656:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734259522.652659:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259522.652662:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259522.652664:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734259522.652666:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734259522.652670:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098300928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259538 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259522.653923:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259522.653939:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621c80 00000400:00000200:0.0:1734259522.653946:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x22c9 [1] + 0 00000400:00000200:0.0:1734259522.653966:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259522.653969:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259522.653976:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098301056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259532 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259522.654041:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259522.654045:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259522.654046:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259522.654050:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098301056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259532 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259522.654056:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098301056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259532 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259522.654085:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259522.654089:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259522.654092:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000400:00000200:0.0:1734259522.655605:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259522.655616:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621c00 00000400:00000200:0.0:1734259522.655623:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x22d1 [1] + 224 00000400:00000200:0.0:1734259522.655638:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259522.655642:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259522.655650:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098300928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259538 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259522.655815:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259522.655820:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259522.655822:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259522.655826:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098300928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259538 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259522.655832:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098300928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259538 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259522.655849:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259522.655853:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259522.655857:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:2.0:1734259527.659942:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259527.659971:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259527.660049:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259527.660058:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259527.660081:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259527.660091:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 02000000:00000010:2.0:1734259527.660095:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:3.0:1734259527.660098:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000010:2.0:1734259527.660099:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000100:00000200:3.0:1734259527.660106:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098301184, portal 25 00000400:00000010:2.0:1734259527.660111:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259527.660111:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734259527.660113:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098301184, offset 0 00000100:00000200:2.0:1734259527.660114:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098301312, portal 10 00000400:00000010:2.0:1734259527.660120:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000400:00000200:3.0:1734259527.660127:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259527.660131:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098301312, offset 0 00000400:00000200:2.0:1734259527.660139:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259527.660143:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259527.660149:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259527.660153:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259527.660161:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259527.660164:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259527.660167:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1085:1085:256:4294967295] 192.168.202.108@tcp LPNI seq info [1084:1084:8:4294967295] 00000400:00000200:3.0:1734259527.660176:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259527.660182:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259527.660183:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259527.660185:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259527.660187:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259527.660189:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259527.660191:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259527.660193:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1086:1086:255:4294967295] 192.168.202.108@tcp LPNI seq info [1085:1085:7:4294967295] 00000400:00000200:2.0:1734259527.660200:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000010:3.0:1734259527.660201:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:2.0:1734259527.660203:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259527.660206:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:3.0:1734259527.660207:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259527.660209:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259527.660217:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259527.660218:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259527.660221:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734259527.660221:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259527.660542:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259527.660549:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259527.660555:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259527.660563:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259527.660615:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734259527.660618:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734259527.660629:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098301312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259537 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259527.660724:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259527.660726:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734259527.660728:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259527.660731:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259527.660733:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734259527.660735:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734259527.660739:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098301184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259543 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259527.663148:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259527.663170:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621d80 00000400:00000200:0.0:1734259527.663178:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x22e1 [1] + 0 00000400:00000200:0.0:1734259527.663189:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259527.663193:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259527.663203:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098301312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259537 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259527.663257:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259527.663261:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621d00 00000400:00000200:0.0:1734259527.663265:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x22d9 [1] + 224 00000400:00000200:0.0:1734259527.663279:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259527.663282:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259527.663287:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098301184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259543 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259527.663445:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259527.663453:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259527.663455:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259527.663463:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098301184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259543 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259527.663470:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098301184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259543 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259527.663473:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259527.663478:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259527.663480:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259527.663492:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098301312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259537 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259527.663498:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098301312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259537 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259527.663499:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259527.663505:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259527.663511:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259527.663532:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259527.663539:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259527.663543:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259532.667839:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259532.667866:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259532.668196:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259532.668202:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259532.668238:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259532.668245:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259532.668252:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259532.668258:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098301568, portal 10 00000400:00000010:2.0:1734259532.668264:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734259532.668266:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098301568, offset 0 00000400:00000200:2.0:1734259532.668275:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259532.668288:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259532.668293:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259532.668296:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259532.668299:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259532.668301:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259532.668304:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1087:1087:256:4294967295] 192.168.202.108@tcp LPNI seq info [1086:1086:8:4294967295] 00000400:00000200:2.0:1734259532.668312:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259532.668317:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259532.668320:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259532.668325:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259532.668332:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259532.668335:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259532.668443:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259532.668447:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259532.668450:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259532.668452:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098301440, portal 25 00000400:00000010:3.0:1734259532.668455:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734259532.668456:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098301440, offset 0 00000400:00000200:3.0:1734259532.668460:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259532.668463:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259532.668466:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259532.668467:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259532.668469:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259532.668471:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259532.668473:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1088:1088:255:4294967295] 192.168.202.108@tcp LPNI seq info [1087:1087:7:4294967295] 00000400:00000200:3.0:1734259532.668479:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259532.668481:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259532.668483:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734259532.668489:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259532.668493:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259532.668495:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259532.668687:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259532.668690:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259532.668695:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259532.668700:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259532.668704:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:0.0:1734259532.668706:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:0.0:1734259532.668713:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098301568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259542 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259532.668776:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259532.668778:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734259532.668780:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259532.668783:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259532.668784:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734259532.668785:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734259532.668789:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098301440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259548 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259532.671499:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259532.671521:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621e00 00000400:00000200:0.0:1734259532.671532:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x22f1 [1] + 224 00000400:00000200:0.0:1734259532.671544:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259532.671547:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259532.671558:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098301440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259548 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259532.671661:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259532.671666:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621e80 00000400:00000200:0.0:1734259532.671673:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x22e9 [1] + 0 00000400:00000200:0.0:1734259532.671690:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259532.671693:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259532.671698:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098301568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259542 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259532.671862:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259532.671867:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259532.671869:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259532.671875:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098301440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259548 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259532.671880:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098301440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259548 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259532.671903:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259532.671908:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259532.671912:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000400:00000010:2.0:1734259532.672038:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259532.672041:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259532.672042:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259532.672046:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098301568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259542 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259532.672052:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098301568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259542 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259532.672070:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259532.672074:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259532.672075:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734259537.675906:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259537.676056:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259537.676115:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259537.676120:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259537.676738:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734259537.676747:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259537.676753:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259537.676759:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098301696, portal 25 00000400:00000010:1.0:1734259537.676762:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734259537.676764:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098301696, offset 0 00000400:00000200:1.0:1734259537.676773:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259537.676784:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259537.676788:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259537.676792:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259537.676794:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259537.676796:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259537.676799:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1089:1089:256:4294967295] 192.168.202.108@tcp LPNI seq info [1088:1088:8:4294967295] 00000400:00000200:1.0:1734259537.676805:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259537.676809:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259537.676824:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734259537.676829:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259537.676835:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259537.676838:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734259537.676884:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259537.676887:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259537.676890:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734259537.676892:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098301824, portal 10 00000400:00000010:1.0:1734259537.676895:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734259537.676896:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098301824, offset 0 00000400:00000200:1.0:1734259537.676899:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259537.676903:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259537.676904:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259537.676906:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259537.676908:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259537.676909:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259537.676911:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1090:1090:255:4294967295] 192.168.202.108@tcp LPNI seq info [1089:1089:7:4294967295] 00000400:00000200:1.0:1734259537.676916:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259537.676918:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259537.676919:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734259537.676921:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259537.676924:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259537.676925:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259537.678665:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259537.678673:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734259537.678679:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259537.678686:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259537.678691:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734259537.678693:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734259537.678702:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098301696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259553 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259537.678771:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259537.678773:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734259537.678776:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259537.678779:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259537.678781:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:0.0:1734259537.678782:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:0.0:1734259537.678786:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098301824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259547 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259537.680415:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259537.680430:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c621f00 00000400:00000200:0.0:1734259537.680438:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x22f9 [1] + 224 00000400:00000200:0.0:1734259537.680458:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259537.680462:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259537.680471:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098301696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259553 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259537.681394:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259537.681403:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259537.681405:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259537.681414:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098301696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259553 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259537.681422:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098301696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259553 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259537.681462:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259537.681467:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:1.0:1734259537.681472:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000400:00000200:0.0:1734259537.682336:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259537.682347:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c621f80 00000400:00000200:0.0:1734259537.682353:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2301 [1] + 0 00000400:00000200:0.0:1734259537.682368:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259537.682372:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259537.682379:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098301824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259547 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259537.682463:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259537.682467:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734259537.682468:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734259537.682473:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098301824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259547 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259537.682479:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098301824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259547 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259537.682496:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259537.682500:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259537.682503:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734259542.684309:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259542.684329:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259542.684381:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259542.684386:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734259542.684465:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734259542.684471:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259542.684477:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734259542.684483:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098301952, portal 25 00000400:00000010:1.0:1734259542.684487:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259542.684489:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098301952, offset 0 00000400:00000200:1.0:1734259542.684496:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259542.684507:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259542.684512:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259542.684516:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259542.684518:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259542.684520:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259542.684522:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1091:1091:256:4294967295] 192.168.202.108@tcp LPNI seq info [1090:1090:8:4294967295] 00000400:00000200:1.0:1734259542.684529:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259542.684534:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259542.684537:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734259542.684551:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:0.0:1734259542.684553:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734259542.684556:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50738. 00000800:00000200:1.0:1734259542.684558:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:0.0:1734259542.684559:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000800:00000200:1.0:1734259542.684560:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:0.0:1734259542.684561:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098302080, portal 10 00000400:00000010:0.0:1734259542.684565:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734259542.684566:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098302080, offset 0 00000400:00000200:0.0:1734259542.684784:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259542.684789:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259542.684791:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259542.684792:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259542.684794:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259542.684795:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259542.684797:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1092:1092:255:4294967295] 192.168.202.108@tcp LPNI seq info [1091:1091:7:4294967295] 00000400:00000200:0.0:1734259542.684801:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259542.684804:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259542.684806:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734259542.684808:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259542.684811:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259542.684813:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259542.684817:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259542.684819:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:1.0:1734259542.684822:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259542.684826:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259542.684829:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:1.0:1734259542.684830:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259542.684947:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098301952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259558 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259542.685333:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259542.685335:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:1.0:1734259542.685338:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259542.685341:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259542.685343:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:1.0:1734259542.685344:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:1.0:1734259542.685348:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098302080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259552 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259542.687636:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259542.687651:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622000 00000400:00000200:0.0:1734259542.687670:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2309 [1] + 224 00000400:00000200:0.0:1734259542.687688:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259542.687692:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259542.687701:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098301952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259558 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259542.688123:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259542.688128:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734259542.688129:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734259542.688134:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098301952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259558 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259542.688140:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098301952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259558 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259542.688160:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259542.688164:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:1.0:1734259542.688167:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000400:00000200:0.0:1734259542.688545:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259542.688552:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622080 00000400:00000200:0.0:1734259542.688557:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2311 [1] + 0 00000400:00000200:0.0:1734259542.688567:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259542.688604:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259542.688609:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098302080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259552 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259542.689745:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50738. 00000400:00000200:2.0:1734259542.689752:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:2.0:1734259542.689754:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:2.0:1734259542.689760:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098302080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259552 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259542.689767:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098302080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259552 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259542.689787:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734259542.689791:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259542.689795:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734259547.691675:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259547.691696:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 02000000:00000010:3.0:1734259547.691775:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259547.691783:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259547.691789:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259547.691795:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098302208, portal 25 00000400:00000010:3.0:1734259547.691799:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734259547.691800:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098302208, offset 0 00000400:00000200:3.0:1734259547.691808:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000010:2.0:1734259547.691812:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 00000400:00000200:3.0:1734259547.691820:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259547.691824:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:2.0:1734259547.691827:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:3.0:1734259547.691828:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259547.691831:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259547.691832:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259547.691835:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1093:1093:256:4294967295] 192.168.202.108@tcp LPNI seq info [1092:1092:8:4294967295] 00000400:00000200:3.0:1734259547.691842:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259547.691847:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259547.691850:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734259547.691854:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:2.0:1734259547.691864:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000800:00000200:3.0:1734259547.691866:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:2.0:1734259547.691868:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000800:00000200:3.0:1734259547.691869:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734259547.691871:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259547.691874:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098302336, portal 10 00000400:00000010:2.0:1734259547.691878:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259547.691879:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098302336, offset 0 00000400:00000200:2.0:1734259547.691884:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259547.691996:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259547.691999:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734259547.692002:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259547.692007:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259547.692009:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734259547.692011:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734259547.692016:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098302208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259563 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734259547.692409:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259547.692412:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259547.692415:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259547.692416:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259547.692418:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259547.692421:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1094:1094:255:4294967295] 192.168.202.108@tcp LPNI seq info [1093:1093:7:4294967295] 00000400:00000200:2.0:1734259547.692427:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259547.692431:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259547.692433:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259547.692436:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259547.692440:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259547.692442:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259547.692521:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259547.692523:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259547.692526:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259547.692529:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259547.692531:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734259547.692532:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734259547.692536:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098302336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259557 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259547.694996:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259547.695012:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622100 00000400:00000200:0.0:1734259547.695027:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2319 [1] + 224 00000400:00000200:0.0:1734259547.695039:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259547.695042:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259547.695048:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098302208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259563 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259547.695072:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259547.695075:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622180 00000400:00000200:0.0:1734259547.695079:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2321 [1] + 0 00000400:00000200:0.0:1734259547.695087:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259547.695089:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259547.695091:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098302336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259547.695107:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259547.695111:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259547.695113:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259547.695118:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098302208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259563 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259547.695125:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098302208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259563 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259547.695143:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259547.695148:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259547.695151:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000400:00000010:2.0:1734259547.695173:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259547.695176:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259547.695177:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259547.695181:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098302336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259557 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259547.695187:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098302336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259557 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259547.695203:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259547.695206:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259547.695208:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734259552.699729:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259552.699753:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259552.699815:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259552.699821:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259552.699855:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259552.699861:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259552.699868:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259552.699875:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098302592, portal 10 00000400:00000010:2.0:1734259552.699881:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734259552.699883:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098302592, offset 0 00000400:00000200:2.0:1734259552.699891:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259552.699903:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259552.699908:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259552.699911:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259552.699914:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259552.699916:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259552.699919:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1095:1095:256:4294967295] 192.168.202.108@tcp LPNI seq info [1094:1094:8:4294967295] 00000400:00000200:2.0:1734259552.699926:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259552.699930:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259552.699934:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 02000000:00000010:1.0:1734259552.699935:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000800:00000200:2.0:1734259552.699939:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:1.0:1734259552.699945:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000800:00000200:2.0:1734259552.699947:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:1.0:1734259552.699949:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000800:00000200:2.0:1734259552.699950:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:1.0:1734259552.699965:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098302464, portal 25 00000400:00000010:1.0:1734259552.699967:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734259552.699968:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098302464, offset 0 00000400:00000200:1.0:1734259552.699973:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259552.699977:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259552.699979:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259552.699982:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259552.699984:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259552.699985:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259552.699987:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1096:1096:255:4294967295] 192.168.202.108@tcp LPNI seq info [1095:1095:7:4294967295] 00000400:00000200:1.0:1734259552.699993:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259552.699997:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259552.699999:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734259552.700002:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259552.700005:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259552.700007:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259552.700102:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259552.700105:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259552.700109:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259552.700113:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259552.700117:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734259552.700118:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734259552.700125:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098302592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259562 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259552.700330:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259552.700332:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734259552.700335:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259552.700338:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259552.700340:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:0.0:1734259552.700341:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:0.0:1734259552.700345:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098302464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259568 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259552.703190:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259552.703208:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622280 00000400:00000200:0.0:1734259552.704117:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2329 [1] + 0 00000400:00000200:0.0:1734259552.704134:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259552.704138:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259552.704147:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098302592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259562 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259552.704340:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259552.704346:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622200 00000400:00000200:0.0:1734259552.704351:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2331 [1] + 224 00000400:00000200:0.0:1734259552.704363:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259552.704365:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259552.704370:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098302464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259568 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259552.704460:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259552.704464:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259552.704466:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259552.704470:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098302592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259562 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259552.704476:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098302592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259562 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259552.704535:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259552.704540:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259552.704543:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000400:00000010:1.0:1734259552.704673:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259552.704677:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734259552.704678:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734259552.704682:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098302464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259568 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259552.704687:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098302464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259568 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259552.704698:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259552.704701:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:1.0:1734259552.704704:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734259557.707687:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259557.707707:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259557.707766:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259557.707773:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259557.707806:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259557.707811:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:2.0:1734259557.707814:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:1.0:1734259557.707816:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259557.707821:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000400:00000010:2.0:1734259557.707821:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:1.0:1734259557.707827:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098302720, portal 25 00000400:00000010:1.0:1734259557.707831:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:2.0:1734259557.708030:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098302848, portal 10 00000100:00000200:1.0:1734259557.708031:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098302720, offset 0 00000400:00000010:2.0:1734259557.708036:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000400:00000200:1.0:1734259557.708042:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259557.708046:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098302848, offset 0 00000400:00000200:2.0:1734259557.708051:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259557.708055:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259557.708061:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259557.708065:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259557.708068:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259557.708070:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259557.708073:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1097:1097:256:4294967295] 192.168.202.108@tcp LPNI seq info [1096:1096:8:4294967295] 00000400:00000200:1.0:1734259557.708081:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259557.708086:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259557.708087:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259557.708089:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734259557.708090:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000400:00000200:2.0:1734259557.708091:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259557.708093:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259557.708095:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734259557.708096:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259557.708097:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1098:1098:255:4294967295] 192.168.202.108@tcp LPNI seq info [1097:1097:7:4294967295] 00000400:00000200:2.0:1734259557.708103:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259557.708105:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259557.708106:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734259557.708108:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:2.0:1734259557.708109:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259557.708112:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259557.708115:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259557.708117:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259557.708730:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259557.708735:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734259557.708740:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259557.708745:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259557.708750:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:0.0:1734259557.708752:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:0.0:1734259557.708761:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098302720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259573 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259557.708845:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259557.708846:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259557.708849:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259557.708852:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259557.708854:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734259557.708855:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734259557.708858:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098302848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259567 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259557.712320:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259557.712345:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622300 00000400:00000200:0.0:1734259557.712374:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2339 [1] + 224 00000400:00000200:0.0:1734259557.712391:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259557.712395:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259557.712408:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098302720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259573 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259557.712449:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259557.712453:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622380 00000400:00000200:0.0:1734259557.712458:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x233d [1] + 0 00000400:00000200:0.0:1734259557.712498:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259557.712501:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259557.712506:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098302848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259557.712681:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259557.712686:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734259557.712688:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734259557.712694:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098302720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259573 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259557.712700:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098302720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259573 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259557.712727:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259557.712732:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:1.0:1734259557.712736:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000400:00000010:2.0:1734259557.712864:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259557.712880:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259557.712882:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259557.712913:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098302848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259567 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259557.712923:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098302848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259567 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259557.712955:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259557.712963:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259557.712967:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734259562.715683:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259562.715703:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 02000000:00000010:1.0:1734259562.715985:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734259562.715992:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000100:00000010:2.0:1734259562.715999:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 00000400:00000010:1.0:1734259562.716002:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 02000000:00000010:2.0:1734259562.716007:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 00000100:00000200:1.0:1734259562.716009:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098302976, portal 25 00000400:00000010:1.0:1734259562.716013:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734259562.716014:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098302976, offset 0 00000400:00000200:1.0:1734259562.716022:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259562.716044:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259562.716048:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259562.716052:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259562.716054:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259562.716056:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259562.716059:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1099:1099:256:4294967295] 192.168.202.108@tcp LPNI seq info [1098:1098:8:4294967295] 00000400:00000200:1.0:1734259562.716071:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259562.716075:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259562.716079:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734259562.716084:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259562.716092:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259562.716095:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734259562.716146:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0bc00. 00000400:00000010:1.0:1734259562.716149:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259562.716151:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259562.716153:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098303104, portal 10 00000400:00000010:1.0:1734259562.716157:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734259562.716158:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098303104, offset 0 00000400:00000200:1.0:1734259562.716161:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259562.716165:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259562.716167:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259562.716169:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259562.716170:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259562.716172:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259562.716174:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1100:1100:255:4294967295] 192.168.202.108@tcp LPNI seq info [1099:1099:7:4294967295] 00000400:00000200:1.0:1734259562.716179:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259562.716182:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259562.716184:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734259562.716186:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259562.716189:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259562.716194:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259562.716292:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259562.716295:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734259562.716299:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259562.716304:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259562.716307:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:0.0:1734259562.716308:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:0.0:1734259562.716315:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098302976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259578 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259562.716371:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259562.716373:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734259562.716375:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259562.716378:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259562.716380:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:0.0:1734259562.716381:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734259562.716384:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098303104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259572 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259562.718623:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259562.718638:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622400 00000400:00000200:0.0:1734259562.718653:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2349 [1] + 224 00000400:00000200:0.0:1734259562.718663:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259562.718666:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259562.718676:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098302976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259578 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259562.718713:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259562.718717:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622480 00000400:00000200:0.0:1734259562.718721:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2351 [1] + 0 00000400:00000010:1.0:1734259562.718786:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259562.718799:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:1.0:1734259562.718801:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734259562.718809:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098302976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259578 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259562.718815:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098302976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259578 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259562.718837:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259562.718841:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:1.0:1734259562.718846:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000400:00000200:0.0:1734259562.719002:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259562.719006:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259562.719011:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098303104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259572 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259562.719045:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259562.719047:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259562.719048:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259562.719051:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098303104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259572 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259562.719055:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098303104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259572 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259562.719067:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0bc00. 02000000:00000010:1.0:1734259562.719070:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259562.719072:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:2.0:1734259567.724029:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259567.724048:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259567.724099:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259567.724105:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259567.724143:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734259567.724151:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259567.724157:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259567.724163:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098303232, portal 25 00000400:00000010:1.0:1734259567.724167:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734259567.724168:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098303232, offset 0 02000000:00000010:0.0:1734259567.724171:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000200:1.0:1734259567.724175:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:0.0:1734259567.724176:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d506e0. 00000400:00000010:0.0:1734259567.724179:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000100:00000200:0.0:1734259567.724181:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098303360, portal 10 00000400:00000010:0.0:1734259567.724185:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:0.0:1734259567.724186:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098303360, offset 0 00000400:00000200:1.0:1734259567.724186:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259567.724190:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259567.724191:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259567.724194:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259567.724206:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259567.724208:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259567.724210:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1101:1101:256:4294967295] 192.168.202.108@tcp LPNI seq info [1100:1100:8:4294967295] 00000400:00000200:1.0:1734259567.724218:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259567.724222:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259567.724224:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259567.724225:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734259567.724226:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259567.724228:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259567.724230:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734259567.724230:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259567.724232:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259567.724234:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1102:1102:255:4294967295] 192.168.202.108@tcp LPNI seq info [1101:1101:7:4294967295] 00000800:00000200:1.0:1734259567.724236:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259567.724239:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734259567.724240:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259567.724244:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259567.724246:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734259567.724248:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259567.724257:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259567.724259:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259567.724331:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259567.724333:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:2.0:1734259567.724338:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259567.724342:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259567.724345:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:2.0:1734259567.724347:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:2.0:1734259567.724354:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098303232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259583 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259567.724950:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259567.724954:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:2.0:1734259567.724958:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259567.724961:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259567.724964:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:2.0:1734259567.724965:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:2.0:1734259567.724970:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098303360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259577 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259567.727490:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259567.727506:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622500 00000400:00000200:0.0:1734259567.727513:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2359 [1] + 224 00000400:00000200:0.0:1734259567.727523:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259567.727526:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259567.727534:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098303232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259583 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259567.727594:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259567.727599:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622580 00000400:00000200:0.0:1734259567.727603:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2361 [1] + 0 00000400:00000200:0.0:1734259567.727616:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259567.727619:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259567.727623:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098303360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259577 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259567.727692:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d506e0. 00000400:00000200:2.0:1734259567.727697:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:2.0:1734259567.727699:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:2.0:1734259567.727704:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098303360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259577 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259567.727705:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259567.727708:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259567.727710:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:2.0:1734259567.727711:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098303360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259577 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259567.727714:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098303232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259583 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259567.727719:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098303232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259583 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259567.727732:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:2.0:1734259567.727733:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:1.0:1734259567.727736:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 02000000:00000010:2.0:1734259567.727736:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259567.727739:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734259567.727739:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734259572.731701:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259572.731726:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259572.731784:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259572.731790:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259572.731824:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259572.731831:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259572.731837:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259572.731843:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098303616, portal 10 00000400:00000010:2.0:1734259572.731849:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734259572.731851:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098303616, offset 0 00000400:00000200:2.0:1734259572.731859:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259572.731870:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259572.731874:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259572.731877:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259572.731880:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 02000000:00000010:1.0:1734259572.731881:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000200:2.0:1734259572.731881:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259572.731883:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1103:1103:256:4294967295] 192.168.202.108@tcp LPNI seq info [1102:1102:8:4294967295] 00000400:00000010:1.0:1734259572.731886:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259572.731888:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259572.731890:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098303488, portal 25 00000400:00000200:2.0:1734259572.731891:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734259572.731892:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734259572.731893:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098303488, offset 0 00000800:00000200:2.0:1734259572.731896:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259572.731897:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259572.731901:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259572.731902:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259572.731904:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259572.731905:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259572.731907:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000010:2.0:1734259572.731910:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259572.731912:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1104:1104:255:4294967295] 192.168.202.108@tcp LPNI seq info [1103:1103:7:4294967295] 00000800:00000200:2.0:1734259572.731916:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259572.731917:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259572.731919:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259572.731921:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734259572.731924:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259572.731924:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259572.731927:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259572.731929:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259572.732265:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259572.732270:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734259572.732274:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259572.732278:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259572.732281:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:0.0:1734259572.732284:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:0.0:1734259572.732292:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098303488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259588 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259572.732633:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259572.732837:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259572.732839:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259572.732842:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259572.732846:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259572.732848:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734259572.732855:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734259572.732859:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098303616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259582 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259572.738021:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259572.738042:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622600 00000400:00000200:0.0:1734259572.738051:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2371 [1] + 224 00000400:00000200:0.0:1734259572.738073:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259572.738078:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259572.738088:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098303488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259588 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259572.738199:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259572.738206:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259572.738208:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259572.738213:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098303488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259588 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259572.738220:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098303488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259588 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259572.738242:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259572.738248:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:1.0:1734259572.738252:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000400:00000200:0.0:1734259572.740135:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259572.740159:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622680 00000400:00000200:0.0:1734259572.740169:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2369 [1] + 0 00000400:00000200:0.0:1734259572.740197:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259572.740202:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259572.740214:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098303616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259582 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259572.740328:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259572.740333:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259572.740335:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259572.740341:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098303616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259582 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259572.740363:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098303616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259582 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259572.740400:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259572.740407:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259572.740412:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:2.0:1734259577.739765:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259577.739793:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 02000000:00000010:3.0:1734259577.739926:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259577.739935:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259577.739942:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259577.739949:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098303744, portal 25 00000400:00000010:3.0:1734259577.739954:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734259577.739955:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098303744, offset 0 00000400:00000200:3.0:1734259577.739963:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259577.739977:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259577.739982:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259577.739985:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259577.739988:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259577.739990:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259577.739993:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1105:1105:256:4294967295] 192.168.202.108@tcp LPNI seq info [1104:1104:8:4294967295] 00000100:00000010:2.0:1734259577.739998:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 00000400:00000200:3.0:1734259577.740001:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:2.0:1734259577.740004:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 00000800:00000200:3.0:1734259577.740006:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259577.740009:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734259577.740014:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259577.740022:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 02000000:00000010:2.0:1734259577.740029:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259577.740034:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000800:00000200:3.0:1734259577.740035:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734259577.740037:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259577.740039:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098303872, portal 10 00000400:00000010:2.0:1734259577.740044:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734259577.740046:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098303872, offset 0 00000400:00000200:2.0:1734259577.740050:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259577.740055:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259577.740057:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259577.740059:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259577.740061:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259577.740063:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259577.740065:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1106:1106:255:4294967295] 192.168.202.108@tcp LPNI seq info [1105:1105:7:4294967295] 00000400:00000200:2.0:1734259577.740076:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259577.740080:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259577.740083:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259577.740086:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259577.740089:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259577.740091:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259577.740154:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259577.740157:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734259577.740160:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259577.740164:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259577.740168:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:0.0:1734259577.740170:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:0.0:1734259577.740176:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098303744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259593 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259577.740305:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259577.740318:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259577.740321:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259577.740324:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259577.740325:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734259577.740332:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734259577.740335:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098303872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259587 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259577.742637:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259577.742655:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622700 00000400:00000200:0.0:1734259577.742663:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2379 [1] + 224 00000400:00000200:0.0:1734259577.742681:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259577.742685:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259577.742694:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098303744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259593 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259577.742911:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259577.742916:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259577.742918:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259577.742922:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098303744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259593 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259577.742928:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098303744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259593 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259577.742951:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259577.742956:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259577.742960:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000200:0.0:1734259577.743396:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259577.743404:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622780 00000400:00000200:0.0:1734259577.743409:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2381 [1] + 0 00000400:00000200:0.0:1734259577.743717:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259577.743721:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259577.743728:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098303872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259587 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259577.743814:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259577.743819:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259577.743820:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259577.743826:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098303872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259587 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259577.743831:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098303872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259587 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259577.743852:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259577.743856:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259577.743858:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:2.0:1734259582.747714:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259582.747736:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259582.747806:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259582.747815:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259582.747858:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259582.747859:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:2.0:1734259582.747865:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:3.0:1734259582.747865:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259582.747873:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259582.747873:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259582.747879:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098304128, portal 10 00000100:00000200:3.0:1734259582.747882:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098304000, portal 25 00000400:00000010:2.0:1734259582.747885:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000400:00000010:3.0:1734259582.747885:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:2.0:1734259582.747887:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098304128, offset 0 00000100:00000200:3.0:1734259582.747887:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098304000, offset 0 00000400:00000200:3.0:1734259582.747896:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259582.747903:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259582.747911:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259582.747917:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259582.747921:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259582.747924:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259582.747926:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259582.747929:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1107:1107:256:4294967295] 192.168.202.108@tcp LPNI seq info [1106:1106:8:4294967295] 00000400:00000200:3.0:1734259582.747937:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259582.747942:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259582.747943:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259582.747945:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734259582.747946:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000400:00000200:2.0:1734259582.747947:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734259582.747952:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259582.747959:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259582.747964:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259582.747973:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259582.747975:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259582.747977:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1108:1108:255:4294967295] 192.168.202.108@tcp LPNI seq info [1107:1107:7:4294967295] 00000400:00000200:2.0:1734259582.747983:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259582.747987:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259582.747991:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259582.747994:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259582.748003:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259582.748005:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259582.748115:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259582.748119:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734259582.748124:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259582.748128:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259582.748132:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734259582.748134:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734259582.748143:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098304000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259598 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259582.748411:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259582.748414:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259582.748417:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259582.748420:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259582.748423:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734259582.748430:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734259582.748434:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098304128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259592 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259582.750211:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259582.750234:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622800 00000400:00000200:0.0:1734259582.750243:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x238d [1] + 224 00000400:00000200:0.0:1734259582.750257:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259582.750261:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259582.750286:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098304000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259598 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259582.750331:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259582.750336:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622880 00000400:00000200:0.0:1734259582.750342:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2389 [1] + 0 00000400:00000200:0.0:1734259582.750362:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259582.750366:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259582.750370:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098304128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259592 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259582.750475:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259582.750486:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259582.750488:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000400:00000010:2.0:1734259582.750500:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000100:00000200:3.0:1734259582.750502:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098304000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259598 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734259582.750505:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259582.750506:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:3.0:1734259582.750511:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098304000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259598 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259582.750512:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098304128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259592 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259582.750519:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098304128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259592 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259582.750532:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:2.0:1734259582.750538:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259582.750538:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734259582.750541:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259582.750542:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259582.750544:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259587.755694:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259587.755711:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259587.755763:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259587.755769:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259587.755798:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259587.755804:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259587.755810:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259587.755815:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098304384, portal 10 00000400:00000010:2.0:1734259587.755820:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734259587.755822:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098304384, offset 0 00000400:00000200:2.0:1734259587.755829:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259587.755849:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259587.755853:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259587.755857:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259587.755860:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259587.755862:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259587.755864:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1109:1109:256:4294967295] 192.168.202.108@tcp LPNI seq info [1108:1108:8:4294967295] 02000000:00000010:3.0:1734259587.755864:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259587.755869:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000200:2.0:1734259587.755872:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:3.0:1734259587.755872:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259587.755874:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098304256, portal 25 00000800:00000200:2.0:1734259587.755876:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734259587.755877:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734259587.755878:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098304256, offset 0 00000800:00000010:2.0:1734259587.755879:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259587.755883:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259587.755884:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259587.755888:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734259587.755889:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259587.755890:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:2.0:1734259587.755892:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734259587.755892:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259587.755894:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259587.755895:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259587.755897:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1110:1110:255:4294967295] 192.168.202.108@tcp LPNI seq info [1109:1109:7:4294967295] 00000400:00000200:3.0:1734259587.755903:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259587.755906:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259587.755908:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734259587.755911:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259587.755914:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259587.755916:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259587.756035:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259587.756038:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259587.756042:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259587.756046:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259587.756049:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734259587.756051:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734259587.756057:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098304384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259597 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259587.756109:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259587.756110:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734259587.756112:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259587.756115:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259587.756116:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734259587.756121:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:0.0:1734259587.756125:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098304256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259603 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259587.758062:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259587.758077:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622900 00000400:00000200:0.0:1734259587.758083:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x23a1 [1] + 224 00000400:00000200:0.0:1734259587.758092:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259587.758095:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259587.758102:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098304256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259603 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259587.758136:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259587.758139:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622980 00000400:00000200:0.0:1734259587.758143:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2399 [1] + 0 00000400:00000200:0.0:1734259587.758156:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259587.758159:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259587.758163:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098304384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259597 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259587.758329:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259587.758338:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259587.758340:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259587.758344:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098304256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259603 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259587.758350:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098304256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259603 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259587.758368:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259587.758372:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259587.758376:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000010:2.0:1734259587.758523:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259587.758526:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259587.758528:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259587.758531:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098304384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259597 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259587.758537:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098304384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259597 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259587.758551:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259587.758555:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259587.758556:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000100:00000010:2.0:1734259592.763904:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259592.763921:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259592.764336:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259592.764343:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259592.764370:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259592.764371:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:2.0:1734259592.764376:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:3.0:1734259592.764376:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259592.764380:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259592.764380:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:2.0:1734259592.764386:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098304640, portal 10 00000100:00000200:3.0:1734259592.764386:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098304512, portal 25 00000400:00000010:3.0:1734259592.764389:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734259592.764391:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098304512, offset 0 00000400:00000200:3.0:1734259592.764398:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259592.764401:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000400:00000200:3.0:1734259592.764408:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259592.764412:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259592.764415:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259592.764417:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259592.764419:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259592.764421:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1111:1111:256:4294967295] 192.168.202.108@tcp LPNI seq info [1110:1110:8:4294967295] 00000400:00000200:3.0:1734259592.764429:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259592.764433:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259592.764437:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734259592.764442:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259592.764448:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259592.764451:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:2.0:1734259592.764667:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098304640, offset 0 00000400:00000200:2.0:1734259592.764673:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259592.764677:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259592.764685:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259592.764687:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259592.764689:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259592.764691:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259592.764693:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1112:1112:255:4294967295] 192.168.202.108@tcp LPNI seq info [1111:1111:7:4294967295] 00000400:00000200:2.0:1734259592.764698:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259592.764702:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259592.764705:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259592.764708:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259592.764712:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259592.764713:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259592.764792:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259592.764795:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734259592.764800:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259592.764804:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259592.764807:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734259592.764808:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734259592.764815:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098304512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259608 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259592.764877:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259592.764878:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259592.764881:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259592.764883:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259592.764885:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734259592.764891:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734259592.764895:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098304640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259602 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259592.766649:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259592.766663:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622a00 00000400:00000200:0.0:1734259592.766705:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x23a9 [1] + 224 00000400:00000200:0.0:1734259592.766716:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259592.766718:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259592.766725:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098304512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259608 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259592.766762:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259592.766766:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622a80 00000400:00000200:0.0:1734259592.766771:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x23ad [1] + 0 00000400:00000200:0.0:1734259592.766784:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259592.766787:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259592.766791:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098304640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259602 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259592.767009:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259592.767013:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259592.767014:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259592.767026:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098304512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259608 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259592.767032:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098304512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259608 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259592.767050:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259592.767054:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734259592.767057:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000400:00000010:2.0:1734259592.767685:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259592.767689:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259592.767690:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259592.767695:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098304640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259602 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259592.767702:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098304640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259602 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259592.767716:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259592.767719:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259592.767721:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:0.0:1734259597.771903:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734259597.771927:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734259597.771989:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734259597.771995:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734259597.772044:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259597.772049:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259597.772055:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259597.772061:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098304896, portal 10 00000400:00000010:2.0:1734259597.772066:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734259597.772081:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098304896, offset 0 00000400:00000200:2.0:1734259597.772090:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259597.772101:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259597.772106:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259597.772110:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259597.772112:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259597.772114:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259597.772117:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1113:1113:256:4294967295] 192.168.202.108@tcp LPNI seq info [1112:1112:8:4294967295] 00000400:00000200:2.0:1734259597.772123:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259597.772128:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259597.772132:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259597.772136:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259597.772143:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259597.772146:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734259597.772225:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:1.0:1734259597.772230:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259597.772234:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259597.772236:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098304768, portal 25 00000400:00000010:1.0:1734259597.772239:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734259597.772241:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098304768, offset 0 00000400:00000200:1.0:1734259597.772245:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259597.772249:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259597.772251:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259597.772253:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259597.772255:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259597.772257:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259597.772259:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1114:1114:255:4294967295] 192.168.202.108@tcp LPNI seq info [1113:1113:7:4294967295] 00000400:00000200:1.0:1734259597.772278:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259597.772282:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259597.772284:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734259597.772287:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259597.772290:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259597.772292:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259597.772312:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259597.772314:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259597.772318:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259597.772322:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259597.772325:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734259597.772327:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734259597.772333:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098304896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259607 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259597.772365:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259597.772367:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734259597.772369:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259597.772372:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259597.772374:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734259597.772375:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734259597.772377:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098304768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259613 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259597.774301:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259597.774320:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622b00 00000400:00000200:0.0:1734259597.774328:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x23c1 [1] + 224 00000400:00000200:0.0:1734259597.774341:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259597.774344:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259597.774356:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098304768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259613 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259597.774399:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259597.774403:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622b80 00000400:00000200:0.0:1734259597.774408:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x23b9 [1] + 0 00000400:00000200:0.0:1734259597.774423:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259597.774426:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259597.774430:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098304896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259607 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259597.774600:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259597.774605:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259597.774607:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259597.774613:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098304896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259607 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259597.774619:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098304896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259607 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259597.774647:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259597.774653:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734259597.774657:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:1.0:1734259597.774724:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259597.774727:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259597.774728:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259597.774733:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098304768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259613 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259597.774737:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098304768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259613 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259597.774748:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734259597.774750:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734259597.774752:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:2.0:1734259602.779982:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259602.780002:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259602.780055:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259602.780061:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259602.780089:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259602.780095:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259602.780111:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259602.780147:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098305152, portal 10 00000400:00000010:2.0:1734259602.780153:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734259602.780155:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098305152, offset 0 00000400:00000200:2.0:1734259602.780163:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259602.780173:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259602.780178:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259602.780182:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259602.780184:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 02000000:00000010:1.0:1734259602.780185:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000200:2.0:1734259602.780186:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:1.0:1734259602.780189:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000200:2.0:1734259602.780189:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1115:1115:256:4294967295] 192.168.202.108@tcp LPNI seq info [1114:1114:8:4294967295] 00000400:00000010:1.0:1734259602.780192:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259602.780194:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098305024, portal 25 00000400:00000010:1.0:1734259602.780196:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000400:00000200:2.0:1734259602.780196:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:1.0:1734259602.780197:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098305024, offset 0 00000400:00000200:1.0:1734259602.780200:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734259602.780201:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259602.780204:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734259602.780204:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259602.780206:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259602.780207:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259602.780209:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259602.780209:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259602.780210:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259602.780212:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1116:1116:255:4294967295] 192.168.202.108@tcp LPNI seq info [1115:1115:7:4294967295] 00000800:00000200:2.0:1734259602.780215:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734259602.780217:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259602.780218:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259602.780224:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259602.780226:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734259602.780228:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259602.780231:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259602.780233:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259602.780300:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259602.780304:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259602.780308:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259602.780312:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259602.780316:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734259602.780317:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734259602.780328:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098305152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259612 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259602.780389:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259602.780397:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734259602.780399:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259602.780403:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259602.780405:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:0.0:1734259602.780406:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:0.0:1734259602.780411:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098305024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259618 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259602.781871:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259602.781884:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622c00 00000400:00000200:0.0:1734259602.781890:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x23d1 [1] + 224 00000400:00000200:0.0:1734259602.781899:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259602.781902:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259602.781909:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098305024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259618 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259602.781941:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259602.781945:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622c80 00000400:00000200:0.0:1734259602.781949:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x23c9 [1] + 0 00000400:00000200:0.0:1734259602.781964:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259602.781966:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259602.781970:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098305152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259612 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259602.782058:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259602.782062:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259602.782063:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259602.782068:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098305024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259618 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259602.782073:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098305024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259618 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259602.782093:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734259602.782097:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259602.782102:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000010:2.0:1734259602.782231:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259602.782235:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259602.782236:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259602.782241:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098305152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259612 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259602.782247:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098305152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259612 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259602.782262:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259602.782266:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259602.782268:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:0.0:1734259607.787787:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734259607.787806:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734259607.787863:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734259607.787868:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734259607.787953:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259607.787960:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259607.787967:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259607.787973:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098305280, portal 25 00000400:00000010:3.0:1734259607.787978:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734259607.787980:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098305280, offset 0 00000400:00000200:3.0:1734259607.787988:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259607.787999:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259607.788003:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259607.788007:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259607.788010:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259607.788011:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259607.788014:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1117:1117:256:4294967295] 192.168.202.108@tcp LPNI seq info [1116:1116:8:4294967295] 00000400:00000200:3.0:1734259607.788022:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259607.788027:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259607.788030:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734259607.788034:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259607.788041:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259607.788044:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259607.788156:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259607.788159:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:1.0:1734259607.788162:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259607.788166:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 02000000:00000010:2.0:1734259607.788168:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:1.0:1734259607.788170:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:1.0:1734259607.788171:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000400:00000010:2.0:1734259607.788171:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259607.788174:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:1.0:1734259607.788176:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098305280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259623 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259607.788185:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098305408, portal 10 00000400:00000010:2.0:1734259607.788188:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734259607.788190:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098305408, offset 0 00000400:00000200:2.0:1734259607.788193:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259607.788197:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259607.788199:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259607.788201:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259607.788203:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259607.788205:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259607.788206:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1118:1118:256:4294967295] 192.168.202.108@tcp LPNI seq info [1117:1117:8:4294967295] 00000400:00000200:2.0:1734259607.788212:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259607.788215:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259607.788217:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259607.788219:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259607.788222:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259607.788224:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259607.788286:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259607.788292:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259607.788294:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259607.788297:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259607.788299:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734259607.788300:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734259607.788304:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098305408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259617 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259607.789875:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259607.789892:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622d00 00000400:00000200:0.0:1734259607.789900:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x23d9 [1] + 224 00000400:00000200:0.0:1734259607.789918:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259607.789922:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259607.789931:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098305280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259623 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259607.789997:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259607.790002:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259607.790003:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259607.790008:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098305280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259623 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259607.790021:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098305280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259623 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259607.790039:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259607.790044:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734259607.790047:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000200:0.0:1734259607.791528:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259607.791542:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622d80 00000400:00000200:0.0:1734259607.791548:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x23e1 [1] + 0 00000400:00000200:0.0:1734259607.791565:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259607.791589:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259607.791598:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098305408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259617 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259607.791767:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259607.791772:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259607.791779:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259607.791784:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098305408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259617 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259607.791789:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098305408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259617 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259607.791814:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259607.791818:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734259607.791821:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734259612.795679:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734259612.795699:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734259612.795752:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734259612.795757:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734259612.795793:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259612.795801:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259612.795806:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259612.795812:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098305536, portal 25 00000400:00000010:3.0:1734259612.795815:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734259612.795817:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098305536, offset 0 00000400:00000200:3.0:1734259612.795825:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259612.795840:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259612.795844:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259612.795847:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259612.795850:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259612.795851:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259612.795854:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1119:1119:256:4294967295] 192.168.202.108@tcp LPNI seq info [1118:1118:8:4294967295] 00000400:00000200:3.0:1734259612.795861:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259612.795866:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259612.795869:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734259612.795874:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259612.795881:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259612.795884:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259612.795888:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259612.795892:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259612.795895:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259612.795898:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098305664, portal 10 00000400:00000010:2.0:1734259612.795920:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734259612.795922:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098305664, offset 0 00000400:00000200:2.0:1734259612.795926:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259612.795931:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259612.795933:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259612.795935:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259612.795937:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259612.795938:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259612.795940:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1120:1120:255:4294967295] 192.168.202.108@tcp LPNI seq info [1119:1119:7:4294967295] 00000400:00000200:2.0:1734259612.795946:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259612.795950:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259612.795952:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259612.795954:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259612.795956:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259612.795958:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259612.795978:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259612.795980:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734259612.795982:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259612.795986:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259612.795988:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734259612.795992:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:0.0:1734259612.795998:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098305536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259628 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259612.796017:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259612.796018:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259612.796020:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259612.796021:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259612.796023:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:0.0:1734259612.796023:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734259612.796025:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098305664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259622 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259612.797466:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259612.797480:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622e00 00000400:00000200:0.0:1734259612.797486:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x23e9 [1] + 224 00000400:00000200:0.0:1734259612.797499:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259612.797502:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259612.797509:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098305536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259628 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259612.797698:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259612.797703:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622e80 00000400:00000200:0.0:1734259612.797707:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x23f1 [1] + 0 00000400:00000200:0.0:1734259612.797714:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259612.797716:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259612.797720:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098305664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259622 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259612.797780:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259612.797785:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259612.797786:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259612.797791:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098305664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259622 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259612.797797:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000100:00000200:2.0:1734259612.797798:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098305664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259622 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734259612.797800:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259612.797802:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259612.797806:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098305536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259628 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259612.797819:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 00000100:00000200:3.0:1734259612.797822:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098305536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259628 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259612.797824:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734259612.797827:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 02000000:00000010:3.0:1734259612.797833:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259612.797836:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734259612.797838:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734259617.803713:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734259617.803738:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734259617.803805:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734259617.803812:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734259617.803833:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259617.803842:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259617.803849:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259617.803855:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098305792, portal 25 00000400:00000010:3.0:1734259617.803859:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734259617.803860:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098305792, offset 0 00000400:00000200:3.0:1734259617.803870:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259617.803883:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259617.803889:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259617.803893:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259617.803896:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259617.803898:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259617.803901:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1121:1121:256:4294967295] 192.168.202.108@tcp LPNI seq info [1120:1120:8:4294967295] 02000000:00000010:2.0:1734259617.803903:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259617.803907:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000200:3.0:1734259617.803909:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:2.0:1734259617.803910:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259617.803913:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098305920, portal 10 00000800:00000200:3.0:1734259617.803914:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259617.803917:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000400:00000010:2.0:1734259617.803918:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734259617.803924:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098305920, offset 0 00000800:00000200:3.0:1734259617.803929:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259617.803930:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259617.803934:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734259617.803936:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259617.803937:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259617.803939:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734259617.803939:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259617.803941:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259617.803942:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259617.803944:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1122:1122:255:4294967295] 192.168.202.108@tcp LPNI seq info [1121:1121:7:4294967295] 00000400:00000200:2.0:1734259617.803949:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259617.803952:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259617.803955:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259617.803958:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259617.803961:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259617.803963:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259617.804073:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259617.804076:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734259617.804080:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259617.804083:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259617.804087:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734259617.804089:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734259617.804096:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098305792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259633 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259617.804169:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259617.804171:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259617.804173:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259617.804176:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259617.804178:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734259617.804179:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734259617.804182:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098305920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259627 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259617.805823:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259617.805843:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c622f00 00000400:00000200:0.0:1734259617.805849:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x23f9 [1] + 224 00000400:00000200:0.0:1734259617.805862:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259617.805865:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259617.805878:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098305792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259633 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259617.805919:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259617.805924:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c622f80 00000400:00000200:0.0:1734259617.805929:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2401 [1] + 0 00000400:00000200:0.0:1734259617.805944:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259617.805946:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259617.805950:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098305920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259627 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259617.806059:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259617.806063:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259617.806065:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259617.806073:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098305792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259633 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259617.806089:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098305792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259633 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259617.806092:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259617.806096:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259617.806097:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259617.806102:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098305920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259627 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259617.806107:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098305920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259627 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259617.806112:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259617.806120:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734259617.806123:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 02000000:00000010:2.0:1734259617.806124:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259617.806128:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734259617.806130:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734259622.811789:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734259622.811810:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734259622.811867:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734259622.811874:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734259622.811901:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000400:00000010:1.0:1734259622.811909:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259622.811917:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259622.811924:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098306048, portal 25 00000400:00000010:1.0:1734259622.811929:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:1.0:1734259622.811931:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098306048, offset 0 02000000:00000010:2.0:1734259622.811939:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:1.0:1734259622.811940:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259622.811944:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259622.811947:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259622.811950:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098306176, portal 10 00000400:00000200:1.0:1734259622.811953:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734259622.811955:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734259622.811957:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098306176, offset 0 00000400:00000200:1.0:1734259622.811985:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259622.811989:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259622.811992:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259622.811993:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259622.811996:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1123:1123:256:4294967295] 192.168.202.108@tcp LPNI seq info [1122:1122:8:4294967295] 00000400:00000200:2.0:1734259622.812003:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259622.812005:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259622.812009:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259622.812010:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259622.812012:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734259622.812013:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000400:00000200:2.0:1734259622.812015:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259622.812016:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734259622.812018:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259622.812018:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259622.812020:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1124:1124:255:4294967295] 192.168.202.108@tcp LPNI seq info [1123:1123:7:4294967295] 00000800:00000200:1.0:1734259622.812026:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259622.812027:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259622.812029:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259622.812030:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259622.812033:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259622.812036:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259622.812039:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259622.812041:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259622.812101:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259622.812104:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734259622.812110:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259622.812114:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259622.812118:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:0.0:1734259622.812119:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:0.0:1734259622.812127:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098306048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259638 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259622.812197:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259622.812199:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259622.812202:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259622.812205:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259622.812207:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734259622.812208:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734259622.812211:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098306176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259632 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259622.813897:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259622.813911:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623000 00000400:00000200:0.0:1734259622.813917:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2409 [1] + 224 00000400:00000200:0.0:1734259622.813925:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259622.813927:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259622.813934:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098306048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259638 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259622.813983:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259622.813987:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623080 00000400:00000200:0.0:1734259622.814003:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2411 [1] + 0 00000400:00000200:0.0:1734259622.814020:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259622.814023:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259622.814028:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098306176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259632 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259622.814075:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259622.814079:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259622.814081:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259622.814086:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098306048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259638 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259622.814086:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259622.814090:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259622.814091:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:1.0:1734259622.814092:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098306048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259638 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259622.814096:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098306176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259632 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259622.814103:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098306176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259632 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259622.814115:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734259622.814120:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 02000000:00000010:2.0:1734259622.814120:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259622.814123:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 02000000:00000010:2.0:1734259622.814123:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734259622.814125:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734259627.819691:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734259627.819712:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734259627.819779:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734259627.819786:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734259627.819794:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259627.819801:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259627.819806:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259627.819812:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098306304, portal 25 00000400:00000010:3.0:1734259627.819816:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734259627.819818:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098306304, offset 0 00000400:00000200:3.0:1734259627.819825:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259627.819837:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259627.819840:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259627.819844:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259627.819846:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259627.819848:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259627.819850:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1125:1125:256:4294967295] 192.168.202.108@tcp LPNI seq info [1124:1124:8:4294967295] 00000400:00000200:3.0:1734259627.819857:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259627.819861:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259627.819864:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734259627.819868:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259627.819874:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259627.819877:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259627.819891:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259627.819901:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259627.819907:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259627.819912:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098306432, portal 10 00000400:00000010:2.0:1734259627.819918:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734259627.819920:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098306432, offset 0 00000400:00000200:2.0:1734259627.819927:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259627.819959:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259627.819963:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259627.819966:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259627.819969:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259627.819971:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259627.819973:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1126:1126:255:4294967295] 192.168.202.108@tcp LPNI seq info [1125:1125:7:4294967295] 00000400:00000200:2.0:1734259627.819981:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259627.819986:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259627.819990:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259627.819994:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259627.820000:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259627.820003:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259627.820021:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259627.820024:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734259627.820027:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259627.820032:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259627.820035:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:0.0:1734259627.820037:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:0.0:1734259627.820042:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098306304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259643 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259627.820064:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259627.820065:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259627.820067:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259627.820069:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259627.820071:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734259627.820072:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734259627.820076:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098306432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259637 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259627.821420:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259627.821433:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623100 00000400:00000200:0.0:1734259627.821441:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2419 [1] + 224 00000400:00000200:0.0:1734259627.821461:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259627.821465:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259627.821481:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098306304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259643 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259627.821623:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259627.821629:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259627.821631:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259627.821636:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098306304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259643 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259627.821654:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098306304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259643 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259627.821674:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259627.821682:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734259627.821685:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000200:0.0:1734259627.822139:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259627.822147:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623180 00000400:00000200:0.0:1734259627.822152:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2421 [1] + 0 00000400:00000200:0.0:1734259627.822162:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259627.822165:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259627.822171:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098306432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259637 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259627.822339:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259627.822348:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259627.822349:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259627.822354:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098306432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259637 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259627.822360:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098306432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259637 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259627.822379:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259627.822384:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734259627.822387:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734259632.827715:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734259632.827738:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 02000000:00000010:1.0:1734259632.827864:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0800. 00000100:00000010:0.0:1734259632.827869:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734259632.827876:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 00000400:00000010:1.0:1734259632.827876:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259632.827882:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259632.827889:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098306560, portal 25 00000400:00000010:1.0:1734259632.827907:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734259632.827909:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098306560, offset 0 00000400:00000200:1.0:1734259632.827918:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259632.827934:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259632.827938:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259632.827956:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259632.827960:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259632.827961:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:2.0:1734259632.827963:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:1.0:1734259632.827964:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1127:1127:256:4294967295] 192.168.202.108@tcp LPNI seq info [1126:1126:8:4294967295] 00000400:00000010:2.0:1734259632.827970:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259632.827976:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000200:1.0:1734259632.827980:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:2.0:1734259632.827983:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098306688, portal 10 00000800:00000200:1.0:1734259632.827985:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259632.827989:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000400:00000010:2.0:1734259632.827991:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734259632.827993:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098306688, offset 0 00000800:00000200:1.0:1734259632.827996:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259632.828004:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734259632.828006:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259632.828010:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259632.828019:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259632.828040:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259632.828045:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259632.828048:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259632.828050:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259632.828052:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1128:1128:255:4294967295] 192.168.202.108@tcp LPNI seq info [1127:1127:7:4294967295] 00000400:00000200:2.0:1734259632.828060:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259632.828065:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259632.828072:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259632.828078:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259632.828085:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259632.828089:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259632.828857:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259632.828863:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734259632.828870:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259632.828876:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259632.828880:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734259632.828882:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734259632.828890:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098306560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259648 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259632.828975:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259632.828977:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259632.828980:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259632.828984:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259632.828986:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734259632.828988:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734259632.828992:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098306688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259632.831424:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259632.831454:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623200 00000400:00000200:0.0:1734259632.831461:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2429 [1] + 224 00000400:00000200:0.0:1734259632.831473:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259632.831476:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259632.831486:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098306560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259648 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259632.831521:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259632.831526:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623280 00000400:00000200:0.0:1734259632.831531:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2431 [1] + 0 00000400:00000200:0.0:1734259632.831541:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259632.831544:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259632.831550:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098306688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259642 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259632.831659:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259632.831668:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259632.831670:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259632.831680:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098306560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259648 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259632.831688:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098306560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259648 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259632.831715:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0800. 02000000:00000010:1.0:1734259632.831722:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:1.0:1734259632.831727:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000010:2.0:1734259632.831747:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259632.831751:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259632.831753:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259632.831758:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098306688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259632.831765:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098306688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259642 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259632.831792:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259632.831798:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734259632.831802:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734259637.835694:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734259637.835713:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734259637.835766:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734259637.835773:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734259637.835785:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734259637.835792:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259637.835798:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259637.835803:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098306816, portal 25 00000400:00000010:3.0:1734259637.835806:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734259637.835808:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098306816, offset 0 00000400:00000200:3.0:1734259637.835815:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259637.835825:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259637.835829:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259637.835832:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 02000000:00000010:2.0:1734259637.835834:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:3.0:1734259637.835834:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259637.835836:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:2.0:1734259637.835839:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000200:3.0:1734259637.835839:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1129:1129:256:4294967295] 192.168.202.108@tcp LPNI seq info [1128:1128:8:4294967295] 00000400:00000010:2.0:1734259637.835842:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259637.835845:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098306944, portal 10 00000400:00000200:3.0:1734259637.835846:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:2.0:1734259637.835849:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000800:00000200:3.0:1734259637.835850:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259637.835851:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098306944, offset 0 00000800:00000010:3.0:1734259637.835853:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000400:00000200:2.0:1734259637.835855:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734259637.835872:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259637.835879:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259637.835883:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259637.835889:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259637.835891:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259637.835902:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259637.835904:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259637.835905:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259637.835907:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1130:1130:255:4294967295] 192.168.202.108@tcp LPNI seq info [1129:1129:7:4294967295] 00000400:00000200:2.0:1734259637.835913:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259637.835916:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259637.835919:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259637.835922:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259637.835925:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259637.835927:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259637.835947:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259637.835950:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734259637.835954:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259637.835958:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259637.835962:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734259637.835963:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734259637.835969:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098306816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259653 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259637.836035:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259637.836037:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259637.836038:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259637.836040:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259637.836042:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734259637.836047:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734259637.836050:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098306944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259637.838344:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259637.838359:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623300 00000400:00000200:0.0:1734259637.838366:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2439 [1] + 224 00000400:00000200:0.0:1734259637.838375:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259637.838378:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259637.838390:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098306816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259653 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259637.838425:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259637.838429:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623380 00000400:00000200:0.0:1734259637.838433:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2441 [1] + 0 00000400:00000200:0.0:1734259637.838446:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259637.838449:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259637.838453:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098306944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259647 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259637.838511:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259637.838515:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259637.838517:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259637.838522:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098306944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259637.838529:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098306944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259647 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259637.838532:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259637.838536:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259637.838537:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259637.838541:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098306816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259653 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259637.838551:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259637.838556:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000200:3.0:1734259637.838556:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098306816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259653 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734259637.838561:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 02000000:00000010:3.0:1734259637.838595:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734259637.838599:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734259637.838601:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734259642.843722:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734259642.843749:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734259642.843849:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734259642.843857:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734259642.843929:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259642.843938:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 02000000:00000010:3.0:1734259642.843944:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:2.0:1734259642.843945:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259642.843952:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098307200, portal 10 00000400:00000010:3.0:1734259642.843957:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:2.0:1734259642.843959:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259642.843961:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098307200, offset 0 00000400:00000010:3.0:1734259642.843966:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000200:2.0:1734259642.843972:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734259642.843981:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098307072, portal 25 00000400:00000010:3.0:1734259642.843985:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734259642.843986:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098307072, offset 0 00000400:00000200:2.0:1734259642.843988:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259642.843994:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259642.843994:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259642.843998:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259642.844014:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259642.844016:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259642.844019:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1131:1131:256:4294967295] 192.168.202.108@tcp LPNI seq info [1130:1130:8:4294967295] 00000400:00000200:2.0:1734259642.844029:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259642.844035:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259642.844039:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259642.844043:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734259642.844044:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734259642.844046:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259642.844049:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259642.844050:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259642.844050:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259642.844053:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1132:1132:255:4294967295] 192.168.202.108@tcp LPNI seq info [1131:1131:7:4294967295] 00000400:00000200:3.0:1734259642.844059:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259642.844060:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259642.844063:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734259642.844064:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000010:3.0:1734259642.844066:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734259642.844069:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259642.844076:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259642.844079:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259642.844138:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259642.844141:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259642.844147:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259642.844153:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259642.844157:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734259642.844159:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734259642.844166:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098307200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259652 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259642.844250:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259642.844252:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734259642.844255:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259642.844257:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259642.844260:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734259642.844261:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734259642.844265:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098307072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259658 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259642.846897:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259642.846916:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623400 00000400:00000200:0.0:1734259642.846925:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2451 [1] + 224 00000400:00000200:0.0:1734259642.846938:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259642.846941:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259642.846952:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098307072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259658 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259642.846989:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259642.846993:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623480 00000400:00000200:0.0:1734259642.846997:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2449 [1] + 0 00000400:00000200:0.0:1734259642.847016:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259642.847019:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259642.847023:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098307200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259652 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259642.847055:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259642.847069:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259642.847071:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259642.847084:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098307072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259658 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259642.847096:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259642.847102:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259642.847104:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259642.847110:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098307200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259652 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259642.847117:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098307200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259652 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259642.847120:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098307072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259658 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259642.847147:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:2.0:1734259642.847148:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259642.847154:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 02000000:00000010:3.0:1734259642.847154:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734259642.847159:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:3.0:1734259642.847159:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:2.0:1734259647.851730:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259647.851753:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259647.851824:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259647.851831:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259647.851861:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734259647.851865:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:2.0:1734259647.851867:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:1.0:1734259647.851870:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:2.0:1734259647.851873:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:1.0:1734259647.851874:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:2.0:1734259647.851880:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098307456, portal 10 00000100:00000200:1.0:1734259647.851887:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098307328, portal 25 00000400:00000010:2.0:1734259647.851887:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734259647.851889:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098307456, offset 0 00000400:00000010:1.0:1734259647.851890:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259647.851891:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098307328, offset 0 00000400:00000200:2.0:1734259647.851897:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259647.851914:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259647.851920:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259647.851924:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259647.851928:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259647.851931:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259647.851933:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259647.851936:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1133:1133:256:4294967295] 192.168.202.108@tcp LPNI seq info [1132:1132:8:4294967295] 00000400:00000200:2.0:1734259647.851943:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259647.851948:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259647.851950:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734259647.851952:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734259647.851953:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259647.851955:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734259647.851956:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259647.851957:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259647.851963:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734259647.851965:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259647.851967:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1134:1134:255:4294967295] 192.168.202.108@tcp LPNI seq info [1133:1133:7:4294967295] 00000800:00000200:2.0:1734259647.851967:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734259647.851973:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259647.851977:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259647.851980:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734259647.851984:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259647.851987:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259647.851989:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259647.852216:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259647.852220:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259647.852225:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259647.852230:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259647.852234:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734259647.852236:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734259647.852249:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098307456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259657 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259647.852318:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259647.852321:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734259647.852323:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259647.852326:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259647.852328:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:0.0:1734259647.852329:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734259647.852333:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098307328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259663 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259647.854380:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259647.854404:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623500 00000400:00000200:0.0:1734259647.854413:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x245d [1] + 224 00000400:00000200:0.0:1734259647.854426:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259647.854430:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259647.854441:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098307328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259663 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259647.854920:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259647.854928:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623580 00000400:00000200:0.0:1734259647.854935:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2459 [1] + 0 00000400:00000200:0.0:1734259647.854955:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259647.854960:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259647.854968:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098307456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259657 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259647.855072:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259647.855077:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259647.855079:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259647.855085:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098307456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259657 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259647.855091:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000100:00000200:2.0:1734259647.855091:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098307456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259657 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734259647.855096:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259647.855098:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259647.855105:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098307328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259663 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259647.855114:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098307328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259663 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259647.855117:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259647.855123:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259647.855126:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 02000000:00000010:1.0:1734259647.855129:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734259647.855136:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:1.0:1734259647.855140:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734259652.859702:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259652.859720:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259652.859790:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734259652.859796:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259652.859819:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 02000000:00000010:2.0:1734259652.859820:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:1.0:1734259652.859825:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:2.0:1734259652.859825:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:1.0:1734259652.859831:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000400:00000010:2.0:1734259652.859831:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:1.0:1734259652.859836:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098307584, portal 25 00000400:00000010:1.0:1734259652.859840:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734259652.859935:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098307584, offset 0 00000100:00000200:2.0:1734259652.859935:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098307712, portal 10 00000400:00000200:1.0:1734259652.859943:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259652.859949:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000100:00000200:2.0:1734259652.859951:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098307712, offset 0 00000400:00000200:1.0:1734259652.859953:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259652.859954:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259652.859958:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259652.859961:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259652.859964:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259652.859966:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259652.859968:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1135:1135:256:4294967295] 192.168.202.108@tcp LPNI seq info [1134:1134:8:4294967295] 00000400:00000200:1.0:1734259652.859979:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259652.859984:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259652.859984:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259652.859986:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:1.0:1734259652.859987:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000400:00000200:2.0:1734259652.859987:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259652.859989:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259652.859990:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734259652.859992:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259652.859992:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1136:1136:255:4294967295] 192.168.202.108@tcp LPNI seq info [1135:1135:7:4294967295] 00000400:00000200:2.0:1734259652.859996:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259652.859998:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259652.859999:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259652.860000:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259652.860003:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259652.860005:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259652.860005:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259652.860007:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259652.860088:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259652.860092:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734259652.860097:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259652.860101:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259652.860105:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:0.0:1734259652.860111:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:0.0:1734259652.860118:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098307584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259668 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259652.860182:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259652.860184:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259652.860187:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259652.860190:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259652.860192:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734259652.860193:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734259652.860196:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098307712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259662 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259652.861622:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259652.861636:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623600 00000400:00000200:0.0:1734259652.861643:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2469 [1] + 224 00000400:00000200:0.0:1734259652.861653:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259652.861656:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259652.861664:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098307584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259668 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259652.861699:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259652.861703:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623680 00000400:00000200:0.0:1734259652.861707:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x246d [1] + 0 00000400:00000200:0.0:1734259652.861720:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259652.861723:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259652.861726:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098307712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259662 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259652.861741:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259652.861746:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259652.861758:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259652.861762:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098307584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259668 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259652.861776:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098307584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259668 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259652.861797:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734259652.861801:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259652.861805:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000400:00000010:2.0:1734259652.861905:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259652.861915:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259652.861917:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259652.861927:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098307712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259662 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259652.861935:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098307712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259662 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259652.861961:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259652.861968:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259652.861971:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734259657.868098:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734259657.868125:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 02000000:00000010:3.0:1734259657.868210:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259657.868219:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259657.868231:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259657.868239:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098307840, portal 25 00000400:00000010:3.0:1734259657.868243:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734259657.868246:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098307840, offset 0 00000400:00000200:3.0:1734259657.868255:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259657.868270:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259657.868276:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259657.868279:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259657.868283:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259657.868285:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259657.868288:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1137:1137:256:4294967295] 192.168.202.108@tcp LPNI seq info [1136:1136:8:4294967295] 00000400:00000200:3.0:1734259657.868296:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259657.868302:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259657.868306:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734259657.868312:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259657.868320:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259657.868323:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259657.868486:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259657.868494:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734259657.868499:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259657.868506:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259657.868511:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734259657.868522:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734259657.868531:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098307840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259673 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734259657.868662:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259657.868671:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259657.868724:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259657.868728:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259657.868731:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259657.868734:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098307968, portal 10 00000400:00000010:3.0:1734259657.868738:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734259657.868748:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098307968, offset 0 00000400:00000200:3.0:1734259657.868752:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259657.868756:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259657.868759:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259657.868761:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259657.868763:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259657.868764:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259657.868767:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1138:1138:256:4294967295] 192.168.202.108@tcp LPNI seq info [1137:1137:8:4294967295] 00000400:00000200:3.0:1734259657.868773:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259657.868776:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259657.868778:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734259657.868781:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259657.868785:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259657.868787:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259657.868864:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259657.868867:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734259657.868869:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259657.868872:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259657.868875:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734259657.868876:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734259657.868880:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098307968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259667 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259657.870945:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259657.870960:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623700 00000400:00000200:0.0:1734259657.870967:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2479 [1] + 224 00000400:00000200:0.0:1734259657.870982:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259657.870986:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259657.870998:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098307840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259673 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259657.871081:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259657.871086:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:3.0:1734259657.871088:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734259657.871092:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098307840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259673 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259657.871103:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098307840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259673 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259657.871123:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259657.871128:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734259657.871132:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000400:00000200:0.0:1734259657.871368:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259657.871375:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623780 00000400:00000200:0.0:1734259657.871379:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2481 [1] + 0 00000400:00000200:0.0:1734259657.871390:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259657.871393:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259657.871398:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098307968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259667 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259657.871525:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259657.871528:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259657.871529:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259657.871533:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098307968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259667 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259657.871539:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098307968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259667 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:3.0:1734259657.871560:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:3.0:1734259657.871677:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259657.871681:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259657.871684:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000100:00000010:2.0:1734259662.875766:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259662.875797:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259662.875864:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259662.875871:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734259662.875885:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734259662.875894:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 02000000:00000010:3.0:1734259662.875901:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:1.0:1734259662.875902:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000400:00000010:3.0:1734259662.875906:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000100:00000200:1.0:1734259662.875908:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098308096, portal 25 00000400:00000010:3.0:1734259662.875910:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259662.875913:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098308224, portal 10 00000400:00000010:1.0:1734259662.875916:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000400:00000010:3.0:1734259662.875917:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:1.0:1734259662.875919:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098308096, offset 0 00000100:00000200:3.0:1734259662.875919:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098308224, offset 0 00000400:00000200:3.0:1734259662.875927:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259662.875932:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259662.875940:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259662.875945:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259662.875949:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259662.875952:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259662.875954:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259662.875957:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1139:1139:256:4294967295] 192.168.202.108@tcp LPNI seq info [1138:1138:8:4294967295] 00000400:00000200:3.0:1734259662.875966:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734259662.875972:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259662.875974:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259662.875976:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259662.875977:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259662.875977:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259662.875979:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259662.875982:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1140:1140:255:4294967295] 192.168.202.108@tcp LPNI seq info [1139:1139:7:4294967295] 00000800:00000010:3.0:1734259662.875983:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734259662.875988:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259662.875988:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259662.875997:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259662.875998:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259662.876001:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:3.0:1734259662.876001:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259662.876004:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259662.876007:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259662.876009:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259662.876135:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259662.876138:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734259662.876143:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259662.876147:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259662.876150:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:0.0:1734259662.876157:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734259662.876165:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098308224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259672 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259662.876239:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259662.876242:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734259662.876244:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259662.876247:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259662.876248:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734259662.876250:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734259662.876253:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098308096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259678 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259662.878145:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259662.878165:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623880 00000400:00000200:0.0:1734259662.878175:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x248d [1] + 0 00000400:00000200:0.0:1734259662.878187:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259662.878190:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259662.878200:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098308224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259672 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259662.878246:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259662.878251:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623800 00000400:00000200:0.0:1734259662.878255:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2489 [1] + 224 00000400:00000200:0.0:1734259662.878273:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259662.878276:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259662.878281:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098308096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259678 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259662.878355:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259662.878361:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259662.878363:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259662.878369:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098308224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259672 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259662.878371:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259662.878376:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000100:00000200:3.0:1734259662.878376:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098308224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259672 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259662.878378:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259662.878382:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098308096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259678 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259662.878389:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098308096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259678 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259662.878418:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:3.0:1734259662.878418:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:1.0:1734259662.878422:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 02000000:00000010:3.0:1734259662.878422:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259662.878427:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:3.0:1734259662.878427:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:0.0:1734259667.883712:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734259667.883735:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734259667.883793:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734259667.883799:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734259667.883877:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259667.883885:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259667.883893:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259667.883899:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098308480, portal 10 00000400:00000010:2.0:1734259667.883905:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734259667.883907:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098308480, offset 0 00000400:00000200:2.0:1734259667.883916:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259667.883933:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259667.883939:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259667.883943:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259667.883946:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259667.883948:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259667.883951:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1141:1141:256:4294967295] 192.168.202.108@tcp LPNI seq info [1140:1140:8:4294967295] 00000400:00000200:2.0:1734259667.883960:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259667.883965:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259667.883970:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259667.883974:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259667.883983:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259667.883987:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734259667.884044:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734259667.884051:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259667.884054:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259667.884057:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098308352, portal 25 00000400:00000010:1.0:1734259667.884060:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734259667.884061:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098308352, offset 0 00000400:00000200:1.0:1734259667.884066:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259667.884070:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259667.884073:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259667.884075:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259667.884076:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259667.884078:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259667.884080:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1142:1142:255:4294967295] 192.168.202.108@tcp LPNI seq info [1141:1141:7:4294967295] 00000400:00000200:1.0:1734259667.884086:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259667.884089:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259667.884097:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734259667.884100:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259667.884104:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259667.884106:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259667.884111:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259667.884114:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259667.884118:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259667.884122:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259667.884126:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734259667.884128:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734259667.884134:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098308480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259677 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259667.884200:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259667.884202:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734259667.884204:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259667.884206:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259667.884208:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734259667.884209:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734259667.884212:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098308352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259683 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259667.886313:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259667.886332:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623980 00000400:00000200:0.0:1734259667.886342:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2499 [1] + 0 00000400:00000200:0.0:1734259667.886366:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259667.886370:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259667.886381:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098308480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259677 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259667.886604:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259667.886609:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259667.886611:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259667.886616:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098308480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259677 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259667.886623:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098308480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259677 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259667.886662:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259667.886674:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734259667.886678:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000200:0.0:1734259667.887659:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259667.887671:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623900 00000400:00000200:0.0:1734259667.887677:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x24a1 [1] + 224 00000400:00000200:0.0:1734259667.887690:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259667.887693:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259667.887701:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098308352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259683 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259667.887897:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:1.0:1734259667.887903:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:1.0:1734259667.887905:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734259667.887909:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098308352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259683 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259667.887916:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098308352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259683 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259667.887929:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734259667.887933:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734259667.887936:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734259672.891747:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734259672.891768:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734259672.891835:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734259672.891841:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734259672.891957:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259672.891964:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259672.891971:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259672.891977:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098308608, portal 25 00000400:00000010:3.0:1734259672.891981:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734259672.891984:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098308608, offset 0 00000400:00000200:3.0:1734259672.891994:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259672.892010:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259672.892016:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259672.892020:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259672.892024:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259672.892026:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259672.892028:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1143:1143:256:4294967295] 192.168.202.108@tcp LPNI seq info [1142:1142:8:4294967295] 00000400:00000200:3.0:1734259672.892038:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:2.0:1734259672.892040:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000800:00000200:3.0:1734259672.892044:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259672.892048:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000400:00000010:2.0:1734259672.892052:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000800:00000200:3.0:1734259672.892053:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:2.0:1734259672.892058:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000800:00000200:3.0:1734259672.892062:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:2.0:1734259672.892064:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098308736, portal 10 00000800:00000200:3.0:1734259672.892066:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734259672.892071:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734259672.892072:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098308736, offset 0 00000400:00000200:2.0:1734259672.892080:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259672.892090:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259672.892094:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259672.892097:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259672.892099:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259672.892101:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259672.892104:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1144:1144:255:4294967295] 192.168.202.108@tcp LPNI seq info [1143:1143:7:4294967295] 00000400:00000200:2.0:1734259672.892111:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259672.892116:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259672.892119:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259672.892124:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259672.892130:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259672.892133:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259672.892149:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259672.892152:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734259672.892157:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259672.892162:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259672.892166:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734259672.892167:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734259672.892175:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098308608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259688 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259672.892248:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259672.892250:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259672.892253:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259672.892257:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259672.892259:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734259672.892261:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734259672.892264:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098308736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259682 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259672.894149:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259672.894170:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623a00 00000400:00000200:0.0:1734259672.894180:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x24a9 [1] + 224 00000400:00000200:0.0:1734259672.894192:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259672.894195:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259672.894205:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098308608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259688 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259672.894248:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259672.894253:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623a80 00000400:00000200:0.0:1734259672.894270:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x24b1 [1] + 0 00000400:00000200:0.0:1734259672.894285:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259672.894289:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259672.894294:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098308736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259672.894395:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259672.894401:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259672.894403:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000400:00000010:2.0:1734259672.894407:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000100:00000200:3.0:1734259672.894407:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098308608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259688 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734259672.894411:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259672.894412:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:3.0:1734259672.894415:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098308608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259688 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259672.894417:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098308736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259682 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259672.894423:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098308736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259682 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259672.894444:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259672.894444:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:2.0:1734259672.894449:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 02000000:00000010:3.0:1734259672.894449:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734259672.894453:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:2.0:1734259672.894456:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:2.0:1734259677.899761:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259677.899782:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259677.899842:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259677.899849:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259677.899876:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259677.899877:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:2.0:1734259677.899882:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:1.0:1734259677.899883:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b13c8. 00000400:00000010:1.0:1734259677.899888:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000400:00000010:2.0:1734259677.899888:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259677.899894:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098308992, portal 10 00000400:00000010:2.0:1734259677.899900:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:1.0:1734259677.899907:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098308864, portal 25 00000400:00000010:1.0:1734259677.899909:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:2.0:1734259677.899910:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098308992, offset 0 00000100:00000200:1.0:1734259677.899911:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098308864, offset 0 00000400:00000200:2.0:1734259677.899918:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259677.899924:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259677.899933:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259677.899938:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259677.899942:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259677.899945:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259677.899946:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259677.899949:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1145:1145:256:4294967295] 192.168.202.108@tcp LPNI seq info [1144:1144:8:4294967295] 00000400:00000200:2.0:1734259677.899955:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259677.899960:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259677.899962:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734259677.899964:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734259677.899965:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259677.899967:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259677.899969:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259677.899969:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259677.899970:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259677.899972:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1146:1146:255:4294967295] 192.168.202.108@tcp LPNI seq info [1145:1145:7:4294967295] 00000800:00000200:2.0:1734259677.899976:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734259677.899978:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259677.899979:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259677.899980:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259677.899984:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734259677.899999:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259677.900003:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259677.900006:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259677.900081:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259677.900084:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259677.900088:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259677.900092:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259677.900095:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:0.0:1734259677.900097:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:0.0:1734259677.900103:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098308992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259687 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259677.900300:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259677.900303:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734259677.900305:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259677.900308:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259677.900311:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:0.0:1734259677.900312:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:0.0:1734259677.900315:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098308864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259693 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259677.902340:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259677.902362:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623b80 00000400:00000200:0.0:1734259677.902372:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x24b9 [1] + 0 00000400:00000200:0.0:1734259677.902397:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259677.902401:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259677.902412:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098308992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259677.902504:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259677.902652:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259677.902655:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259677.902661:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098308992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259687 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259677.902670:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098308992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259687 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259677.902719:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 00000400:00000200:0.0:1734259677.902725:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 02000000:00000010:2.0:1734259677.902725:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259677.902729:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000200:0.0:1734259677.902732:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623b00 00000400:00000200:0.0:1734259677.902742:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x24bd [1] + 224 00000400:00000200:0.0:1734259677.902752:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259677.902755:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259677.902761:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098308864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259693 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259677.902825:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b13c8. 00000400:00000200:2.0:1734259677.902828:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:2.0:1734259677.902829:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:2.0:1734259677.902834:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098308864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259693 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259677.902841:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098308864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259693 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259677.902860:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:2.0:1734259677.902863:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259677.902866:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000100:00000010:2.0:1734259682.907675:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259682.907695:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259682.907742:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:3.0:1734259682.907784:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259682.907791:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259682.907797:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259682.907804:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098309120, portal 25 00000400:00000010:3.0:1734259682.907807:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734259682.907809:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098309120, offset 0 00000400:00000200:3.0:1734259682.907816:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259682.907827:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259682.907832:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259682.907835:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259682.907838:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259682.907839:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259682.907842:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1147:1147:256:4294967295] 192.168.202.108@tcp LPNI seq info [1146:1146:8:4294967295] 00000400:00000200:3.0:1734259682.907850:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259682.907855:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259682.907858:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734259682.907862:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259682.907868:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259682.907870:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259682.907880:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259682.907905:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259682.907909:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259682.907912:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259682.907914:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098309248, portal 10 00000400:00000010:2.0:1734259682.907918:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734259682.907919:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098309248, offset 0 00000400:00000200:2.0:1734259682.907924:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259682.907928:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259682.907930:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259682.907933:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259682.907934:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259682.907936:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259682.907938:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1148:1148:255:4294967295] 192.168.202.108@tcp LPNI seq info [1147:1147:7:4294967295] 00000400:00000200:2.0:1734259682.907956:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259682.907960:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259682.907962:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259682.907965:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259682.907968:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259682.907970:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259682.907986:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259682.907989:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734259682.907993:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259682.907997:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259682.908001:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734259682.908002:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734259682.908009:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098309120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259698 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259682.908069:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259682.908071:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259682.908073:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259682.908076:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259682.908078:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:0.0:1734259682.908079:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734259682.908082:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098309248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259692 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259682.910620:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259682.910636:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623c80 00000400:00000200:0.0:1734259682.910647:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x24d1 [1] + 0 00000400:00000200:0.0:1734259682.910657:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259682.910660:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259682.910669:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098309248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259682.910705:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259682.910709:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623c00 00000400:00000200:0.0:1734259682.910724:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x24c9 [1] + 224 00000400:00000200:0.0:1734259682.910734:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259682.910737:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259682.910742:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098309120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259698 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259682.910818:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259682.910821:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259682.910823:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259682.910827:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098309248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259692 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259682.910830:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000100:00000200:2.0:1734259682.910833:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098309248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259692 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734259682.910833:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259682.910834:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259682.910837:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098309120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259698 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259682.910842:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098309120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259698 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259682.910854:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259682.910854:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:2.0:1734259682.910859:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259682.910862:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 02000000:00000010:3.0:1734259682.910863:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734259682.910865:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000100:00000010:0.0:1734259687.915732:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734259687.915753:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 02000000:00000010:3.0:1734259687.915829:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259687.915837:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259687.915844:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259687.915850:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098309376, portal 25 00000400:00000010:3.0:1734259687.915854:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734259687.915856:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098309376, offset 0 00000400:00000200:3.0:1734259687.915865:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000010:0.0:1734259687.915866:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734259687.915873:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 00000400:00000200:3.0:1734259687.915878:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259687.915883:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259687.915886:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259687.915889:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259687.915891:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259687.915894:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1149:1149:256:4294967295] 192.168.202.108@tcp LPNI seq info [1148:1148:8:4294967295] 00000400:00000200:3.0:1734259687.915902:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259687.915908:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259687.915911:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734259687.915920:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259687.915928:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259687.915931:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259687.915934:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259687.915939:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259687.915942:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259687.915945:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098309504, portal 10 00000400:00000010:2.0:1734259687.915949:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734259687.915950:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098309504, offset 0 00000400:00000200:2.0:1734259687.915954:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259687.915959:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259687.915961:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259687.915963:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259687.915965:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259687.915966:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259687.915968:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1150:1150:255:4294967295] 192.168.202.108@tcp LPNI seq info [1149:1149:7:4294967295] 00000400:00000200:2.0:1734259687.915974:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259687.915993:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259687.915997:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259687.916000:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259687.916003:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259687.916005:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259687.916050:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259687.916053:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734259687.916058:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259687.916062:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259687.916065:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734259687.916066:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734259687.916074:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098309376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259703 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259687.916142:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259687.916144:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259687.916147:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259687.916149:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259687.916151:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:0.0:1734259687.916152:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734259687.916156:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098309504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259697 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259687.917798:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259687.917813:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623d00 00000400:00000200:0.0:1734259687.917820:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x24d9 [1] + 224 00000400:00000200:0.0:1734259687.917830:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259687.917833:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259687.917852:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098309376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259703 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259687.917887:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259687.917892:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623d80 00000400:00000200:0.0:1734259687.917897:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x24e1 [1] + 0 00000400:00000200:0.0:1734259687.917909:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259687.917912:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259687.917916:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098309504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259697 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259687.917976:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259687.917980:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259687.917981:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259687.917985:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098309504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259697 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259687.917989:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098309504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259697 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259687.918012:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259687.918016:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734259687.918020:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:3.0:1734259687.918117:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259687.918121:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259687.918122:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259687.918127:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098309376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259703 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259687.918134:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098309376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259703 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259687.918146:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259687.918150:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734259687.918157:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734259692.923793:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734259692.923823:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734259692.923913:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734259692.923922:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734259692.923984:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734259692.924000:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259692.924008:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259692.924015:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098309632, portal 25 00000400:00000010:1.0:1734259692.924020:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734259692.924022:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098309632, offset 0 00000400:00000200:1.0:1734259692.924031:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259692.924044:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:2.0:1734259692.924048:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:1.0:1734259692.924049:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259692.924053:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259692.924055:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:2.0:1734259692.924055:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000200:1.0:1734259692.924057:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259692.924060:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1151:1151:256:4294967295] 192.168.202.108@tcp LPNI seq info [1150:1150:8:4294967295] 00000400:00000010:2.0:1734259692.924062:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259692.924067:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098309760, portal 10 00000400:00000200:1.0:1734259692.924068:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259692.924074:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259692.924074:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734259692.924076:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098309760, offset 0 00000800:00000010:1.0:1734259692.924079:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734259692.924084:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259692.924084:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734259692.924093:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259692.924095:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734259692.924097:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259692.924098:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259692.924102:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259692.924104:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259692.924106:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259692.924109:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1152:1152:255:4294967295] 192.168.202.108@tcp LPNI seq info [1151:1151:7:4294967295] 00000400:00000200:2.0:1734259692.924117:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259692.924122:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259692.924142:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259692.924147:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259692.924153:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259692.924157:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259692.924252:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259692.924256:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734259692.924262:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259692.924267:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259692.924272:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734259692.924274:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734259692.924281:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098309632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259708 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259692.924371:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259692.924374:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259692.924377:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259692.924380:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259692.924382:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734259692.924383:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734259692.924386:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098309760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259702 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259692.925977:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259692.926004:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623e00 00000400:00000200:0.0:1734259692.926010:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x24e9 [1] + 224 00000400:00000200:0.0:1734259692.926022:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259692.926026:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259692.926035:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098309632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259708 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259692.926076:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259692.926081:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623e80 00000400:00000200:0.0:1734259692.926086:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x24f1 [1] + 0 00000400:00000200:0.0:1734259692.926097:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259692.926100:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259692.926104:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098309760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259692.926130:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259692.926135:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259692.926137:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259692.926141:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098309632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259708 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259692.926147:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098309632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259708 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259692.926170:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734259692.926180:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:1.0:1734259692.926185:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:2.0:1734259692.926198:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259692.926201:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259692.926202:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259692.926206:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098309760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259702 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259692.926212:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098309760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259702 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259692.926229:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259692.926233:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734259692.926236:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734259697.931867:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734259697.931888:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734259697.932174:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734259697.932182:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734259697.932222:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734259697.932231:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259697.932238:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259697.932245:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098309888, portal 25 00000400:00000010:1.0:1734259697.932249:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:1.0:1734259697.932250:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098309888, offset 0 00000400:00000200:1.0:1734259697.932260:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259697.932274:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259697.932279:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259697.932282:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259697.932285:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259697.932287:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259697.932290:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1153:1153:256:4294967295] 192.168.202.108@tcp LPNI seq info [1152:1152:8:4294967295] 00000400:00000200:1.0:1734259697.932297:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259697.932302:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259697.932305:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734259697.932311:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259697.932319:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259697.932322:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259697.932618:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259697.932623:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259697.932626:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259697.932628:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098310016, portal 10 00000400:00000010:2.0:1734259697.932632:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734259697.932633:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098310016, offset 0 00000400:00000200:2.0:1734259697.932637:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259697.932641:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259697.932643:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259697.932645:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259697.932647:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259697.932648:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259697.932650:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1154:1154:255:4294967295] 192.168.202.108@tcp LPNI seq info [1153:1153:7:4294967295] 00000400:00000200:2.0:1734259697.932655:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259697.932659:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259697.932661:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259697.932676:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259697.932679:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259697.932681:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259697.932719:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259697.932722:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734259697.932727:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259697.932731:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259697.932735:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:0.0:1734259697.932736:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:0.0:1734259697.932743:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098309888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259713 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259697.932806:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259697.932808:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259697.932810:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259697.932813:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259697.932815:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734259697.932820:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734259697.932824:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098310016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259707 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259697.935536:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259697.935552:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c623f80 00000400:00000200:0.0:1734259697.935560:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2501 [1] + 0 00000400:00000200:0.0:1734259697.935591:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259697.935594:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259697.935604:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098310016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259707 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259697.935640:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259697.935645:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c623f00 00000400:00000200:0.0:1734259697.935649:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x24f9 [1] + 224 00000400:00000200:0.0:1734259697.935665:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259697.935668:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259697.935672:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098309888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259713 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259697.935751:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259697.935757:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259697.935758:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259697.935763:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098310016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259707 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259697.935770:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098310016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259707 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259697.935794:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259697.935800:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734259697.935804:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000010:1.0:1734259697.935865:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259697.935868:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259697.935870:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259697.935874:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098309888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259713 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259697.935880:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098309888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259713 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259697.935903:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734259697.935907:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734259697.935919:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734259702.939719:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734259702.939738:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734259702.939796:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734259702.939802:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734259702.939816:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734259702.939824:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259702.939830:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259702.939836:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098310144, portal 25 00000400:00000010:1.0:1734259702.939840:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734259702.939842:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098310144, offset 0 00000400:00000200:1.0:1734259702.939850:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259702.939864:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259702.939868:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259702.939872:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259702.939874:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259702.939876:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259702.939879:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1155:1155:256:4294967295] 192.168.202.108@tcp LPNI seq info [1154:1154:8:4294967295] 00000400:00000200:1.0:1734259702.939885:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259702.939889:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259702.939892:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734259702.939904:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259702.939911:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259702.939916:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259702.940042:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259702.940044:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734259702.940048:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259702.940052:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259702.940055:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:0.0:1734259702.940056:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:0.0:1734259702.940061:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098310144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259718 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259702.940150:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259702.940155:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259702.940159:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259702.940161:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098310272, portal 10 00000400:00000010:2.0:1734259702.940166:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734259702.940167:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098310272, offset 0 00000400:00000200:2.0:1734259702.940172:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259702.940176:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259702.940178:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259702.940180:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259702.940182:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259702.940183:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259702.940186:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1156:1156:256:4294967295] 192.168.202.108@tcp LPNI seq info [1155:1155:8:4294967295] 00000400:00000200:2.0:1734259702.940192:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259702.940195:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259702.940198:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259702.940201:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259702.940209:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259702.940211:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259702.940329:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259702.940332:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259702.940334:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259702.940337:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259702.940339:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734259702.940341:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734259702.940344:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098310272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259712 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259702.941525:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259702.941538:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624080 00000400:00000200:0.0:1734259702.941544:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2511 [1] + 0 00000400:00000200:0.0:1734259702.941560:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259702.941563:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259702.941591:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098310272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259712 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259702.941649:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259702.941653:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259702.941655:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259702.941660:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098310272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259712 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259702.941667:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098310272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259712 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259702.941691:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259702.941696:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734259702.941700:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734259702.941745:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259702.941750:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624000 00000400:00000200:0.0:1734259702.941755:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2509 [1] + 224 00000400:00000200:0.0:1734259702.941763:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259702.941766:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259702.941771:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098310144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259718 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259702.941960:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259702.941964:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259702.941965:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259702.941970:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098310144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259718 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259702.941976:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098310144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259718 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259702.941992:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734259702.941995:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:1.0:1734259702.941997:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:2.0:1734259707.948129:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259707.948152:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259707.948206:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259707.948213:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259707.948238:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259707.948239:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:2.0:1734259707.948244:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:3.0:1734259707.948246:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:2.0:1734259707.948250:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734259707.948250:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:2.0:1734259707.948256:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098310528, portal 10 00000400:00000010:2.0:1734259707.948261:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259707.948264:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098310528, offset 0 00000100:00000200:3.0:1734259707.948264:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098310400, portal 25 00000400:00000010:3.0:1734259707.948267:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000400:00000200:2.0:1734259707.948271:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734259707.948276:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098310400, offset 0 00000400:00000200:2.0:1734259707.948281:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259707.948281:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259707.948284:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259707.948287:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259707.948289:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259707.948291:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259707.948293:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1157:1157:256:4294967295] 192.168.202.108@tcp LPNI seq info [1156:1156:8:4294967295] 00000400:00000200:2.0:1734259707.948301:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:3.0:1734259707.948322:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734259707.948324:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259707.948325:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259707.948327:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000010:2.0:1734259707.948328:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734259707.948328:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259707.948331:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259707.948333:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1158:1158:255:4294967295] 192.168.202.108@tcp LPNI seq info [1157:1157:7:4294967295] 00000800:00000200:2.0:1734259707.948334:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259707.948339:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259707.948341:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259707.948343:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259707.948357:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734259707.948363:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259707.948366:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259707.948370:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259707.948374:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259707.948478:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259707.948481:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734259707.948485:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259707.948489:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259707.948493:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734259707.948494:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734259707.948506:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098310400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259723 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259707.948587:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259707.948589:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259707.948591:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259707.948594:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259707.948596:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734259707.948597:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734259707.948601:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098310528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259717 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259707.951237:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259707.951257:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624180 00000400:00000200:0.0:1734259707.951265:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2519 [1] + 0 00000400:00000200:0.0:1734259707.951277:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259707.951281:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259707.951295:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098310528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259717 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259707.951333:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259707.951337:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624100 00000400:00000200:0.0:1734259707.951341:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x251d [1] + 224 00000400:00000200:0.0:1734259707.951369:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259707.951372:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259707.951378:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098310400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259723 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259707.951612:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259707.951617:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259707.951619:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259707.951624:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098310528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259717 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259707.951630:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098310528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259717 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259707.951656:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259707.951660:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259707.951664:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000010:3.0:1734259707.952228:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259707.952233:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259707.952234:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259707.952240:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098310400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259723 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259707.952246:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098310400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259723 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259707.952259:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259707.952263:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259707.952267:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259712.955680:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259712.955701:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259712.955758:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259712.955764:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734259712.955783:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 02000000:00000010:2.0:1734259712.955787:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:1.0:1734259712.955791:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:2.0:1734259712.955791:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:1.0:1734259712.955797:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:2.0:1734259712.955798:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259712.955804:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098310784, portal 10 00000100:00000200:1.0:1734259712.955806:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098310656, portal 25 00000400:00000010:1.0:1734259712.955810:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000400:00000010:2.0:1734259712.955810:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:1.0:1734259712.955811:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098310656, offset 0 00000100:00000200:2.0:1734259712.955812:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098310784, offset 0 00000400:00000200:2.0:1734259712.955818:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259712.955824:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259712.955831:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259712.955836:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259712.955839:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259712.955842:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259712.955854:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259712.955857:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1159:1159:256:4294967295] 192.168.202.108@tcp LPNI seq info [1158:1158:8:4294967295] 00000400:00000200:2.0:1734259712.955865:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259712.955869:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259712.955870:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734259712.955872:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259712.955873:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259712.955875:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259712.955877:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259712.955877:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734259712.955878:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259712.955880:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1160:1160:255:4294967295] 192.168.202.108@tcp LPNI seq info [1159:1159:7:4294967295] 00000800:00000200:2.0:1734259712.955883:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734259712.955886:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259712.955886:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259712.955889:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259712.955892:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734259712.955894:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259712.955899:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259712.955901:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259712.956017:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259712.956020:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259712.956025:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259712.956029:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259712.956033:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734259712.956039:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734259712.956045:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098310784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259722 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259712.956160:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259712.956162:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734259712.956165:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259712.956168:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259712.956170:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734259712.956171:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734259712.956175:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098310656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259728 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259712.958414:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259712.958436:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624200 00000400:00000200:0.0:1734259712.958444:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x252d [1] + 224 00000400:00000200:0.0:1734259712.958454:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259712.958458:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259712.958467:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098310656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259728 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259712.958644:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259712.958649:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259712.958651:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000400:00000200:0.0:1734259712.958654:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000100:00000200:1.0:1734259712.958656:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098310656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259728 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259712.958659:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624280 00000100:00000200:1.0:1734259712.958664:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098310656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259728 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259712.958683:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734259712.958687:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:1.0:1734259712.958691:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000200:0.0:1734259712.958712:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2529 [1] + 0 00000400:00000200:0.0:1734259712.958729:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259712.958732:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259712.958742:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098310784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259722 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259712.958826:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259712.958830:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259712.958831:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259712.958836:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098310784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259722 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259712.958842:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098310784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259722 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259712.958858:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259712.958862:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:2.0:1734259712.958864:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:2.0:1734259717.963866:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259717.963896:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 02000000:00000010:3.0:1734259717.964050:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259717.964061:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259717.964068:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259717.964076:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098310912, portal 25 00000400:00000010:3.0:1734259717.964082:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734259717.964085:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098310912, offset 0 00000400:00000200:3.0:1734259717.964096:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259717.964113:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259717.964120:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259717.964124:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259717.964128:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259717.964130:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259717.964133:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1161:1161:256:4294967295] 192.168.202.108@tcp LPNI seq info [1160:1160:8:4294967295] 00000400:00000200:3.0:1734259717.964143:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259717.964150:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259717.964154:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734259717.964160:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259717.964171:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259717.964175:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259717.964366:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259717.964370:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734259717.964374:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259717.964379:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259717.964383:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000100:00000010:2.0:1734259717.964390:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 00000400:00000010:0.0:1734259717.964400:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734259717.964409:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098310912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259733 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259717.964414:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259717.964466:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734259717.964470:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50688. 00000400:00000010:0.0:1734259717.964473:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734259717.964476:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098311040, portal 10 00000400:00000010:0.0:1734259717.964481:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734259717.964483:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098311040, offset 0 00000400:00000200:0.0:1734259717.964487:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259717.964493:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259717.964495:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259717.964498:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259717.964499:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259717.964501:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259717.964503:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1162:1162:256:4294967295] 192.168.202.108@tcp LPNI seq info [1161:1161:8:4294967295] 00000400:00000200:0.0:1734259717.964509:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259717.964513:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259717.964515:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734259717.964518:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259717.964522:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259717.964525:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734259717.965214:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259717.965218:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:2.0:1734259717.965222:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259717.965229:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259717.965234:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:2.0:1734259717.965235:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:2.0:1734259717.965242:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098311040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259727 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259717.967649:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259717.967668:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624300 00000400:00000200:0.0:1734259717.967676:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2539 [1] + 224 00000400:00000200:0.0:1734259717.967687:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259717.967691:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259717.967701:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098310912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259733 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259717.967743:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259717.967757:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624380 00000400:00000200:0.0:1734259717.967762:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2541 [1] + 0 00000400:00000200:0.0:1734259717.967774:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259717.967777:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259717.967782:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098311040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259727 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259717.967861:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50688. 00000400:00000200:1.0:1734259717.967880:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:1.0:1734259717.967883:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:1.0:1734259717.967892:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098311040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259727 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259717.967901:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098311040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259727 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259717.967934:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:1.0:1734259717.967940:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734259717.967947:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000400:00000010:3.0:1734259717.968008:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259717.968012:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259717.968014:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259717.968019:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098310912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259733 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259717.968025:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098310912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259733 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259717.968043:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259717.968048:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734259717.968051:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000100:00000010:0.0:1734259722.972034:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734259722.972053:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734259722.972112:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734259722.972117:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:0.0:1734259722.972152:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734259722.972158:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50aa8. 00000400:00000010:0.0:1734259722.972164:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000100:00000200:0.0:1734259722.972170:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098311296, portal 10 00000400:00000010:0.0:1734259722.972175:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734259722.972177:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098311296, offset 0 00000400:00000200:0.0:1734259722.972185:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259722.972198:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259722.972204:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259722.972218:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259722.972220:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259722.972222:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259722.972224:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1163:1163:256:4294967295] 192.168.202.108@tcp LPNI seq info [1162:1162:8:4294967295] 00000400:00000200:0.0:1734259722.972232:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259722.972269:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259722.972272:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734259722.972277:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259722.972284:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259722.972288:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734259722.972316:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734259722.972320:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259722.972323:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259722.972326:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098311168, portal 25 00000400:00000010:1.0:1734259722.972329:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734259722.972330:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098311168, offset 0 00000400:00000200:1.0:1734259722.972334:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259722.972338:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259722.972340:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259722.972342:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259722.972344:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259722.972345:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259722.972347:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1164:1164:255:4294967295] 192.168.202.108@tcp LPNI seq info [1163:1163:7:4294967295] 00000400:00000200:1.0:1734259722.972353:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259722.972356:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259722.972358:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734259722.972361:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259722.972364:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259722.972366:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259722.972398:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259722.972401:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:0.0:1734259722.972403:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259722.972407:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259722.972410:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:0.0:1734259722.972411:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734259722.972417:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098311296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259732 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259722.972443:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259722.972445:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734259722.972447:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259722.972449:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259722.972451:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:0.0:1734259722.972452:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:0.0:1734259722.972454:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098311168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259738 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259722.974996:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259722.975016:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624480 00000400:00000200:0.0:1734259722.975024:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2549 [1] + 0 00000400:00000200:0.0:1734259722.975043:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259722.975047:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259722.975058:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098311296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259732 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259722.975168:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50aa8. 00000400:00000200:2.0:1734259722.975173:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:2.0:1734259722.975175:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:2.0:1734259722.975180:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098311296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259732 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259722.975186:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098311296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259732 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259722.975213:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:2.0:1734259722.975217:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734259722.975221:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000200:0.0:1734259722.975833:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259722.975843:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624400 00000400:00000200:0.0:1734259722.975848:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2551 [1] + 224 00000400:00000200:0.0:1734259722.975862:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259722.975866:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259722.975871:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098311168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259738 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259722.976132:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259722.976137:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259722.976142:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259722.976147:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098311168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259738 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259722.976153:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098311168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259738 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259722.976170:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734259722.976173:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:1.0:1734259722.976176:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734259727.980174:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734259727.980193:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734259727.980280:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734259727.980287:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734259727.980305:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259727.980325:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259727.980330:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259727.980336:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098311424, portal 25 00000400:00000010:3.0:1734259727.980340:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734259727.980341:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098311424, offset 0 02000000:00000010:2.0:1734259727.980346:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:3.0:1734259727.980348:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259727.980351:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259727.980355:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259727.980357:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098311552, portal 10 00000400:00000200:3.0:1734259727.980358:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734259727.980362:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734259727.980363:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098311552, offset 0 00000400:00000200:3.0:1734259727.980363:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259727.980367:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259727.980368:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259727.980369:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259727.980372:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259727.980374:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1165:1165:256:4294967295] 192.168.202.108@tcp LPNI seq info [1164:1164:8:4294967295] 00000400:00000200:3.0:1734259727.980381:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259727.980385:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259727.980387:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259727.980389:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000400:00000200:2.0:1734259727.980390:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259727.980392:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259727.980394:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734259727.980394:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259727.980396:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259727.980398:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1166:1166:255:4294967295] 192.168.202.108@tcp LPNI seq info [1165:1165:7:4294967295] 00000800:00000200:3.0:1734259727.980401:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259727.980404:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259727.980404:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259727.980408:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259727.980411:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259727.980413:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259727.980417:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259727.980419:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259727.980473:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259727.980476:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734259727.980479:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259727.980483:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259727.980486:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734259727.980487:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734259727.980493:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098311424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259743 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259727.980707:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259727.980709:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259727.980712:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259727.980715:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259727.980717:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734259727.980718:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734259727.980722:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098311552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259737 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259727.982318:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259727.982332:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624580 00000400:00000200:0.0:1734259727.982339:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2561 [1] + 0 00000400:00000200:0.0:1734259727.982348:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259727.982351:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259727.982358:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098311552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259737 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259727.982394:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259727.982398:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624500 00000400:00000200:0.0:1734259727.982411:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2559 [1] + 224 00000400:00000200:0.0:1734259727.982424:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259727.982426:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259727.982431:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098311424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259743 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259727.982512:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259727.982516:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259727.982517:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259727.982528:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098311424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259743 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259727.982534:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098311424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259743 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259727.982553:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259727.982559:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734259727.982563:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:2.0:1734259727.982634:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259727.982638:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259727.982640:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259727.982644:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098311552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259737 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259727.982651:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098311552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259737 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259727.982667:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259727.982671:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:2.0:1734259727.982673:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734259732.987728:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734259732.987749:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734259732.987807:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734259732.987813:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734259732.987862:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259732.987871:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259732.987890:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259732.987897:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098311680, portal 25 00000400:00000010:3.0:1734259732.987902:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734259732.987903:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098311680, offset 0 00000400:00000200:3.0:1734259732.987911:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259732.987927:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259732.987932:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259732.987936:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259732.987938:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259732.987941:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259732.987944:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1167:1167:256:4294967295] 192.168.202.108@tcp LPNI seq info [1166:1166:8:4294967295] 00000400:00000200:3.0:1734259732.987951:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259732.987955:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259732.987959:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734259732.987964:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259732.987971:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259732.987974:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259732.988468:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259732.988473:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259732.988476:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259732.988480:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098311808, portal 10 00000400:00000010:2.0:1734259732.988484:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734259732.988486:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098311808, offset 0 00000400:00000200:2.0:1734259732.988490:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259732.988495:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259732.988497:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259732.988499:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259732.988501:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259732.988503:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259732.988505:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1168:1168:255:4294967295] 192.168.202.108@tcp LPNI seq info [1167:1167:7:4294967295] 00000400:00000200:2.0:1734259732.988511:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259732.988515:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259732.988518:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259732.988520:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259732.988525:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259732.988527:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259732.988552:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259732.988555:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734259732.988559:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259732.988564:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259732.988584:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734259732.988586:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734259732.988593:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098311680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259748 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259732.988657:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259732.988659:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259732.988661:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259732.988664:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259732.988666:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734259732.988667:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734259732.988671:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098311808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259742 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259732.991228:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259732.991245:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624680 00000400:00000200:0.0:1734259732.991253:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2571 [1] + 0 00000400:00000200:0.0:1734259732.991264:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259732.991267:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259732.991288:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098311808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259742 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259732.991327:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259732.991331:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624600 00000400:00000200:0.0:1734259732.991335:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2569 [1] + 224 00000400:00000200:0.0:1734259732.991347:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259732.991350:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259732.991354:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098311680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259748 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259732.991376:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259732.991385:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259732.991386:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259732.991392:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098311808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259742 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259732.991398:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098311808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259742 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259732.991425:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259732.991430:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734259732.991434:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000010:3.0:1734259732.992113:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259732.992118:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259732.992119:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259732.992124:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098311680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259748 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259732.992131:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098311680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259748 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259732.992144:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259732.992149:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:3.0:1734259732.992151:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734259737.995718:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734259737.995738:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734259737.995794:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734259737.995800:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734259737.995865:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259737.995878:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259737.995887:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259737.995895:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098311936, portal 25 00000400:00000010:3.0:1734259737.995918:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 02000000:00000010:2.0:1734259737.995919:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000100:00000200:3.0:1734259737.995921:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098311936, offset 0 00000400:00000010:2.0:1734259737.995927:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000200:3.0:1734259737.995931:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259737.995942:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000200:3.0:1734259737.995946:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:2.0:1734259737.995950:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098312064, portal 10 00000400:00000200:3.0:1734259737.995952:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:2.0:1734259737.995956:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000400:00000200:3.0:1734259737.995957:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:2.0:1734259737.995958:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098312064, offset 0 00000400:00000200:3.0:1734259737.995960:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259737.995963:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259737.995965:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259737.995966:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1169:1169:256:4294967295] 192.168.202.108@tcp LPNI seq info [1168:1168:8:4294967295] 00000400:00000200:3.0:1734259737.995976:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259737.995983:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259737.995987:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000400:00000200:2.0:1734259737.995988:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734259737.995993:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259737.996002:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259737.996007:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259737.996251:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259737.996255:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734259737.996259:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259737.996263:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259737.996268:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734259737.996269:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734259737.996276:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098311936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734259737.996408:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259737.996414:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259737.996417:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259737.996420:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259737.996423:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1170:1170:255:4294967295] 192.168.202.108@tcp LPNI seq info [1169:1169:7:4294967295] 00000400:00000200:2.0:1734259737.996432:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259737.996438:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259737.996443:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259737.996449:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259737.996457:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259737.996460:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259737.997251:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259737.997255:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259737.997259:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259737.997263:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259737.997267:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734259737.997268:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734259737.997274:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098312064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259747 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259737.998160:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259737.998186:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624700 00000400:00000200:0.0:1734259737.998194:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2579 [1] + 224 00000400:00000200:0.0:1734259737.998212:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259737.998215:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259737.998222:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098311936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259753 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259737.998354:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259737.998360:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259737.998361:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259737.998366:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098311936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259737.998373:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098311936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259753 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259737.998396:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259737.998402:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734259737.998406:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000200:0.0:1734259737.998886:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259737.998893:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624780 00000400:00000200:0.0:1734259737.998900:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2581 [1] + 0 00000400:00000200:0.0:1734259737.998911:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259737.998914:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259737.998920:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098312064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259747 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259737.999024:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259737.999036:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259737.999050:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259737.999062:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098312064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259747 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259737.999073:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098312064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259747 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259737.999103:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259737.999110:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734259737.999116:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734259743.005172:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734259743.005197:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734259743.005273:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734259743.005280:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734259743.005385:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259743.005393:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259743.005400:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259743.005408:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098312192, portal 25 00000400:00000010:3.0:1734259743.005412:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734259743.005425:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098312192, offset 0 00000400:00000200:3.0:1734259743.005433:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259743.005446:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259743.005451:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259743.005455:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259743.005458:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259743.005459:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259743.005462:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1171:1171:256:4294967295] 192.168.202.108@tcp LPNI seq info [1170:1170:8:4294967295] 00000400:00000200:3.0:1734259743.005470:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259743.005475:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259743.005478:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734259743.005482:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259743.005490:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259743.005493:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259743.005548:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259743.005553:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259743.005556:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259743.005559:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098312320, portal 10 00000400:00000010:2.0:1734259743.005563:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734259743.005564:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098312320, offset 0 00000400:00000200:2.0:1734259743.005590:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259743.005595:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259743.005597:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259743.005599:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259743.005601:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259743.005602:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259743.005604:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1172:1172:255:4294967295] 192.168.202.108@tcp LPNI seq info [1171:1171:7:4294967295] 00000400:00000200:2.0:1734259743.005610:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259743.005613:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259743.005617:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259743.005619:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259743.005623:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259743.005625:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259743.006290:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259743.006295:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734259743.006300:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259743.006304:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259743.006308:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734259743.006309:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734259743.006316:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098312192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259759 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259743.006374:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259743.006376:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259743.006379:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259743.006381:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259743.006383:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734259743.006389:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734259743.006393:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098312320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259753 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259743.008791:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259743.008810:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624800 00000400:00000200:0.0:1734259743.008818:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2589 [1] + 224 00000400:00000200:0.0:1734259743.008837:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259743.008841:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259743.008850:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098312192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259759 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259743.009566:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259743.009613:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259743.009615:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259743.009621:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098312192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259759 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259743.009627:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098312192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259759 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259743.009646:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259743.009651:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734259743.009654:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000200:0.0:1734259743.009800:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259743.009812:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624880 00000400:00000200:0.0:1734259743.009817:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2591 [1] + 0 00000400:00000200:0.0:1734259743.009828:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259743.009831:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259743.009836:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098312320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259753 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259743.009987:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259743.009991:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259743.009992:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259743.010003:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098312320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259753 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259743.010009:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098312320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259753 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259743.010025:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259743.010028:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734259743.010031:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734259748.011687:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734259748.011705:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734259748.011763:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734259748.011770:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734259748.011790:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259748.011797:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259748.011803:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259748.011809:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098312448, portal 25 00000400:00000010:3.0:1734259748.011813:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734259748.011814:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098312448, offset 0 00000400:00000200:3.0:1734259748.011825:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259748.011846:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259748.011850:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259748.011853:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259748.011855:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259748.011857:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259748.011859:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1173:1173:256:4294967295] 192.168.202.108@tcp LPNI seq info [1172:1172:8:4294967295] 00000400:00000200:3.0:1734259748.011866:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259748.011872:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259748.011875:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734259748.011881:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259748.011889:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259748.011893:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259748.012030:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259748.012033:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734259748.012037:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259748.012041:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259748.012045:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734259748.012046:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734259748.012081:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098312448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259764 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259748.012159:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259748.012165:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259748.012168:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259748.012170:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098312576, portal 10 00000400:00000010:2.0:1734259748.012174:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734259748.012176:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098312576, offset 0 00000400:00000200:2.0:1734259748.012179:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259748.012184:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259748.012186:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259748.012188:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259748.012189:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259748.012191:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259748.012193:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1174:1174:256:4294967295] 192.168.202.108@tcp LPNI seq info [1173:1173:8:4294967295] 00000400:00000200:2.0:1734259748.012198:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259748.012201:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259748.012205:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259748.012207:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259748.012211:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259748.012213:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259748.012345:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259748.012347:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259748.012349:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259748.012352:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259748.012354:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734259748.012356:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734259748.012359:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098312576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259758 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259748.014329:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259748.014346:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624900 00000400:00000200:0.0:1734259748.014353:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2599 [1] + 224 00000400:00000200:0.0:1734259748.014371:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259748.014374:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259748.014383:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098312448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259764 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259748.014446:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259748.014451:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259748.014453:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259748.014463:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098312448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259764 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259748.014470:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098312448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259764 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259748.014489:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259748.014494:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734259748.014497:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000200:0.0:1734259748.014788:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259748.014795:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624980 00000400:00000200:0.0:1734259748.014800:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x25a1 [1] + 0 00000400:00000200:0.0:1734259748.014811:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259748.014814:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259748.014819:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098312576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259748.014917:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259748.014921:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259748.014922:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259748.014927:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098312576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259758 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259748.014948:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098312576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259758 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259748.014965:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259748.014969:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734259748.014972:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734259753.019818:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734259753.019838:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734259753.019895:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734259753.019902:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734259753.019995:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734259753.020002:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259753.020007:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259753.020046:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098312704, portal 25 00000400:00000010:1.0:1734259753.020051:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734259753.020053:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098312704, offset 0 00000400:00000200:1.0:1734259753.020060:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259753.020071:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259753.020075:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259753.020078:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259753.020081:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259753.020082:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259753.020085:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1175:1175:256:4294967295] 192.168.202.108@tcp LPNI seq info [1174:1174:8:4294967295] 00000400:00000200:1.0:1734259753.020097:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259753.020104:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259753.020107:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734259753.020112:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259753.020118:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 02000000:00000010:2.0:1734259753.020120:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000800:00000200:1.0:1734259753.020122:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734259753.020125:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259753.020128:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259753.020131:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098312832, portal 10 00000400:00000010:2.0:1734259753.020135:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259753.020136:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098312832, offset 0 00000400:00000200:2.0:1734259753.020140:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259753.020144:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259753.020146:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259753.020148:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259753.020150:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259753.020152:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259753.020153:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1176:1176:255:4294967295] 192.168.202.108@tcp LPNI seq info [1175:1175:7:4294967295] 00000400:00000200:2.0:1734259753.020159:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259753.020162:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259753.020164:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259753.020167:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259753.020171:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259753.020173:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259753.020188:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259753.020191:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734259753.020205:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259753.020210:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259753.020212:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:0.0:1734259753.020214:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:0.0:1734259753.020221:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098312704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259769 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259753.020415:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259753.020417:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259753.020421:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259753.020424:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259753.020426:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:0.0:1734259753.020427:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:0.0:1734259753.020431:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098312832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259763 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259753.022035:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259753.022052:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624a80 00000400:00000200:0.0:1734259753.022060:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x25b1 [1] + 0 00000400:00000200:0.0:1734259753.022076:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259753.022080:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259753.022089:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098312832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259763 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259753.022129:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259753.022134:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624a00 00000400:00000200:0.0:1734259753.022138:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x25a9 [1] + 224 00000400:00000200:0.0:1734259753.022156:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259753.022159:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259753.022163:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098312704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259769 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259753.022217:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259753.022221:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259753.022223:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259753.022227:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098312832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259763 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259753.022244:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098312832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259763 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259753.022269:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259753.022273:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734259753.022278:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:1.0:1734259753.022361:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259753.022365:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259753.022366:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259753.022370:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098312704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259769 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259753.022382:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098312704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259769 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259753.022393:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734259753.022396:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734259753.022398:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734259758.027842:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734259758.027876:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734259758.027943:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734259758.027951:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734259758.028099:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734259758.028107:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259758.028114:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259758.028120:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098312960, portal 25 00000400:00000010:1.0:1734259758.028124:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734259758.028126:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098312960, offset 0 00000400:00000200:1.0:1734259758.028135:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259758.028146:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259758.028151:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259758.028155:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259758.028157:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259758.028159:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259758.028161:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1177:1177:256:4294967295] 192.168.202.108@tcp LPNI seq info [1176:1176:8:4294967295] 00000400:00000200:1.0:1734259758.028169:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259758.028174:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259758.028177:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734259758.028183:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259758.028190:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259758.028195:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259758.028277:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734259758.028282:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259758.028285:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259758.028287:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098313088, portal 10 00000400:00000010:2.0:1734259758.028292:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734259758.028293:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098313088, offset 0 00000400:00000200:2.0:1734259758.028296:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259758.028300:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259758.028302:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259758.028304:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259758.028305:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259758.028307:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259758.028308:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1178:1178:255:4294967295] 192.168.202.108@tcp LPNI seq info [1177:1177:7:4294967295] 00000400:00000200:2.0:1734259758.028314:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259758.028317:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259758.028319:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259758.028321:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259758.028325:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259758.028326:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259758.028458:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259758.028460:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734259758.028464:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259758.028468:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259758.028472:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:0.0:1734259758.028473:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734259758.028480:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098312960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259774 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259758.028545:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259758.028547:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259758.028550:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259758.028954:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259758.028957:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:0.0:1734259758.028959:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:0.0:1734259758.028963:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098313088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259768 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259758.030906:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259758.030921:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624b80 00000400:00000200:0.0:1734259758.030929:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x25c1 [1] + 0 00000400:00000200:0.0:1734259758.030936:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259758.030939:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259758.030946:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098313088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259768 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259758.030973:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259758.030976:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624b00 00000400:00000200:0.0:1734259758.030990:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x25b9 [1] + 224 00000400:00000200:0.0:1734259758.031008:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259758.031018:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259758.031021:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098312960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259774 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259758.031022:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259758.031026:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259758.031028:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259758.031032:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098313088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259768 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259758.031046:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098313088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259768 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259758.031072:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259758.031077:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734259758.031081:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000400:00000010:1.0:1734259758.031409:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259758.031415:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259758.031416:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259758.031420:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098312960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259774 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259758.031436:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098312960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259774 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259758.031450:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734259758.031453:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:1.0:1734259758.031455:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734259763.035856:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734259763.035892:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734259763.035986:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734259763.035995:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734259763.036055:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734259763.036065:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50aa8. 00000400:00000010:0.0:1734259763.036075:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734259763.036084:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098313344, portal 10 02000000:00000010:3.0:1734259763.036090:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:0.0:1734259763.036091:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734259763.036094:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098313344, offset 0 00000400:00000010:3.0:1734259763.036102:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000200:0.0:1734259763.036105:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734259763.036117:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000400:00000200:0.0:1734259763.036121:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:3.0:1734259763.036124:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098313216, portal 25 00000400:00000200:0.0:1734259763.036127:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734259763.036128:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000200:0.0:1734259763.036131:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:3.0:1734259763.036131:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098313216, offset 0 00000400:00000200:0.0:1734259763.036134:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259763.036136:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259763.036139:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1179:1179:256:4294967295] 192.168.202.108@tcp LPNI seq info [1178:1178:8:4294967295] 00000400:00000200:3.0:1734259763.036139:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259763.036149:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259763.036154:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259763.036158:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000400:00000200:3.0:1734259763.036159:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:0.0:1734259763.036164:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259763.036165:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1734259763.036172:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259763.036177:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734259763.036179:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259763.036183:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259763.036185:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259763.036188:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1180:1180:255:4294967295] 192.168.202.108@tcp LPNI seq info [1179:1179:7:4294967295] 00000400:00000200:3.0:1734259763.036197:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259763.036203:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259763.036207:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734259763.036212:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259763.036219:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259763.036223:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259763.036308:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259763.036312:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:1.0:1734259763.036317:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259763.036351:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259763.036354:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:1.0:1734259763.036356:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:1.0:1734259763.036364:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098313344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259773 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259763.036428:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259763.036430:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734259763.036432:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259763.036435:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259763.036436:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:1.0:1734259763.036438:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734259763.036441:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098313216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259779 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259763.038635:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259763.038653:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624c00 00000400:00000200:0.0:1734259763.038662:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x25d1 [1] + 224 00000400:00000200:0.0:1734259763.038672:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259763.038687:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259763.038699:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098313216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259779 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259763.038741:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259763.038745:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624c80 00000400:00000200:0.0:1734259763.038750:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x25c9 [1] + 0 00000400:00000200:0.0:1734259763.038763:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259763.038766:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259763.038771:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098313344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259773 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259763.038860:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50aa8. 00000400:00000200:1.0:1734259763.038873:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:1.0:1734259763.038876:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:1.0:1734259763.038887:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098313344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259773 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259763.038896:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098313344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259773 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259763.038924:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734259763.038930:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734259763.038956:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:3.0:1734259763.038973:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259763.038978:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259763.038979:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259763.038985:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098313216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259779 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259763.038991:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098313216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259779 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259763.039008:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259763.039014:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:3.0:1734259763.039017:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:2.0:1734259768.043796:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259768.043821:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259768.043884:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259768.043892:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259768.044168:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259768.044176:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259768.044183:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259768.044191:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098313472, portal 25 00000400:00000010:3.0:1734259768.044195:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734259768.044197:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098313472, offset 0 00000400:00000200:3.0:1734259768.044207:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259768.044222:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259768.044227:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259768.044231:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259768.044234:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259768.044249:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259768.044252:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1181:1181:256:4294967295] 192.168.202.108@tcp LPNI seq info [1180:1180:8:4294967295] 00000400:00000200:3.0:1734259768.044260:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259768.044266:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259768.044269:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734259768.044276:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259768.044284:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259768.044289:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:0.0:1734259768.044322:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734259768.044327:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50688. 00000400:00000010:0.0:1734259768.044331:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734259768.044332:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098313600, portal 10 00000400:00000010:0.0:1734259768.044337:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:0.0:1734259768.044338:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098313600, offset 0 00000400:00000200:0.0:1734259768.044342:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259768.044347:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259768.044349:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259768.044351:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259768.044352:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259768.044354:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259768.044355:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1182:1182:255:4294967295] 192.168.202.108@tcp LPNI seq info [1181:1181:7:4294967295] 00000400:00000200:0.0:1734259768.044360:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259768.044363:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259768.044366:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734259768.044368:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259768.044372:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259768.044374:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734259768.045005:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734259768.045009:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:3.0:1734259768.045013:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734259768.045018:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734259768.045022:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:3.0:1734259768.045024:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734259768.045031:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098313472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259784 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734259768.045118:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734259768.045120:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:3.0:1734259768.045122:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734259768.045125:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734259768.045128:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:3.0:1734259768.045129:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:3.0:1734259768.045132:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098313600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259778 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259768.048644:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259768.048665:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624d00 00000400:00000200:0.0:1734259768.048673:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x25d9 [1] + 224 00000400:00000200:0.0:1734259768.048686:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259768.048689:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259768.048699:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098313472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259784 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259768.048738:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259768.048742:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624d80 00000400:00000200:0.0:1734259768.048747:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x25e1 [1] + 0 00000400:00000200:0.0:1734259768.048763:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259768.048766:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259768.048774:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098313600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259778 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259768.049378:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259768.049384:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259768.049385:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259768.049391:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098313472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259784 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259768.049398:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098313472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259784 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259768.049440:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259768.049449:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734259768.049453:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000400:00000010:1.0:1734259768.050520:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50688. 00000400:00000200:1.0:1734259768.050527:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:1.0:1734259768.050530:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:1.0:1734259768.050539:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098313600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259778 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259768.050547:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098313600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259778 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259768.050579:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:1.0:1734259768.050584:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259768.050588:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:2.0:1734259773.051715:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259773.051738:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259773.051801:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259773.051810:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259773.051816:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0000. 00000400:00000010:1.0:1734259773.051824:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259773.051831:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259773.051838:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098313728, portal 25 00000400:00000010:1.0:1734259773.051843:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734259773.051845:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098313728, offset 0 00000400:00000200:1.0:1734259773.051854:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259773.051896:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259773.051902:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259773.051906:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259773.051909:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259773.051911:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259773.051914:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1183:1183:256:4294967295] 192.168.202.108@tcp LPNI seq info [1182:1182:8:4294967295] 00000400:00000200:1.0:1734259773.051923:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259773.051929:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259773.051933:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734259773.051939:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259773.051947:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259773.051952:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:0.0:1734259773.052023:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:0.0:1734259773.052028:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d506e0. 00000400:00000010:0.0:1734259773.052031:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000100:00000200:0.0:1734259773.052034:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098313856, portal 10 00000400:00000010:0.0:1734259773.052038:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000100:00000200:0.0:1734259773.052040:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098313856, offset 0 00000400:00000200:0.0:1734259773.052045:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259773.052049:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259773.052052:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259773.052054:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259773.052056:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259773.052057:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259773.052060:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1184:1184:255:4294967295] 192.168.202.108@tcp LPNI seq info [1183:1183:7:4294967295] 00000400:00000200:0.0:1734259773.052066:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259773.052069:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259773.052077:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734259773.052080:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259773.052084:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259773.052086:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259773.052327:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259773.052330:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:1.0:1734259773.052333:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259773.052337:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259773.052341:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:1.0:1734259773.052343:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734259773.052349:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098313728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259789 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259773.052391:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259773.052393:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734259773.052395:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259773.052399:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259773.052401:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:1.0:1734259773.052402:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:1.0:1734259773.052406:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098313856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259783 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259773.053645:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259773.053658:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624e00 00000400:00000200:0.0:1734259773.053664:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x25e9 [1] + 224 00000400:00000200:0.0:1734259773.053673:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259773.053675:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259773.053682:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098313728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259789 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259773.053717:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259773.053722:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624e80 00000400:00000200:0.0:1734259773.053726:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x25f1 [1] + 0 00000400:00000200:0.0:1734259773.053740:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259773.053744:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259773.053749:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098313856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259783 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259773.053805:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d506e0. 00000400:00000200:2.0:1734259773.053810:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:2.0:1734259773.053811:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:2.0:1734259773.053816:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098313856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259783 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259773.053823:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000100:00000200:2.0:1734259773.053824:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098313856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259783 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734259773.053826:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259773.053828:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259773.053833:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098313728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259789 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259773.053838:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098313728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259789 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259773.053850:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0000. 02000000:00000010:2.0:1734259773.053850:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:1.0:1734259773.053854:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 02000000:00000010:2.0:1734259773.053854:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734259773.053858:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734259773.053858:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259778.059752:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259778.059780:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 02000000:00000010:3.0:1734259778.059890:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000100:00000010:2.0:1734259778.059900:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259778.059907:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259778.059936:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259778.059941:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000400:00000010:2.0:1734259778.059963:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259778.059971:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098314112, portal 10 00000400:00000010:2.0:1734259778.059977:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734259778.059979:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098314112, offset 0 00000400:00000010:3.0:1734259778.059981:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000200:2.0:1734259778.059989:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734259778.059993:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259778.059995:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098313984, portal 25 00000400:00000010:3.0:1734259778.059998:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734259778.059999:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098313984, offset 0 00000400:00000200:2.0:1734259778.060002:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259778.060002:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259778.060008:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259778.060011:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259778.060014:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259778.060017:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259778.060020:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1185:1185:256:4294967295] 192.168.202.108@tcp LPNI seq info [1184:1184:8:4294967295] 00000400:00000200:2.0:1734259778.060028:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259778.060033:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259778.060033:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259778.060034:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734259778.060036:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734259778.060036:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259778.060038:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259778.060039:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259778.060041:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1186:1186:255:4294967295] 192.168.202.108@tcp LPNI seq info [1185:1185:7:4294967295] 00000800:00000200:2.0:1734259778.060042:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259778.060046:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259778.060048:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734259778.060051:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:3.0:1734259778.060051:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734259778.060053:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259778.060055:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734259778.060055:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259778.060057:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259778.060617:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259778.060622:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259778.060629:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259778.060633:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259778.060637:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:0.0:1734259778.060639:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:0.0:1734259778.060647:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098314112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259788 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259778.061503:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259778.061508:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734259778.061512:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259778.061524:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259778.061527:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734259778.061528:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734259778.061533:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098313984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259794 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259778.064533:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259778.064560:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c624f00 00000400:00000200:0.0:1734259778.064600:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2601 [1] + 224 00000400:00000200:0.0:1734259778.064616:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259778.064620:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259778.064630:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098313984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259794 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259778.064680:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259778.064684:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c624f80 00000400:00000200:0.0:1734259778.064689:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x25f9 [1] + 0 00000400:00000200:0.0:1734259778.064706:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259778.064709:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259778.064714:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098314112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259788 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259778.064781:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:2.0:1734259778.064786:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734259778.064789:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259778.064794:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098314112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259788 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259778.064796:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259778.064801:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000100:00000200:2.0:1734259778.064802:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098314112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259788 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259778.064802:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259778.064807:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098313984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259794 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259778.064813:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098313984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259794 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259778.064828:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259778.064828:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:2.0:1734259778.064846:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259778.064850:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 02000000:00000010:3.0:1734259778.064854:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734259778.064857:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259783.067731:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259783.067757:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259783.067825:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259783.067844:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259783.067856:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3a600. 00000400:00000010:0.0:1734259783.067865:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50738. 00000400:00000010:0.0:1734259783.067873:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 02000000:00000010:2.0:1734259783.067874:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259783.067879:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ce18. 00000100:00000200:0.0:1734259783.067882:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098314240, portal 25 00000400:00000010:2.0:1734259783.067882:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734259783.067885:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098314368, portal 10 00000400:00000010:0.0:1734259783.067888:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:0.0:1734259783.067890:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098314240, offset 0 00000400:00000010:2.0:1734259783.067890:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734259783.067891:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098314368, offset 0 00000400:00000200:0.0:1734259783.067900:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259783.067906:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259783.067914:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259783.067918:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259783.067922:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259783.067930:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259783.067931:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259783.067935:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1187:1187:256:4294967295] 192.168.202.108@tcp LPNI seq info [1186:1186:8:4294967295] 00000400:00000200:0.0:1734259783.067943:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259783.067948:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259783.067950:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734259783.067951:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4000. 00000400:00000200:2.0:1734259783.067953:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259783.067955:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:0.0:1734259783.067956:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259783.067957:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259783.067959:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259783.067961:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1188:1188:255:4294967295] 192.168.202.108@tcp LPNI seq info [1187:1187:7:4294967295] 00000800:00000200:0.0:1734259783.067964:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259783.067967:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259783.067967:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259783.067970:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259783.067973:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259783.067975:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259783.067979:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259783.067981:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259783.068056:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259783.068059:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4000. 00000400:00000200:1.0:1734259783.068065:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259783.068069:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259783.068073:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:1.0:1734259783.068074:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:1.0:1734259783.068085:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098314240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259799 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259783.068148:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259783.068150:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734259783.068152:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259783.068155:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259783.068157:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:1.0:1734259783.068158:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:1.0:1734259783.068161:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098314368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259793 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259783.070512:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259783.070533:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625000 00000400:00000200:0.0:1734259783.070542:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2609 [1] + 224 00000400:00000200:0.0:1734259783.070565:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259783.070684:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259783.070696:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098314240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259799 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259783.070737:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259783.070743:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625080 00000400:00000200:0.0:1734259783.070748:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x260d [1] + 0 00000400:00000200:0.0:1734259783.070757:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259783.070760:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259783.070766:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098314368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259793 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259783.070858:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50738. 00000400:00000200:2.0:1734259783.070864:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:2.0:1734259783.070866:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:2.0:1734259783.070872:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098314240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259799 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259783.070879:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098314240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259799 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259783.070905:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3a600. 02000000:00000010:2.0:1734259783.070912:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259783.070915:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000400:00000010:3.0:1734259783.071097:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ce18. 00000400:00000200:3.0:1734259783.071106:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:3.0:1734259783.071107:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:3.0:1734259783.071117:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098314368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259793 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259783.071126:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098314368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259793 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259783.071152:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259783.071158:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259783.071162:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734259788.075976:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259788.075995:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259788.076108:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259788.076116:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259788.076153:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259788.076159:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259788.076167:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259788.076173:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098314496, portal 25 00000400:00000010:3.0:1734259788.076179:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734259788.076181:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098314496, offset 0 00000400:00000200:3.0:1734259788.076190:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259788.076203:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259788.076208:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259788.076216:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259788.076219:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259788.076221:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259788.076223:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1189:1189:256:4294967295] 192.168.202.108@tcp LPNI seq info [1188:1188:8:4294967295] 00000400:00000200:3.0:1734259788.076230:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259788.076235:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259788.076238:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734259788.076242:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259788.076249:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259788.076263:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259788.076336:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259788.076340:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000010:2.0:1734259788.076343:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259788.076345:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098314624, portal 10 00000400:00000010:2.0:1734259788.076349:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:2.0:1734259788.076350:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098314624, offset 0 00000400:00000200:2.0:1734259788.076354:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259788.076360:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259788.076362:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259788.076364:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259788.076366:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259788.076367:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259788.076370:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1190:1190:255:4294967295] 192.168.202.108@tcp LPNI seq info [1189:1189:7:4294967295] 00000400:00000200:2.0:1734259788.076375:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259788.076378:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259788.076380:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259788.076383:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259788.076386:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259788.076389:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259788.076431:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259788.076433:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734259788.076437:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259788.076441:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259788.076444:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:0.0:1734259788.076450:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734259788.076456:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098314496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259804 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259788.076513:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259788.076515:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259788.076518:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259788.076520:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259788.076522:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734259788.076523:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734259788.076526:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098314624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259798 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259788.078646:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259788.078670:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625180 00000400:00000200:0.0:1734259788.078681:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2621 [1] + 0 00000400:00000200:0.0:1734259788.078694:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259788.078699:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259788.078709:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098314624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259798 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259788.078755:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259788.078796:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625100 00000400:00000200:0.0:1734259788.078802:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2619 [1] + 224 00000400:00000010:2.0:1734259788.079152:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:2.0:1734259788.079158:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734259788.079160:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259788.079166:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098314624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259798 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259788.079175:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098314624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259798 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259788.079223:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259788.079231:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259788.079236:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000400:00000200:0.0:1734259788.079298:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259788.079305:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259788.079314:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098314496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259804 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259788.079456:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259788.079462:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259788.079463:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259788.079470:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098314496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259804 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259788.079477:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098314496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259804 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259788.079490:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259788.079496:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259788.079499:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734259793.083755:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259793.083787:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259793.083871:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259793.083880:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259793.083940:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259793.083949:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000010:2.0:1734259793.083960:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259793.083969:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098314880, portal 10 00000400:00000010:2.0:1734259793.083978:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734259793.083980:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098314880, offset 0 00000400:00000200:2.0:1734259793.083994:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259793.084011:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259793.084020:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259793.084024:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259793.084029:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259793.084031:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259793.084034:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1191:1191:256:4294967295] 192.168.202.108@tcp LPNI seq info [1190:1190:8:4294967295] 00000400:00000200:2.0:1734259793.084044:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259793.084051:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259793.084055:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259793.084061:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259793.084070:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259793.084076:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259793.084284:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259793.084290:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259793.084294:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259793.084296:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098314752, portal 25 00000400:00000010:3.0:1734259793.084299:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734259793.084301:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098314752, offset 0 00000400:00000200:3.0:1734259793.084305:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259793.084310:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259793.084312:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259793.084315:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259793.084316:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259793.084318:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259793.084320:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1192:1192:255:4294967295] 192.168.202.108@tcp LPNI seq info [1191:1191:7:4294967295] 00000400:00000200:3.0:1734259793.084326:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259793.084329:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259793.084331:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734259793.084334:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259793.084338:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259793.084340:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259793.084749:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259793.084758:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259793.084765:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259793.084773:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259793.084779:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734259793.084792:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734259793.084803:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098314880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259803 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259793.084840:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259793.084841:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734259793.084843:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259793.084845:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259793.084847:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:0.0:1734259793.084848:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734259793.084852:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098314752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259809 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259793.087429:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259793.087450:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625200 00000400:00000200:0.0:1734259793.087459:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2631 [1] + 224 00000400:00000200:0.0:1734259793.087470:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259793.087473:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259793.087484:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098314752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259809 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259793.087519:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259793.087523:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625280 00000400:00000200:0.0:1734259793.087527:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2629 [1] + 0 00000400:00000200:0.0:1734259793.087541:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259793.087544:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259793.087549:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098314880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259803 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259793.087615:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:2.0:1734259793.087621:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734259793.087622:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259793.087636:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098314880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259803 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259793.087643:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098314880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259803 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259793.087671:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259793.087676:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259793.087680:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000400:00000010:3.0:1734259793.088090:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259793.088100:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259793.088107:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259793.088117:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098314752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259809 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259793.088126:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098314752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259809 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259793.088148:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259793.088155:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259793.088158:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000100:00000010:2.0:1734259798.091714:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259798.091733:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259798.091787:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259798.091793:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259798.091822:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259798.091828:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cdc0. 00000400:00000010:2.0:1734259798.091834:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259798.091841:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098315136, portal 10 00000400:00000010:2.0:1734259798.091846:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734259798.091847:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098315136, offset 0 02000000:00000010:0.0:1734259798.091854:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000200:2.0:1734259798.091854:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:0.0:1734259798.091862:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50790. 00000400:00000200:2.0:1734259798.091865:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:0.0:1734259798.091866:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000400:00000200:2.0:1734259798.091869:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:0.0:1734259798.091871:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098315008, portal 25 00000400:00000200:2.0:1734259798.091872:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259798.091875:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259798.091877:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259798.091879:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1193:1193:256:4294967295] 192.168.202.108@tcp LPNI seq info [1192:1192:8:4294967295] 00000400:00000010:0.0:1734259798.091886:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000400:00000200:2.0:1734259798.091886:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:0.0:1734259798.091887:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098315008, offset 0 00000800:00000200:2.0:1734259798.091892:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259798.091893:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259798.091896:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259798.091900:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259798.091901:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259798.091904:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259798.091907:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734259798.091907:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734259798.091909:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259798.091910:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734259798.091911:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259798.091913:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1194:1194:255:4294967295] 192.168.202.108@tcp LPNI seq info [1193:1193:7:4294967295] 00000400:00000200:0.0:1734259798.091918:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259798.091921:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259798.091924:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734259798.091927:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259798.091932:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259798.091935:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259798.092484:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259798.092488:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734259798.092493:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259798.092497:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259798.092501:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:1.0:1734259798.092502:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:1.0:1734259798.092509:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098315136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259808 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259798.092593:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259798.092596:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734259798.092599:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259798.092601:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259798.092603:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:1.0:1734259798.092604:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:1.0:1734259798.092606:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098315008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259798.096928:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259798.096945:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625300 00000400:00000200:0.0:1734259798.096954:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2641 [1] + 224 00000400:00000200:0.0:1734259798.096965:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259798.096968:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259798.096976:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098315008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259814 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259798.097015:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259798.097019:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625380 00000400:00000200:0.0:1734259798.097024:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2639 [1] + 0 00000400:00000200:0.0:1734259798.097038:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259798.097041:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259798.097045:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098315136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259808 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259798.097088:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50790. 00000400:00000200:2.0:1734259798.097094:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:2.0:1734259798.097096:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:2.0:1734259798.097101:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098315008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259798.097108:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098315008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259814 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259798.097130:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734259798.097134:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259798.097137:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000400:00000010:3.0:1734259798.097362:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cdc0. 00000400:00000200:3.0:1734259798.097366:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:3.0:1734259798.097368:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:3.0:1734259798.097372:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098315136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259808 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259798.097378:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098315136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259808 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259798.097397:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259798.097401:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259798.097402:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734259803.099741:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259803.099769:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259803.099839:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259803.099850:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259803.099878:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 00000400:00000010:0.0:1734259803.099888:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d507e8. 02000000:00000010:2.0:1734259803.099894:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:0.0:1734259803.099896:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000400:00000010:2.0:1734259803.099899:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd68. 00000100:00000200:0.0:1734259803.099906:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098315264, portal 25 00000400:00000010:0.0:1734259803.099911:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000400:00000010:2.0:1734259803.099911:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734259803.099913:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098315264, offset 0 00000100:00000200:2.0:1734259803.099915:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098315392, portal 10 00000400:00000010:2.0:1734259803.099920:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000400:00000200:0.0:1734259803.099925:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259803.099929:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098315392, offset 0 00000400:00000200:2.0:1734259803.099935:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259803.099942:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259803.099949:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259803.099952:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259803.099964:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259803.099967:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259803.099974:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1195:1195:256:4294967295] 192.168.202.108@tcp LPNI seq info [1194:1194:8:4294967295] 00000400:00000200:0.0:1734259803.099984:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259803.099990:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259803.099991:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259803.099994:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734259803.099995:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000400:00000200:2.0:1734259803.099996:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259803.099998:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259803.100000:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734259803.100001:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259803.100002:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1196:1196:255:4294967295] 192.168.202.108@tcp LPNI seq info [1195:1195:7:4294967295] 00000400:00000200:2.0:1734259803.100007:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259803.100008:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259803.100011:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259803.100013:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:2.0:1734259803.100013:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259803.100016:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259803.100040:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259803.100042:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259803.100109:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259803.100115:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734259803.100120:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259803.100127:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259803.100131:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:1.0:1734259803.100132:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000100:00000200:1.0:1734259803.100152:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098315264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259803.100223:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259803.100225:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734259803.100228:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259803.100231:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259803.100233:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:1.0:1734259803.100235:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:1.0:1734259803.100239:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098315392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259813 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259803.102034:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259803.102050:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625400 00000400:00000200:0.0:1734259803.102058:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2649 [1] + 224 00000400:00000200:0.0:1734259803.102069:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259803.102072:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259803.102081:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098315264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259819 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259803.102123:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259803.102127:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625480 00000400:00000200:0.0:1734259803.102142:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2651 [1] + 0 00000400:00000200:0.0:1734259803.102152:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259803.102155:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259803.102160:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098315392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259813 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259803.102164:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d507e8. 00000400:00000200:2.0:1734259803.102169:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:2.0:1734259803.102171:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:2.0:1734259803.102176:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098315264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259803.102183:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098315264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259819 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259803.102212:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 02000000:00000010:2.0:1734259803.102219:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000400:00000010:3.0:1734259803.102222:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd68. 00000100:00000010:2.0:1734259803.102223:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000400:00000200:3.0:1734259803.102225:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:3.0:1734259803.102226:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:3.0:1734259803.102231:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098315392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259813 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259803.102235:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098315392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259813 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259803.102249:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259803.102252:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259803.102254:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259808.107914:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259808.107951:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259808.108044:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259808.108057:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259808.108110:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 02000000:00000010:2.0:1734259808.108131:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259808.108143:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:3.0:1734259808.108153:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:2.0:1734259808.108154:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000400:00000010:3.0:1734259808.108163:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:2.0:1734259808.108172:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098315648, portal 10 00000400:00000010:2.0:1734259808.108181:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:3.0:1734259808.108184:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098315520, portal 25 00000100:00000200:2.0:1734259808.108186:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098315648, offset 0 00000400:00000010:3.0:1734259808.108189:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734259808.108191:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098315520, offset 0 00000400:00000200:2.0:1734259808.108203:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259808.108214:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259808.108229:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259808.108244:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259808.108250:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259808.108256:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259808.108260:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259808.108265:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1197:1197:256:4294967295] 192.168.202.108@tcp LPNI seq info [1196:1196:8:4294967295] 00000400:00000200:2.0:1734259808.108277:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259808.108286:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259808.108286:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259808.108291:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259808.108294:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259808.108297:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259808.108299:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259808.108302:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1198:1198:255:4294967295] 192.168.202.108@tcp LPNI seq info [1197:1197:7:4294967295] 00000400:00000200:3.0:1734259808.108309:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000010:2.0:1734259808.108314:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:3.0:1734259808.108314:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259808.108318:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:2.0:1734259808.108322:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259808.108324:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259808.108335:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259808.108336:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259808.108342:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734259808.108342:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259808.109140:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259808.109146:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259808.109152:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259808.109158:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259808.109162:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734259808.109164:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734259808.109173:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098315648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259808.109255:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259808.109257:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734259808.109259:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259808.109262:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259808.109264:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:0.0:1734259808.109265:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:0.0:1734259808.109269:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098315520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259808.110823:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259808.110843:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625580 00000400:00000200:0.0:1734259808.110853:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2659 [1] + 0 00000400:00000200:0.0:1734259808.110865:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259808.110868:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259808.110877:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098315648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259818 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259808.110915:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259808.110919:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625500 00000400:00000200:0.0:1734259808.110937:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x265d [1] + 224 00000400:00000200:0.0:1734259808.110951:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259808.110954:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:2.0:1734259808.110954:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:2.0:1734259808.110959:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734259808.110961:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734259808.110966:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098315648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734259808.110968:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098315520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259824 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259808.110973:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098315648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259818 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734259808.110992:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 00000400:00000010:3.0:1734259808.111080:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259808.111089:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259808.111091:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259808.111100:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098315520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259808.111110:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098315520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259824 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259808.111137:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259808.111148:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259808.111155:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259808.116556:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259808.116584:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259808.116590:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734259813.115827:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259813.115849:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259813.115901:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259813.115905:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259813.115934:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259813.115941:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:2.0:1734259813.115946:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734259813.115952:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098315904, portal 10 00000400:00000010:2.0:1734259813.115960:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:2.0:1734259813.115961:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098315904, offset 0 00000400:00000200:2.0:1734259813.115969:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259813.115981:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259813.115986:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259813.115989:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259813.115992:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259813.115994:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259813.116009:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1199:1199:256:4294967295] 192.168.202.108@tcp LPNI seq info [1198:1198:8:4294967295] 00000400:00000200:2.0:1734259813.116017:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259813.116021:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259813.116024:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259813.116029:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259813.116036:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259813.116039:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734259813.116043:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734259813.116047:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259813.116050:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259813.116053:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098315776, portal 25 00000400:00000010:1.0:1734259813.116055:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734259813.116057:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098315776, offset 0 00000400:00000200:1.0:1734259813.116061:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259813.116065:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259813.116067:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259813.116068:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259813.116070:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259813.116071:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259813.116073:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1200:1200:255:4294967295] 192.168.202.108@tcp LPNI seq info [1199:1199:7:4294967295] 00000400:00000200:1.0:1734259813.116078:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259813.116081:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259813.116083:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734259813.116086:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259813.116089:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259813.116091:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259813.116201:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259813.116204:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734259813.116208:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259813.116212:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259813.116216:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734259813.116217:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734259813.116222:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098315904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259813.116282:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259813.116283:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734259813.116285:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259813.116287:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259813.116288:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:0.0:1734259813.116289:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:0.0:1734259813.116291:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098315776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259829 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259813.118908:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259813.118923:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625600 00000400:00000200:0.0:1734259813.118929:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2671 [1] + 224 00000400:00000200:0.0:1734259813.118938:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259813.118942:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259813.118952:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098315776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259829 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259813.118989:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259813.118994:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625680 00000400:00000200:0.0:1734259813.119009:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2669 [1] + 0 00000400:00000200:0.0:1734259813.119021:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259813.119024:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259813.119033:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098315904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259823 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259813.119172:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:2.0:1734259813.119177:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734259813.119179:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734259813.119183:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098315904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259813.119190:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098315904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259823 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259813.119200:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259813.119203:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259813.119208:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259813.119211:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098315776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259829 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259813.119215:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 00000100:00000200:1.0:1734259813.119216:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098315776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259829 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259813.119219:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259813.119222:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 02000000:00000010:1.0:1734259813.119224:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259813.119226:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259813.119229:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734259818.123710:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259818.123727:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259818.123786:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259818.123791:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259818.123823:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259818.123829:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:2.0:1734259818.123834:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734259818.123839:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098316160, portal 10 00000400:00000010:2.0:1734259818.123844:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734259818.123847:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098316160, offset 0 00000400:00000200:2.0:1734259818.123854:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259818.123865:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259818.123869:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:3.0:1734259818.123876:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000200:2.0:1734259818.123883:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:3.0:1734259818.123883:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000200:2.0:1734259818.123885:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259818.123887:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259818.123890:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1201:1201:256:4294967295] 192.168.202.108@tcp LPNI seq info [1200:1200:8:4294967295] 00000400:00000010:3.0:1734259818.123895:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000400:00000200:2.0:1734259818.123898:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:3.0:1734259818.123899:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098316032, portal 25 00000800:00000200:2.0:1734259818.123903:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734259818.123903:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734259818.123905:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098316032, offset 0 00000800:00000010:2.0:1734259818.123908:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:3.0:1734259818.123911:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734259818.123913:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259818.123917:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734259818.123920:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259818.123921:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:2.0:1734259818.123923:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734259818.123923:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259818.123925:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259818.123927:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259818.123930:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1202:1202:255:4294967295] 192.168.202.108@tcp LPNI seq info [1201:1201:7:4294967295] 00000400:00000200:3.0:1734259818.123938:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259818.123942:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259818.123946:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734259818.123951:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259818.123957:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259818.123959:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259818.124019:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259818.124022:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259818.124027:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259818.124031:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259818.124034:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734259818.124035:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734259818.124042:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098316160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259828 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259818.124139:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259818.124141:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734259818.124144:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259818.124147:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259818.124149:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:0.0:1734259818.124150:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:0.0:1734259818.124153:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098316032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259834 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259818.125275:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259818.125287:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625780 00000400:00000200:0.0:1734259818.125294:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2679 [1] + 0 00000400:00000200:0.0:1734259818.125303:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259818.125306:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259818.125313:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098316160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259828 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259818.125349:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259818.125353:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625700 00000400:00000200:0.0:1734259818.125364:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2681 [1] + 224 00000400:00000200:0.0:1734259818.125378:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259818.125381:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259818.125384:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098316032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259834 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259818.125448:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259818.125452:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259818.125454:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000400:00000010:2.0:1734259818.125458:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000100:00000200:3.0:1734259818.125458:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098316032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259834 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734259818.125462:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:2.0:1734259818.125463:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:3.0:1734259818.125465:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098316032/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259834 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259818.125467:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098316160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259828 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259818.125473:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098316160/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259828 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259818.125482:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259818.125487:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 02000000:00000010:2.0:1734259818.125488:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734259818.125491:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259818.125492:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259818.125494:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734259823.131729:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259823.131755:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 02000000:00000010:0.0:1734259823.131869:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3be00. 00000400:00000010:0.0:1734259823.131878:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50840. 00000400:00000010:0.0:1734259823.131885:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000100:00000200:0.0:1734259823.131893:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098316288, portal 25 00000400:00000010:0.0:1734259823.131898:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000100:00000200:0.0:1734259823.131900:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098316288, offset 0 00000400:00000200:0.0:1734259823.131910:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259823.131925:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000010:2.0:1734259823.131926:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 00000400:00000200:0.0:1734259823.131932:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259823.131935:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259823.131938:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259823.131941:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259823.131943:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1203:1203:256:4294967295] 192.168.202.108@tcp LPNI seq info [1202:1202:8:4294967295] 02000000:00000010:2.0:1734259823.131948:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 00000400:00000200:0.0:1734259823.131952:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259823.131958:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259823.131962:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000800:00000200:0.0:1734259823.131967:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259823.131976:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259823.131980:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259823.132009:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259823.132017:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cd10. 00000400:00000010:2.0:1734259823.132023:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000100:00000200:2.0:1734259823.132029:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098316416, portal 10 00000400:00000010:2.0:1734259823.132035:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734259823.132037:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098316416, offset 0 00000400:00000200:2.0:1734259823.132060:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259823.132073:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259823.132078:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259823.132082:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259823.132085:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259823.132087:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259823.132090:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1204:1204:255:4294967295] 192.168.202.108@tcp LPNI seq info [1203:1203:7:4294967295] 00000400:00000200:2.0:1734259823.132098:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259823.132102:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259823.132106:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259823.132111:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259823.132118:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259823.132122:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259823.132135:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259823.132139:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734259823.132144:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259823.132149:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259823.132152:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:1.0:1734259823.132154:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:1.0:1734259823.132163:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098316288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259839 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259823.132338:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259823.132343:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734259823.132347:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259823.132351:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259823.132355:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:1.0:1734259823.132356:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:1.0:1734259823.132362:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098316416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259833 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259823.134113:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259823.134125:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625800 00000400:00000200:0.0:1734259823.134131:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2689 [1] + 224 00000400:00000200:0.0:1734259823.134139:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259823.134142:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259823.134162:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098316288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259839 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259823.134197:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259823.134200:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625880 00000400:00000200:0.0:1734259823.134204:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2691 [1] + 0 00000400:00000200:0.0:1734259823.134213:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259823.134216:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259823.134220:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098316416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259833 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259823.134380:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cd10. 00000400:00000200:3.0:1734259823.134385:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:3.0:1734259823.134387:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:3.0:1734259823.134391:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098316416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259833 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259823.134402:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098316416/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259833 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259823.134426:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259823.134430:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259823.134433:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:2.0:1734259823.136053:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50840. 00000400:00000200:2.0:1734259823.136064:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:2.0:1734259823.136066:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:2.0:1734259823.136076:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098316288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259839 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259823.136084:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098316288/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259839 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259823.136105:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3be00. 02000000:00000010:2.0:1734259823.136112:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259823.136115:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734259828.139737:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259828.139762:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259828.139821:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259828.139829:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259828.139868:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259828.139869:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:2.0:1734259828.139875:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000400:00000010:3.0:1734259828.139876:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:2.0:1734259828.139880:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734259828.139880:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259828.139886:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098316544, portal 25 00000400:00000010:3.0:1734259828.139891:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734259828.139893:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098316544, offset 0 00000100:00000200:2.0:1734259828.139895:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098316672, portal 10 00000400:00000010:2.0:1734259828.139900:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000400:00000200:3.0:1734259828.139902:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259828.139909:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098316672, offset 0 00000400:00000200:2.0:1734259828.139914:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259828.139915:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259828.139919:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259828.139922:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259828.139925:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259828.139928:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259828.139930:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1205:1205:256:4294967295] 192.168.202.108@tcp LPNI seq info [1204:1204:8:4294967295] 00000400:00000200:3.0:1734259828.139937:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259828.139942:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259828.139943:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259828.139945:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734259828.139945:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000400:00000200:2.0:1734259828.139947:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259828.139949:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259828.139950:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259828.139952:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1206:1206:255:4294967295] 192.168.202.108@tcp LPNI seq info [1205:1205:7:4294967295] 00000800:00000200:3.0:1734259828.139953:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259828.139957:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259828.139959:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259828.139961:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734259828.139962:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:2.0:1734259828.139964:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259828.139966:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259828.139970:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259828.139972:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259828.140080:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259828.140083:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734259828.140087:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259828.140092:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259828.140096:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:0.0:1734259828.140097:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:0.0:1734259828.140104:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098316544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259844 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259828.140162:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259828.140165:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259828.140167:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259828.140170:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259828.140172:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734259828.140173:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734259828.140176:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098316672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259838 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259828.142174:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259828.142190:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625980 00000400:00000200:0.0:1734259828.142198:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x26a1 [1] + 0 00000400:00000200:0.0:1734259828.142213:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259828.142217:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259828.142235:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098316672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259828.142272:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259828.142276:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625900 00000400:00000200:0.0:1734259828.142280:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2699 [1] + 224 00000400:00000200:0.0:1734259828.142289:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259828.142291:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259828.142296:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098316544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259844 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259828.142451:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259828.142457:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259828.142459:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000400:00000010:2.0:1734259828.142474:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:2.0:1734259828.142478:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734259828.142479:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:3.0:1734259828.142479:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098316544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259844 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259828.142484:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098316672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259838 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259828.142490:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098316672/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259838 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259828.142496:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098316544/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259844 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259828.142512:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259828.142513:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:2.0:1734259828.142518:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259828.142518:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259828.142520:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:3.0:1734259828.142520:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734259833.147713:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259833.147734:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259833.147798:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259833.147805:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259833.147859:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259833.147860:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:2.0:1734259833.147867:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000400:00000010:3.0:1734259833.147867:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:2.0:1734259833.147873:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734259833.147873:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:2.0:1734259833.147880:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098316928, portal 10 00000100:00000200:3.0:1734259833.147884:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098316800, portal 25 00000400:00000010:3.0:1734259833.147888:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734259833.147894:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098316800, offset 0 00000400:00000200:3.0:1734259833.147902:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259833.147913:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259833.147919:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259833.147922:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259833.147926:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259833.147928:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259833.147931:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1207:1207:256:4294967295] 192.168.202.108@tcp LPNI seq info [1206:1206:8:4294967295] 00000400:00000200:3.0:1734259833.147940:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259833.147946:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259833.147950:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734259833.147955:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:2.0:1734259833.147960:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734259833.147962:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098316928, offset 0 00000800:00000200:3.0:1734259833.147962:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259833.147965:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259833.147968:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259833.147973:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259833.147975:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259833.147977:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259833.147979:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259833.147981:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259833.147982:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1208:1208:255:4294967295] 192.168.202.108@tcp LPNI seq info [1207:1207:7:4294967295] 00000400:00000200:2.0:1734259833.147988:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259833.147991:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259833.147993:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259833.147996:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259833.148000:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259833.148002:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259833.148082:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259833.148085:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734259833.148089:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259833.148093:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259833.148098:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734259833.148099:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734259833.148107:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098316800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259849 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259833.148175:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259833.148176:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259833.148179:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259833.148181:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259833.148183:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734259833.148184:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734259833.148188:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098316928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259843 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259833.150821:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259833.150840:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625a00 00000400:00000200:0.0:1734259833.150849:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x26ad [1] + 224 00000400:00000200:0.0:1734259833.150860:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259833.150875:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259833.150885:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098316800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259849 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259833.150927:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259833.150931:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625a80 00000400:00000200:0.0:1734259833.150937:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x26a9 [1] + 0 00000400:00000200:0.0:1734259833.150950:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259833.150953:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259833.150958:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098316928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259843 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259833.151207:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:2.0:1734259833.151212:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734259833.151215:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259833.151224:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098316928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259843 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259833.151231:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098316928/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259843 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259833.151261:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259833.151266:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259833.151269:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000010:3.0:1734259833.151276:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259833.151280:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259833.151281:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259833.151285:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098316800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259849 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259833.151299:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098316800/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259849 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259833.151310:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259833.151314:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734259833.151320:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734259838.155730:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259838.155768:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259838.155833:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259838.155839:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259838.155853:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259838.155862:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 02000000:00000010:2.0:1734259838.155869:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:3.0:1734259838.155870:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000400:00000010:2.0:1734259838.155873:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000100:00000200:3.0:1734259838.155877:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098317056, portal 25 00000400:00000010:2.0:1734259838.155878:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734259838.155884:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:2.0:1734259838.155885:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098317184, portal 10 00000100:00000200:3.0:1734259838.155886:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098317056, offset 0 00000400:00000010:2.0:1734259838.155889:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000400:00000200:3.0:1734259838.155895:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259838.155903:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098317184, offset 0 00000400:00000200:2.0:1734259838.155908:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259838.155913:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259838.155918:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259838.155922:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259838.155926:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259838.155928:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259838.155930:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1209:1209:256:4294967295] 192.168.202.108@tcp LPNI seq info [1208:1208:8:4294967295] 00000400:00000200:3.0:1734259838.155938:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259838.155944:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259838.155945:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259838.155947:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734259838.155948:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000400:00000200:2.0:1734259838.155950:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259838.155952:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259838.155953:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734259838.155954:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259838.155955:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1210:1210:255:4294967295] 192.168.202.108@tcp LPNI seq info [1209:1209:7:4294967295] 00000400:00000200:2.0:1734259838.155962:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259838.155963:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259838.155966:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734259838.155967:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000800:00000010:2.0:1734259838.155968:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259838.155971:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259838.155973:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259838.155975:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259838.156058:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259838.156061:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734259838.156066:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259838.156071:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259838.156074:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734259838.156076:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734259838.156085:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098317056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259854 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259838.156155:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259838.156157:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259838.156160:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259838.156162:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259838.156164:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734259838.156166:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734259838.156169:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098317184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259848 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259838.157633:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259838.157650:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625b00 00000400:00000200:0.0:1734259838.157657:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x26b9 [1] + 224 00000400:00000200:0.0:1734259838.157668:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259838.157682:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259838.157691:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098317056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259854 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259838.157726:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259838.157731:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625b80 00000400:00000200:0.0:1734259838.157735:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x26bd [1] + 0 00000400:00000200:0.0:1734259838.157746:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259838.157750:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259838.157754:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098317184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259838.157760:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259838.157765:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259838.157767:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259838.157772:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098317056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259854 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259838.157789:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098317056/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259854 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259838.157810:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259838.157814:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:3.0:1734259838.157819:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000400:00000010:2.0:1734259838.157826:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:2.0:1734259838.157833:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734259838.157835:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734259838.157842:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098317184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259848 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259838.157850:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098317184/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259848 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259838.157874:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259838.157888:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259838.157891:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259843.163683:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259843.163704:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259843.163755:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259843.163761:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259843.163783:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 02000000:00000010:2.0:1734259843.163788:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:0.0:1734259843.163791:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50898. 00000400:00000010:2.0:1734259843.163791:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ccb8. 00000400:00000010:0.0:1734259843.163797:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000400:00000010:2.0:1734259843.163797:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:0.0:1734259843.163802:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098317312, portal 25 00000400:00000010:0.0:1734259843.163805:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1000. 00000100:00000200:0.0:1734259843.163809:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098317312, offset 0 00000100:00000200:2.0:1734259843.163809:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098317440, portal 10 00000400:00000010:2.0:1734259843.163813:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000200:0.0:1734259843.163817:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259843.163821:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098317440, offset 0 00000400:00000200:2.0:1734259843.163826:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259843.163833:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259843.163837:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259843.163841:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259843.163844:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259843.163846:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259843.163848:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1211:1211:256:4294967295] 192.168.202.108@tcp LPNI seq info [1210:1210:8:4294967295] 00000400:00000200:0.0:1734259843.163856:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259843.163861:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259843.163863:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734259843.163864:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000400:00000200:2.0:1734259843.163865:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259843.163867:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:0.0:1734259843.163869:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259843.163869:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259843.163871:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259843.163872:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1212:1212:255:4294967295] 192.168.202.108@tcp LPNI seq info [1211:1211:7:4294967295] 00000800:00000200:0.0:1734259843.163876:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259843.163878:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259843.163879:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259843.163885:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259843.163888:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259843.163890:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259843.163894:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259843.163896:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259843.163974:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259843.163978:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734259843.163983:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259843.163987:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259843.163990:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1000 00000400:00000010:1.0:1734259843.163992:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1000. 00000100:00000200:1.0:1734259843.163999:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098317312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259859 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259843.164068:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259843.164070:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734259843.164073:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259843.164076:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259843.164078:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:1.0:1734259843.164079:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:1.0:1734259843.164082:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098317440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259853 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259843.165748:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259843.165764:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625c00 00000400:00000200:0.0:1734259843.165771:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x26c9 [1] + 224 00000400:00000200:0.0:1734259843.165781:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259843.165784:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259843.165793:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098317312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259859 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259843.165834:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259843.165839:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625c80 00000400:00000200:0.0:1734259843.165843:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x26cd [1] + 0 00000400:00000200:0.0:1734259843.165855:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259843.165858:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259843.165863:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098317440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259843.165929:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ccb8. 00000400:00000200:3.0:1734259843.165934:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:3.0:1734259843.165936:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:3.0:1734259843.165940:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098317440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259853 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259843.165947:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098317440/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259853 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259843.165968:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259843.165973:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259843.165976:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000400:00000010:2.0:1734259843.166136:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50898. 00000400:00000200:2.0:1734259843.166140:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:2.0:1734259843.166142:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:2.0:1734259843.166147:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098317312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259859 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259843.166153:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098317312/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259859 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259843.166174:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 02000000:00000010:2.0:1734259843.166177:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259843.166180:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734259848.171950:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259848.171977:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259848.172040:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259848.172060:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259848.172103:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259848.172109:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734259848.172115:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734259848.172122:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098317696, portal 10 00000400:00000010:2.0:1734259848.172128:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000100:00000200:2.0:1734259848.172129:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098317696, offset 0 00000400:00000200:2.0:1734259848.172138:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259848.172152:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259848.172157:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259848.172160:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259848.172163:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259848.172165:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259848.172167:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1213:1213:256:4294967295] 192.168.202.108@tcp LPNI seq info [1212:1212:8:4294967295] 00000400:00000200:2.0:1734259848.172175:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259848.172181:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259848.172184:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259848.172191:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259848.172198:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259848.172202:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734259848.172313:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259848.172350:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259848.172353:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259848.172356:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098317568, portal 25 00000400:00000010:3.0:1734259848.172359:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734259848.172361:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098317568, offset 0 00000800:00000200:0.0:1734259848.172362:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259848.172365:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734259848.172365:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259848.172369:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734259848.172370:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259848.172372:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259848.172373:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734259848.172374:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259848.172376:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000200:3.0:1734259848.172376:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259848.172377:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:0.0:1734259848.172378:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000400:00000200:3.0:1734259848.172379:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1214:1214:255:4294967295] 192.168.202.108@tcp LPNI seq info [1213:1213:7:4294967295] 00000100:00000200:0.0:1734259848.172385:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098317696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259858 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734259848.172385:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259848.172434:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259848.172437:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734259848.172440:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259848.172444:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259848.172446:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259848.172476:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259848.172480:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734259848.172482:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259848.172485:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259848.172487:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:1.0:1734259848.172489:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:1.0:1734259848.172492:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098317568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259864 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259848.174667:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259848.174689:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625d00 00000400:00000200:0.0:1734259848.174697:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x26e1 [1] + 224 00000400:00000200:0.0:1734259848.174708:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259848.174712:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259848.174720:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098317568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259864 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259848.174775:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259848.174837:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625d80 00000400:00000200:0.0:1734259848.174843:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x26d9 [1] + 0 00000400:00000200:0.0:1734259848.174858:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259848.174861:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259848.174866:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098317696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259858 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259848.174894:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259848.174900:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259848.174902:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259848.174909:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098317568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259864 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259848.174916:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098317568/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259864 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259848.174938:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259848.174943:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:3.0:1734259848.174947:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000010:2.0:1734259848.175025:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734259848.175028:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:2.0:1734259848.175029:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734259848.175032:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098317696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259858 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259848.175040:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098317696/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259858 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259848.175054:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259848.175057:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259848.175058:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734259853.180114:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259853.180142:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259853.180201:0:8371:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259853.180208:0:8371:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259853.180250:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259853.180258:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734259853.180266:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734259853.180274:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098317952, portal 10 00000400:00000010:2.0:1734259853.180294:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734259853.180297:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098317952, offset 0 00000400:00000200:2.0:1734259853.180308:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259853.180322:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259853.180328:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259853.180332:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259853.180336:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259853.180338:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259853.180341:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1215:1215:256:4294967295] 192.168.202.108@tcp LPNI seq info [1214:1214:8:4294967295] 00000400:00000200:2.0:1734259853.180350:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259853.180356:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259853.180359:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259853.180366:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259853.180375:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259853.180379:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734259853.180755:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1e00. 00000400:00000010:1.0:1734259853.180768:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259853.180775:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259853.180783:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098317824, portal 25 00000400:00000010:1.0:1734259853.180789:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734259853.180791:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098317824, offset 0 00000400:00000200:1.0:1734259853.180800:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259853.180815:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259853.180820:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259853.180824:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259853.180827:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259853.180828:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259853.180831:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1216:1216:255:4294967295] 192.168.202.108@tcp LPNI seq info [1215:1215:7:4294967295] 00000400:00000200:1.0:1734259853.180838:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259853.180856:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259853.180860:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734259853.180865:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259853.180871:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259853.180875:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259853.181016:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259853.181019:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259853.181025:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259853.181029:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259853.181033:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:0.0:1734259853.181034:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:0.0:1734259853.181041:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098317952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259863 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259853.181267:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259853.181272:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734259853.181277:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259853.181293:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259853.181297:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:0.0:1734259853.181298:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:0.0:1734259853.181305:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098317824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259869 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259853.183131:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259853.183148:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625e80 00000400:00000200:0.0:1734259853.183156:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x26e9 [1] + 0 00000400:00000200:0.0:1734259853.184191:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259853.184201:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259853.184213:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098317952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259863 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259853.184439:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259853.184447:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625e00 00000400:00000200:0.0:1734259853.184453:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x26f1 [1] + 224 00000400:00000200:0.0:1734259853.184464:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259853.184468:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259853.184473:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098317824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259869 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259853.184595:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259853.184600:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259853.184601:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259853.184607:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098317824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259869 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259853.184613:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098317824/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259869 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259853.184637:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1e00. 02000000:00000010:1.0:1734259853.184641:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:1.0:1734259853.184646:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000400:00000010:2.0:1734259853.184718:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:2.0:1734259853.184726:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:2.0:1734259853.184727:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734259853.184732:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098317952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259863 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259853.184737:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098317952/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259863 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259853.184754:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259853.184758:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259853.184760:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:2.0:1734259858.188005:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259858.188029:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259858.188092:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259858.188098:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259858.188137:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259858.188144:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cbb0. 00000400:00000010:2.0:1734259858.188149:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734259858.188155:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098318208, portal 10 00000400:00000010:2.0:1734259858.188161:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734259858.188163:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098318208, offset 0 00000400:00000200:2.0:1734259858.188171:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:0.0:1734259858.188175:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3a600. 00000400:00000200:2.0:1734259858.188185:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:0.0:1734259858.188186:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d508f0. 00000400:00000200:2.0:1734259858.188191:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:0.0:1734259858.188193:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1088. 00000400:00000200:2.0:1734259858.188194:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:0.0:1734259858.188198:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098318080, portal 25 00000400:00000200:2.0:1734259858.188198:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259858.188199:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259858.188202:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1217:1217:256:4294967295] 192.168.202.108@tcp LPNI seq info [1216:1216:8:4294967295] 00000400:00000010:0.0:1734259858.188204:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1ee0. 00000100:00000200:0.0:1734259858.188206:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098318080, offset 0 00000400:00000200:2.0:1734259858.188210:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:0.0:1734259858.188213:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:2.0:1734259858.188215:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259858.188217:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259858.188223:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734259858.188223:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259858.188227:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259858.188230:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259858.188232:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259858.188234:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259858.188237:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1218:1218:255:4294967295] 192.168.202.108@tcp LPNI seq info [1217:1217:7:4294967295] 00000800:00000200:2.0:1734259858.188257:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259858.188260:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734259858.188270:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259858.188275:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259858.188278:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734259858.188282:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259858.188288:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259858.188291:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259858.188350:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259858.188354:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734259858.188360:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259858.188365:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259858.188368:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:1.0:1734259858.188370:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:1.0:1734259858.188378:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098318208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259868 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259858.188444:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259858.188446:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:1.0:1734259858.188449:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259858.188451:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259858.188454:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1ee0 00000400:00000010:1.0:1734259858.188455:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1ee0. 00000100:00000200:1.0:1734259858.188459:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098318080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259874 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259858.190310:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259858.190330:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c625f00 00000400:00000200:0.0:1734259858.190351:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2701 [1] + 224 00000400:00000200:0.0:1734259858.190365:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259858.190369:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259858.190379:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098318080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259874 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259858.190418:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259858.190423:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c625f80 00000400:00000200:0.0:1734259858.190428:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x26f9 [1] + 0 00000400:00000200:0.0:1734259858.190445:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259858.190448:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:2.0:1734259858.190453:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d508f0. 00000400:00000200:2.0:1734259858.190459:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1088 00000400:00000010:2.0:1734259858.190461:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1088. 00000100:00000200:2.0:1734259858.190467:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098318080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259874 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734259858.190468:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098318208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259868 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259858.190474:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098318080/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259874 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259858.190502:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3a600. 02000000:00000010:2.0:1734259858.190509:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259858.190514:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000010:3.0:1734259858.190612:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cbb0. 00000400:00000200:3.0:1734259858.190616:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:3.0:1734259858.190618:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:3.0:1734259858.190622:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098318208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259868 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259858.190628:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098318208/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259868 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259858.190645:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259858.190650:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259858.190652:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000100:00000010:2.0:1734259863.195716:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259863.195752:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259863.195821:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734259863.195830:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734259863.195843:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734259863.195850:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50948. 00000400:00000010:0.0:1734259863.195856:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1000. 00000100:00000200:0.0:1734259863.195863:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098318336, portal 25 02000000:00000010:2.0:1734259863.195864:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:0.0:1734259863.195867:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1330. 00000400:00000010:2.0:1734259863.195868:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cc60. 00000100:00000200:0.0:1734259863.195869:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098318336, offset 0 00000400:00000010:2.0:1734259863.195871:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000400:00000200:0.0:1734259863.195877:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734259863.195882:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098318464, portal 10 00000400:00000010:2.0:1734259863.195886:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000100:00000200:2.0:1734259863.195887:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098318464, offset 0 00000400:00000200:2.0:1734259863.195891:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259863.195892:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259863.195897:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259863.195900:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259863.195903:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259863.195905:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259863.195907:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1219:1219:256:4294967295] 192.168.202.108@tcp LPNI seq info [1218:1218:8:4294967295] 00000400:00000200:0.0:1734259863.195916:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259863.195921:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259863.195921:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259863.195922:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734259863.195924:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000400:00000200:2.0:1734259863.195924:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259863.195926:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259863.195927:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734259863.195929:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259863.195929:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1220:1220:255:4294967295] 192.168.202.108@tcp LPNI seq info [1219:1219:7:4294967295] 00000400:00000200:2.0:1734259863.195933:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259863.195936:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259863.195944:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259863.195946:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259863.195950:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259863.195951:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259863.195953:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259863.195953:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259863.196042:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259863.196045:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734259863.196051:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259863.196056:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259863.196059:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:1.0:1734259863.196060:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:1.0:1734259863.196068:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098318464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259873 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259863.196136:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259863.196138:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734259863.196140:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259863.196143:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259863.196145:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1330 00000400:00000010:1.0:1734259863.196146:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1330. 00000100:00000200:1.0:1734259863.196149:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098318336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259879 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259863.197828:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259863.197844:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626000 00000400:00000200:0.0:1734259863.197852:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2709 [1] + 224 00000400:00000200:0.0:1734259863.197865:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259863.197868:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259863.197879:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098318336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259879 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259863.197917:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259863.197921:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626080 00000400:00000200:0.0:1734259863.197924:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2711 [1] + 0 00000400:00000200:0.0:1734259863.197941:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259863.197944:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259863.197948:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098318464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259873 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259863.197993:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50948. 00000400:00000200:2.0:1734259863.197998:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1000 00000400:00000010:2.0:1734259863.197999:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1000. 00000100:00000200:2.0:1734259863.198004:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098318336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259879 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259863.198011:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098318336/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259879 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259863.198034:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734259863.198039:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259863.198043:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000010:3.0:1734259863.198055:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cc60. 00000400:00000200:3.0:1734259863.198059:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:3.0:1734259863.198060:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:3.0:1734259863.198064:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098318464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259873 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259863.198082:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098318464/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259873 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259863.198100:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259863.198104:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259863.198105:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734259868.203680:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734259868.203699:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259868.203755:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734259868.203762:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259868.203802:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259868.203808:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cc08. 00000400:00000010:2.0:1734259868.203814:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734259868.203820:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098318720, portal 10 00000400:00000010:2.0:1734259868.203825:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734259868.203827:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098318720, offset 0 00000400:00000200:2.0:1734259868.203834:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259868.203846:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:3.0:1734259868.203849:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000200:2.0:1734259868.203850:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259868.203853:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:3.0:1734259868.203854:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000200:2.0:1734259868.203856:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:3.0:1734259868.203857:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000400:00000200:2.0:1734259868.203858:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:3.0:1734259868.203859:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098318592, portal 25 00000400:00000200:2.0:1734259868.203860:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1221:1221:256:4294967295] 192.168.202.108@tcp LPNI seq info [1220:1220:8:4294967295] 00000400:00000010:3.0:1734259868.203862:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734259868.203863:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098318592, offset 0 00000400:00000200:3.0:1734259868.203868:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259868.203956:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259868.203961:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259868.203963:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734259868.203965:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000400:00000200:3.0:1734259868.203965:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259868.203967:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259868.203969:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259868.203970:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259868.203971:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259868.203973:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1222:1222:255:4294967295] 192.168.202.108@tcp LPNI seq info [1221:1221:7:4294967295] 00000800:00000200:2.0:1734259868.203976:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259868.203979:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734259868.203979:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259868.203982:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259868.203985:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734259868.203987:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259868.203991:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259868.203993:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259868.204599:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259868.204603:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259868.204608:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259868.204612:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259868.204615:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734259868.204616:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734259868.204623:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098318720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259878 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259868.204677:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259868.204679:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734259868.204681:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259868.204684:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259868.204686:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:0.0:1734259868.204692:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:0.0:1734259868.204696:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098318592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259884 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259868.207861:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259868.207877:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626100 00000400:00000200:0.0:1734259868.207885:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2721 [1] + 224 00000400:00000200:0.0:1734259868.207897:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259868.207900:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259868.207910:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098318592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259884 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259868.207947:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259868.207952:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626180 00000400:00000200:0.0:1734259868.207955:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2719 [1] + 0 00000400:00000200:0.0:1734259868.207968:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259868.207971:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259868.207975:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098318720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259878 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259868.208062:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:3.0:1734259868.208066:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:3.0:1734259868.208068:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259868.208073:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098318592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259884 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259868.208089:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098318592/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259884 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259868.208108:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259868.208114:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734259868.208117:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000400:00000010:2.0:1734259868.208288:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cc08. 00000400:00000200:2.0:1734259868.208291:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:2.0:1734259868.208292:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734259868.208297:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098318720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259878 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259868.208302:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098318720/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259878 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259868.208319:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259868.208322:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259868.208324:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734259873.211728:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734259873.211754:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259873.211818:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259873.211825:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259873.211871:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0200. 02000000:00000010:2.0:1734259873.211875:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259873.211882:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cc08. 00000400:00000010:1.0:1734259873.211884:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:2.0:1734259873.211889:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000400:00000010:1.0:1734259873.211890:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:2.0:1734259873.211897:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098318976, portal 10 00000100:00000200:1.0:1734259873.211898:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098318848, portal 25 00000400:00000010:1.0:1734259873.211903:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000400:00000010:2.0:1734259873.211904:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:1.0:1734259873.211905:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098318848, offset 0 00000100:00000200:2.0:1734259873.211907:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098318976, offset 0 00000400:00000200:1.0:1734259873.211918:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259873.211930:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259873.211935:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259873.211943:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259873.211947:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259873.211952:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259873.211954:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259873.211958:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1223:1223:256:4294967295] 192.168.202.108@tcp LPNI seq info [1222:1222:8:4294967295] 00000400:00000200:1.0:1734259873.211967:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259873.211991:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259873.211995:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000400:00000200:2.0:1734259873.211999:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734259873.212003:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259873.212005:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259873.212009:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734259873.212013:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259873.212019:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259873.212027:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259873.212029:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259873.212031:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1224:1224:255:4294967295] 192.168.202.108@tcp LPNI seq info [1223:1223:7:4294967295] 00000400:00000200:2.0:1734259873.212038:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259873.212043:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259873.212046:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259873.212052:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259873.212065:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259873.212069:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259873.212115:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259873.212118:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734259873.212126:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259873.212130:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259873.212144:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:0.0:1734259873.212146:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:0.0:1734259873.212156:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098318848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259889 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259873.212224:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259873.212226:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259873.212229:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259873.212231:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259873.212234:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734259873.212240:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000100:00000200:0.0:1734259873.212244:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098318976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259883 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259873.215473:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259873.215494:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626280 00000400:00000200:0.0:1734259873.215503:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2729 [1] + 0 00000400:00000200:0.0:1734259873.215514:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259873.215517:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259873.215528:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098318976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259883 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259873.215601:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259873.215606:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626200 00000400:00000200:0.0:1734259873.215611:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x272d [1] + 224 00000400:00000200:0.0:1734259873.215630:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259873.215633:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259873.215639:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098318848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259889 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259873.215931:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cc08. 00000400:00000200:2.0:1734259873.215937:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:2.0:1734259873.215939:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734259873.215945:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098318976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259883 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259873.215951:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098318976/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259883 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259873.215983:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259873.215988:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259873.215991:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000400:00000010:1.0:1734259873.216061:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259873.216065:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259873.216067:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259873.216071:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098318848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259889 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259873.216076:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098318848/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259889 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259873.216086:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0200. 02000000:00000010:1.0:1734259873.216089:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:1.0:1734259873.216092:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734259878.219713:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259878.219736:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259878.219808:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734259878.219816:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734259878.219854:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259878.219855:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 00000400:00000010:0.0:1734259878.219861:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509a0. 00000400:00000010:2.0:1734259878.219861:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cc08. 00000400:00000010:0.0:1734259878.219868:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000400:00000010:2.0:1734259878.219868:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000100:00000200:2.0:1734259878.219876:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098319232, portal 10 00000100:00000200:0.0:1734259878.219883:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098319104, portal 25 00000400:00000010:0.0:1734259878.219887:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734259878.219889:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098319104, offset 0 00000400:00000200:0.0:1734259878.219898:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259878.219912:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259878.219921:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259878.219925:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259878.219928:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259878.219930:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259878.219944:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1225:1225:256:4294967295] 192.168.202.108@tcp LPNI seq info [1224:1224:8:4294967295] 00000400:00000200:0.0:1734259878.219952:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:2.0:1734259878.219954:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734259878.219957:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098319232, offset 0 00000800:00000200:0.0:1734259878.219958:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259878.219961:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000400:00000200:2.0:1734259878.219962:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259878.219966:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259878.219973:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:0.0:1734259878.219974:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259878.219975:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1734259878.219977:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259878.219977:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259878.219979:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259878.219981:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259878.219983:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1226:1226:255:4294967295] 192.168.202.108@tcp LPNI seq info [1225:1225:7:4294967295] 00000400:00000200:2.0:1734259878.219989:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259878.219992:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259878.219994:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259878.219997:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259878.220001:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259878.220003:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259878.220053:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259878.220057:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:1.0:1734259878.220062:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259878.220067:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259878.220071:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:1.0:1734259878.220072:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:1.0:1734259878.220079:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098319104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259894 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259878.220174:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259878.220176:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:1.0:1734259878.220179:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259878.220181:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259878.220183:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:1.0:1734259878.220185:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:1.0:1734259878.220188:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098319232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259888 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259878.221788:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259878.221803:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626300 00000400:00000200:0.0:1734259878.221810:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x273d [1] + 224 00000400:00000200:0.0:1734259878.221822:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259878.221825:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259878.221836:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098319104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259894 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259878.221876:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259878.221881:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626380 00000400:00000200:0.0:1734259878.221885:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2739 [1] + 0 00000400:00000200:0.0:1734259878.221904:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259878.221907:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259878.221912:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098319232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259888 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259878.221950:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509a0. 00000400:00000200:2.0:1734259878.221956:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:2.0:1734259878.221958:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:2.0:1734259878.221964:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098319104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259894 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259878.221971:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098319104/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259894 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259878.221996:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 02000000:00000010:2.0:1734259878.222002:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259878.222006:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000400:00000010:3.0:1734259878.222060:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cc08. 00000400:00000200:3.0:1734259878.222066:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:3.0:1734259878.222067:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:3.0:1734259878.222072:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098319232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259888 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259878.222078:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098319232/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259888 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259878.222109:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259878.222113:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259878.222115:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734259883.227719:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259883.227747:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 02000000:00000010:3.0:1734259883.228047:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259883.228084:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d68. 00000400:00000010:3.0:1734259883.228092:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734259883.228099:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098319360, portal 25 00000400:00000010:3.0:1734259883.228103:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734259883.228105:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098319360, offset 0 00000400:00000200:3.0:1734259883.228115:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259883.228130:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259883.228135:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259883.228138:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259883.228141:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259883.228143:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259883.228145:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1227:1227:256:4294967295] 192.168.202.108@tcp LPNI seq info [1226:1226:8:4294967295] 00000400:00000200:3.0:1734259883.228154:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259883.228174:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259883.228177:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734259883.228182:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259883.228190:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259883.228194:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:2.0:1734259883.228813:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734259883.228826:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259883.228923:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259883.228930:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259883.228935:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734259883.228939:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098319488, portal 10 00000400:00000010:3.0:1734259883.228945:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734259883.228947:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098319488, offset 0 00000400:00000200:3.0:1734259883.228955:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259883.228965:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734259883.228969:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:3.0:1734259883.228970:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259883.228973:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000010:1.0:1734259883.228976:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:3.0:1734259883.228976:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259883.228978:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259883.228980:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734259883.228980:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1228:1228:255:4294967295] 192.168.202.108@tcp LPNI seq info [1227:1227:7:4294967295] 00000400:00000200:1.0:1734259883.228986:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734259883.228988:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734259883.228990:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:1.0:1734259883.228992:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000800:00000200:3.0:1734259883.228993:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259883.228996:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000100:00000200:1.0:1734259883.228998:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098319360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259899 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734259883.229001:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259883.229008:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259883.229010:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259883.229031:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259883.229033:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:1.0:1734259883.229035:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259883.229038:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259883.229040:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:1.0:1734259883.229041:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:1.0:1734259883.229045:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098319488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259893 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259883.234987:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259883.235006:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626480 00000400:00000200:0.0:1734259883.235015:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2751 [1] + 0 00000400:00000200:0.0:1734259883.235026:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259883.235029:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259883.235039:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098319488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259883.235099:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259883.235103:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626400 00000400:00000200:0.0:1734259883.235107:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2749 [1] + 224 00000400:00000200:0.0:1734259883.235117:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259883.235119:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259883.235123:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098319360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259899 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259883.235287:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:3.0:1734259883.235292:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:3.0:1734259883.235294:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734259883.235299:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098319488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259893 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259883.235306:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098319488/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259893 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259883.235338:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259883.235342:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259883.235347:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000010:2.0:1734259883.235348:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d68. 00000400:00000200:2.0:1734259883.235357:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:2.0:1734259883.235359:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:2.0:1734259883.235368:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098319360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259899 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259883.235391:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098319360/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259899 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259883.235411:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:2.0:1734259883.235418:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259883.235422:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000100:00000010:2.0:1734259888.235758:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259888.235781:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 02000000:00000010:3.0:1734259888.235905:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734259888.235912:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16d10. 00000400:00000010:3.0:1734259888.235918:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734259888.235923:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098319616, portal 25 00000400:00000010:3.0:1734259888.235927:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734259888.235929:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098319616, offset 0 00000400:00000200:3.0:1734259888.235937:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259888.235949:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259888.235954:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259888.235958:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259888.235960:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259888.235962:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259888.235965:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1229:1229:256:4294967295] 192.168.202.108@tcp LPNI seq info [1228:1228:8:4294967295] 00000400:00000200:3.0:1734259888.235972:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259888.235983:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259888.235986:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734259888.235990:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259888.235997:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259888.236001:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:2.0:1734259888.236054:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259888.236062:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734259888.236087:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259888.236090:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734259888.236093:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259888.236121:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098319744, portal 10 00000400:00000010:3.0:1734259888.236129:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734259888.236131:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098319744, offset 0 00000400:00000200:3.0:1734259888.236135:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259888.236151:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259888.236153:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259888.236155:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259888.236157:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259888.236158:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259888.236160:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1230:1230:255:4294967295] 192.168.202.108@tcp LPNI seq info [1229:1229:7:4294967295] 00000400:00000200:3.0:1734259888.236165:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259888.236168:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259888.236170:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734259888.236172:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259888.236175:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259888.236177:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259888.236193:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259888.236196:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734259888.236200:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259888.236204:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259888.236208:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734259888.236209:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734259888.236216:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098319616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259904 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259888.236288:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259888.236290:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734259888.236292:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259888.236294:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259888.236296:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734259888.236297:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734259888.236300:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098319744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259898 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259888.238621:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259888.238639:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626580 00000400:00000200:0.0:1734259888.238646:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2761 [1] + 0 00000400:00000200:0.0:1734259888.238657:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259888.238660:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259888.238670:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098319744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259898 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259888.238727:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259888.238732:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626500 00000400:00000200:0.0:1734259888.238736:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2759 [1] + 224 00000400:00000200:0.0:1734259888.238749:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259888.238752:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259888.238756:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098319616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259904 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259888.238810:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259888.238815:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259888.238817:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259888.238823:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098319744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259898 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259888.238828:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098319744/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259898 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259888.238848:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16d10. 00000400:00000200:2.0:1734259888.238851:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:2.0:1734259888.238852:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:2.0:1734259888.238856:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098319616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259904 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259888.238858:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 00000100:00000200:2.0:1734259888.238860:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098319616/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259904 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259888.238862:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734259888.238866:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734259888.238870:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:2.0:1734259888.238874:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259888.238876:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000100:00000010:2.0:1734259893.243746:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734259893.243765:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259893.243815:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734259893.243822:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734259893.243844:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 02000000:00000010:3.0:1734259893.243846:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:1.0:1734259893.243850:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:3.0:1734259893.243850:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:1.0:1734259893.243856:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734259893.243856:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734259893.243862:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098319872, portal 25 00000400:00000010:1.0:1734259893.243865:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:3.0:1734259893.243865:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098320000, portal 10 00000100:00000200:1.0:1734259893.243867:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098319872, offset 0 00000400:00000010:3.0:1734259893.243869:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000400:00000200:1.0:1734259893.243874:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734259893.243877:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098320000, offset 0 00000400:00000200:3.0:1734259893.243882:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259893.243885:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259893.243890:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259893.243893:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259893.243896:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259893.243898:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259893.243900:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1231:1231:256:4294967295] 192.168.202.108@tcp LPNI seq info [1230:1230:8:4294967295] 00000400:00000200:1.0:1734259893.243907:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259893.243922:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259893.243922:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259893.243924:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734259893.243929:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259893.243935:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259893.243936:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734259893.243938:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734259893.243938:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259893.243939:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259893.243941:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259893.243943:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1232:1232:255:4294967295] 192.168.202.108@tcp LPNI seq info [1231:1231:7:4294967295] 00000400:00000200:3.0:1734259893.243949:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259893.243952:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259893.243955:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734259893.243957:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259893.243960:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259893.243962:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259893.244018:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259893.244021:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734259893.244026:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259893.244030:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259893.244033:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:0.0:1734259893.244035:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:0.0:1734259893.244041:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098319872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259909 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259893.244098:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259893.244100:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734259893.244102:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259893.244105:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259893.244107:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734259893.244108:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734259893.244111:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098320000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259903 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259893.245674:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259893.245690:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626600 00000400:00000200:0.0:1734259893.245698:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2769 [1] + 224 00000400:00000200:0.0:1734259893.245707:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259893.245711:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259893.245719:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098319872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259909 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259893.245776:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259893.245780:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626680 00000400:00000200:0.0:1734259893.245785:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x276d [1] + 0 00000400:00000200:0.0:1734259893.245800:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259893.245803:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259893.245808:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098320000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259903 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259893.245909:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259893.245913:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259893.245915:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259893.245920:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098319872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259909 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259893.245925:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098319872/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259909 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259893.245943:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734259893.245948:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:1.0:1734259893.245951:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000400:00000010:3.0:1734259893.245981:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259893.245985:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259893.246000:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259893.246004:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098320000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259903 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259893.246010:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098320000/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259903 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259893.246025:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259893.246028:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734259893.246031:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:2.0:1734259898.251739:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734259898.251770:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259898.251842:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734259898.251850:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259898.252126:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734259898.252142:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259898.252150:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259898.252157:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098320128, portal 25 00000400:00000010:1.0:1734259898.252162:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734259898.252164:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098320128, offset 0 00000400:00000200:1.0:1734259898.252172:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259898.252187:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259898.252192:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259898.252196:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259898.252200:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259898.252202:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259898.252205:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1233:1233:256:4294967295] 192.168.202.108@tcp LPNI seq info [1232:1232:8:4294967295] 00000400:00000200:1.0:1734259898.252215:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259898.252221:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259898.252241:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734259898.252247:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259898.252256:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259898.252260:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259898.252387:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259898.252390:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734259898.252393:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259898.252398:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259898.252402:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734259898.252404:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734259898.252411:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098320128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259914 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259898.252436:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259898.252442:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734259898.252446:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259898.252453:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098320256, portal 10 00000400:00000010:3.0:1734259898.252458:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734259898.252459:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098320256, offset 0 00000400:00000200:3.0:1734259898.252464:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259898.252469:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259898.252471:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259898.252480:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259898.252481:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259898.252483:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259898.252485:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1234:1234:256:4294967295] 192.168.202.108@tcp LPNI seq info [1233:1233:8:4294967295] 00000400:00000200:3.0:1734259898.252490:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259898.252493:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259898.252495:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734259898.252498:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259898.252502:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259898.252504:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259898.252636:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259898.252638:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734259898.252640:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259898.252644:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259898.252646:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734259898.252647:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734259898.252658:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098320256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259908 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259898.254292:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259898.254310:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626700 00000400:00000200:0.0:1734259898.254318:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2779 [1] + 224 00000400:00000200:0.0:1734259898.254329:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259898.254332:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259898.254340:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098320128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259914 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259898.254386:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259898.254390:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626780 00000400:00000200:0.0:1734259898.254395:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2781 [1] + 0 00000400:00000200:0.0:1734259898.254405:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259898.254407:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259898.254413:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098320256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259908 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259898.254421:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259898.254426:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259898.254427:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259898.254441:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098320128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259914 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259898.254449:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098320128/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259914 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259898.254611:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259898.254615:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259898.254617:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259898.254621:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098320256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259908 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259898.254627:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098320256/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259908 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259898.254652:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259898.254657:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259898.254662:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 02000000:00000010:1.0:1734259898.254704:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734259898.254709:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:1.0:1734259898.254711:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734259903.259864:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734259903.259891:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259903.259968:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259903.259993:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259903.260002:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1800. 00000400:00000010:1.0:1734259903.260011:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259903.260018:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259903.260028:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098320384, portal 25 00000400:00000010:1.0:1734259903.260036:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734259903.260038:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098320384, offset 0 00000400:00000200:1.0:1734259903.260050:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259903.260070:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259903.260077:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259903.260081:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259903.260085:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259903.260088:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259903.260091:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1235:1235:256:4294967295] 192.168.202.108@tcp LPNI seq info [1234:1234:8:4294967295] 00000400:00000200:1.0:1734259903.260101:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259903.260105:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259903.260109:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734259903.260122:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259903.260132:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259903.260136:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:3.0:1734259903.260144:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259903.260150:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734259903.260153:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259903.260156:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098320512, portal 10 00000400:00000010:3.0:1734259903.260162:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734259903.260164:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098320512, offset 0 00000400:00000200:3.0:1734259903.260168:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259903.260173:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259903.260177:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259903.260179:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259903.260187:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259903.260188:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259903.260190:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1236:1236:255:4294967295] 192.168.202.108@tcp LPNI seq info [1235:1235:7:4294967295] 00000400:00000200:3.0:1734259903.260196:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259903.260199:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259903.260202:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734259903.260205:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259903.260208:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259903.260211:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259903.260229:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259903.260233:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734259903.260239:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259903.260243:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259903.260248:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734259903.260250:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734259903.260259:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098320384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259919 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259903.260387:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259903.260390:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734259903.260392:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259903.260396:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259903.260398:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734259903.260400:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734259903.260403:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098320512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259913 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259903.261994:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259903.262014:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626800 00000400:00000200:0.0:1734259903.262023:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2789 [1] + 224 00000400:00000200:0.0:1734259903.262039:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259903.262052:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259903.262063:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098320384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259919 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259903.262134:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259903.262141:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626880 00000400:00000200:0.0:1734259903.262147:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2791 [1] + 0 00000400:00000010:1.0:1734259903.262159:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259903.262164:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000200:0.0:1734259903.262165:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:1.0:1734259903.262166:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000400:00000200:0.0:1734259903.262170:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:1.0:1734259903.262170:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098320384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259919 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734259903.262176:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098320512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259913 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259903.262178:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098320384/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259919 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259903.262198:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1800. 02000000:00000010:1.0:1734259903.262203:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:1.0:1734259903.262206:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:3.0:1734259903.262244:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259903.262248:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259903.262249:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259903.262254:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098320512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259913 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259903.262260:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098320512/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259913 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259903.262275:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259903.262278:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259903.262286:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:2.0:1734259908.267717:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259908.267741:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259908.267804:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259908.267811:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259908.267835:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3be00. 00000400:00000010:0.0:1734259908.267844:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d509f8. 00000400:00000010:0.0:1734259908.267851:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000100:00000200:0.0:1734259908.267859:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098320640, portal 25 00000400:00000010:0.0:1734259908.267863:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000100:00000200:0.0:1734259908.267865:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098320640, offset 0 00000400:00000200:0.0:1734259908.267906:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259908.267923:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:3.0:1734259908.267925:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000200:0.0:1734259908.267929:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259908.267932:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259908.267935:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259908.267937:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:3.0:1734259908.267938:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:0.0:1734259908.267940:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1237:1237:256:4294967295] 192.168.202.108@tcp LPNI seq info [1236:1236:8:4294967295] 00000400:00000010:3.0:1734259908.267945:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000200:0.0:1734259908.267949:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:3.0:1734259908.267953:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098320768, portal 10 00000800:00000200:0.0:1734259908.267955:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259908.267959:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000400:00000010:3.0:1734259908.267961:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734259908.267963:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098320768, offset 0 00000400:00000200:3.0:1734259908.267972:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259908.267985:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259908.267990:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259908.267994:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259908.267997:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259908.268011:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259908.268015:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1238:1238:255:4294967295] 192.168.202.108@tcp LPNI seq info [1237:1237:7:4294967295] 00000400:00000200:3.0:1734259908.268024:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259908.268030:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259908.268034:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734259908.268040:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259908.268049:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259908.268052:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259908.268059:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259908.268067:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259908.268070:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259908.268153:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259908.268156:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:1.0:1734259908.268160:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259908.268164:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259908.268168:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:1.0:1734259908.268170:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:1.0:1734259908.268176:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098320768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259918 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259908.268242:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259908.268244:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734259908.268671:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259908.268675:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259908.268677:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:1.0:1734259908.268678:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:1.0:1734259908.268683:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098320640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259924 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259908.270091:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259908.270108:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626980 00000400:00000200:0.0:1734259908.270130:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x27a1 [1] + 0 00000400:00000200:0.0:1734259908.270144:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259908.270148:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259908.270157:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098320768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259918 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259908.270195:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259908.270201:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626900 00000400:00000200:0.0:1734259908.270205:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2799 [1] + 224 00000400:00000200:0.0:1734259908.270219:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259908.270222:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259908.270227:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098320640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259924 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259908.270258:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259908.270269:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259908.270271:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259908.270281:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098320768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259918 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259908.270291:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098320768/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259918 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259908.270301:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d509f8. 00000400:00000200:1.0:1734259908.270306:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:1.0:1734259908.270308:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 00000100:00000200:1.0:1734259908.270318:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098320640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259924 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259908.270325:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098320640/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259924 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259908.270329:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259908.270337:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734259908.270342:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3be00. 00000100:00000010:3.0:1734259908.270342:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 02000000:00000010:1.0:1734259908.270348:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:1.0:1734259908.270351:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734259913.275789:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259913.275808:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734259913.275896:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259913.275905:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734259913.275951:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734259913.275957:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259913.275963:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259913.275969:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098320896, portal 25 00000400:00000010:1.0:1734259913.275973:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734259913.275975:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098320896, offset 0 00000400:00000200:1.0:1734259913.275983:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259913.275994:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259913.275999:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259913.276003:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259913.276005:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259913.276007:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259913.276010:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1239:1239:256:4294967295] 192.168.202.108@tcp LPNI seq info [1238:1238:8:4294967295] 00000400:00000200:1.0:1734259913.276016:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259913.276020:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259913.276023:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734259913.276028:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259913.276034:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259913.276037:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259913.276387:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259913.276390:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:1.0:1734259913.276393:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259913.276396:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259913.276400:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:1.0:1734259913.276409:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734259913.276416:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098320896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259929 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259913.276478:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259913.276483:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734259913.276486:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259913.276488:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098321024, portal 10 00000400:00000010:3.0:1734259913.276492:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734259913.276494:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098321024, offset 0 00000400:00000200:3.0:1734259913.276498:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259913.276503:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259913.276505:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259913.276507:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259913.276509:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259913.276510:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259913.276517:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1240:1240:256:4294967295] 192.168.202.108@tcp LPNI seq info [1239:1239:8:4294967295] 00000400:00000200:3.0:1734259913.276523:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259913.276527:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259913.276529:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734259913.276532:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259913.276536:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259913.276538:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259913.276796:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259913.276798:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:1.0:1734259913.276802:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259913.276806:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259913.276808:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:1.0:1734259913.276809:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:1.0:1734259913.276813:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098321024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259923 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259913.277611:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259913.277623:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626a00 00000400:00000200:0.0:1734259913.277630:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x27a9 [1] + 224 00000400:00000200:0.0:1734259913.277645:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259913.277649:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259913.277655:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098320896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259929 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259913.277713:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259913.277717:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259913.277718:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259913.277723:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098320896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259929 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259913.277732:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098320896/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259929 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259913.277748:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734259913.277752:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734259913.277755:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000400:00000200:0.0:1734259913.278055:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259913.278062:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626a80 00000400:00000200:0.0:1734259913.278066:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x27b1 [1] + 0 00000400:00000200:0.0:1734259913.278076:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259913.278079:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259913.278085:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098321024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259923 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259913.278148:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259913.278223:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259913.278225:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259913.278230:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098321024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259923 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259913.278237:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098321024/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259923 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259913.278253:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259913.278256:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734259913.278260:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734259918.283719:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b800. 02000000:00000010:2.0:1734259918.283742:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734259918.283848:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259918.283857:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259918.283891:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734259918.283899:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734259918.283905:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259918.283910:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098321152, portal 25 00000400:00000010:3.0:1734259918.283915:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000100:00000200:3.0:1734259918.283916:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098321152, offset 0 02000000:00000010:2.0:1734259918.283919:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259918.283925:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000200:3.0:1734259918.283928:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259918.283939:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734259918.283940:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000400:00000200:3.0:1734259918.283943:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:2.0:1734259918.283944:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098321280, portal 10 00000400:00000200:3.0:1734259918.283947:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:2.0:1734259918.283949:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000400:00000200:3.0:1734259918.283950:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:2.0:1734259918.283951:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098321280, offset 0 00000400:00000200:3.0:1734259918.283952:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259918.283955:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1241:1241:256:4294967295] 192.168.202.108@tcp LPNI seq info [1240:1240:8:4294967295] 00000400:00000200:2.0:1734259918.283956:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259918.283972:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259918.283978:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259918.283980:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259918.283981:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000400:00000200:2.0:1734259918.283984:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259918.283986:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734259918.283986:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259918.283989:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259918.283991:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259918.283993:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1242:1242:255:4294967295] 192.168.202.108@tcp LPNI seq info [1241:1241:7:4294967295] 00000800:00000200:3.0:1734259918.283993:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259918.283995:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259918.284000:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259918.284004:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259918.284007:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734259918.284010:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259918.284023:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259918.284026:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259918.284112:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259918.284116:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734259918.284120:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259918.284124:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259918.284128:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:1.0:1734259918.284129:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:1.0:1734259918.284136:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b800 x1818500098321152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259934 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259918.284197:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259918.284199:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734259918.284202:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259918.284217:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259918.284219:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:1.0:1734259918.284220:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:1.0:1734259918.284224:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098321280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259928 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259918.285791:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259918.285825:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626b00 00000400:00000200:0.0:1734259918.285832:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x27b9 [1] + 224 00000400:00000200:0.0:1734259918.285842:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259918.285844:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259918.285852:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b800 x1818500098321152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259934 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259918.285887:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259918.285891:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626b80 00000400:00000200:0.0:1734259918.285895:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x27c1 [1] + 0 00000400:00000200:0.0:1734259918.285903:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259918.285905:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259918.285907:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098321280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259928 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259918.285913:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259918.285917:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259918.285919:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259918.285928:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b800 x1818500098321152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259934 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259918.285935:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b800 x1818500098321152/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259934 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259918.285954:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734259918.285959:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734259918.285962:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b800. 00000400:00000010:2.0:1734259918.285966:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:2.0:1734259918.285969:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259918.285970:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259918.285973:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098321280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259928 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259918.285977:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098321280/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259928 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259918.285989:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259918.285991:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259918.285993:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000100:00000010:2.0:1734259923.291716:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b480. 02000000:00000010:2.0:1734259923.291755:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734259923.291849:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259923.291856:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734259923.291869:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259923.291878:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:2.0:1734259923.291880:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259923.291884:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:3.0:1734259923.291886:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:2.0:1734259923.291893:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:3.0:1734259923.291893:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098321408, portal 25 00000100:00000200:2.0:1734259923.291896:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098321536, portal 10 00000400:00000010:3.0:1734259923.291897:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734259923.291899:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098321408, offset 0 00000400:00000010:2.0:1734259923.291900:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734259923.291902:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098321536, offset 0 00000400:00000200:3.0:1734259923.291909:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259923.291918:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259923.291923:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259923.291929:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259923.291933:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259923.291936:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259923.291938:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259923.291942:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1243:1243:256:4294967295] 192.168.202.108@tcp LPNI seq info [1242:1242:8:4294967295] 00000400:00000200:3.0:1734259923.291950:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259923.291971:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259923.291972:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259923.291974:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734259923.291974:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000400:00000200:2.0:1734259923.291977:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259923.291978:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259923.291980:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734259923.291980:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259923.291983:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1244:1244:255:4294967295] 192.168.202.108@tcp LPNI seq info [1243:1243:7:4294967295] 00000400:00000200:2.0:1734259923.291989:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259923.291989:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259923.291993:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259923.292006:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259923.292009:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259923.292012:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259923.292015:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259923.292017:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259923.292115:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259923.292121:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734259923.292128:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259923.292135:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259923.292139:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734259923.292141:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734259923.292150:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b480 x1818500098321408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259939 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259923.292209:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259923.292212:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259923.292214:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259923.292217:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259923.292220:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734259923.292221:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734259923.292225:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098321536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259933 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259923.293387:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259923.293410:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626c00 00000400:00000200:0.0:1734259923.293416:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x27c9 [1] + 224 00000400:00000200:0.0:1734259923.293430:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259923.293433:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259923.293439:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b480 x1818500098321408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259939 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259923.293468:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259923.293472:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626c80 00000400:00000200:0.0:1734259923.293476:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x27cd [1] + 0 00000400:00000200:0.0:1734259923.293487:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259923.293490:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259923.293494:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098321536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259933 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259923.293510:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259923.293515:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259923.293516:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259923.293521:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b480 x1818500098321408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259939 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259923.293528:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b480 x1818500098321408/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259939 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259923.293548:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259923.293553:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000400:00000010:2.0:1734259923.293556:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000100:00000010:3.0:1734259923.293556:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b480. 00000400:00000200:2.0:1734259923.293560:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:2.0:1734259923.293562:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259923.293566:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098321536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259933 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259923.293592:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098321536/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259933 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259923.293608:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259923.293612:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734259923.293618:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:2.0:1734259928.299700:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734259928.299720:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734259928.299802:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734259928.299809:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734259928.299850:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1200. 00000400:00000010:1.0:1734259928.299858:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259928.299864:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259928.299870:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098321664, portal 25 00000400:00000010:1.0:1734259928.299873:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734259928.299875:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098321664, offset 0 00000400:00000200:1.0:1734259928.299883:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:3.0:1734259928.299892:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000200:1.0:1734259928.299894:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:3.0:1734259928.299897:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:1.0:1734259928.299899:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734259928.299900:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000200:1.0:1734259928.299902:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000100:00000200:3.0:1734259928.299902:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098321792, portal 10 00000400:00000200:1.0:1734259928.299905:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:3.0:1734259928.299906:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000400:00000200:1.0:1734259928.299907:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000100:00000200:3.0:1734259928.299908:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098321792, offset 0 00000400:00000200:1.0:1734259928.299909:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1245:1245:256:4294967295] 192.168.202.108@tcp LPNI seq info [1244:1244:8:4294967295] 00000400:00000200:3.0:1734259928.299912:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259928.299917:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259928.299921:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259928.299923:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259928.299925:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000400:00000200:3.0:1734259928.299925:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259928.299927:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259928.299929:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734259928.299930:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259928.299931:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259928.299933:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1246:1246:255:4294967295] 192.168.202.108@tcp LPNI seq info [1245:1245:7:4294967295] 00000800:00000200:1.0:1734259928.299937:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259928.299939:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259928.299940:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734259928.299942:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259928.299955:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734259928.299958:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259928.299961:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259928.299963:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259928.300031:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259928.300034:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734259928.300038:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259928.300042:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259928.300046:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:0.0:1734259928.300048:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:0.0:1734259928.300054:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098321664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259944 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259928.300117:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259928.300119:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734259928.300121:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259928.300124:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259928.300126:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734259928.300127:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734259928.300130:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098321792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259938 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259928.301705:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259928.301725:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626d00 00000400:00000200:0.0:1734259928.301743:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x27d9 [1] + 224 00000400:00000200:0.0:1734259928.301754:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259928.301756:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259928.301763:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098321664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259944 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259928.301789:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259928.301793:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626d80 00000400:00000200:0.0:1734259928.301797:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x27e1 [1] + 0 00000400:00000200:0.0:1734259928.301809:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259928.301811:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259928.301815:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098321792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259938 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259928.301820:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259928.301824:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259928.301825:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259928.301830:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098321664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259944 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259928.301836:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098321664/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259944 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259928.301864:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1200. 02000000:00000010:1.0:1734259928.301868:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:1.0:1734259928.301871:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000400:00000010:3.0:1734259928.301877:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259928.301882:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259928.301883:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259928.301888:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098321792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259938 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259928.301895:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098321792/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259938 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259928.301912:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259928.301915:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734259928.301918:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:2.0:1734259933.307901:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734259933.307917:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734259933.307959:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734259933.307963:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734259933.308018:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734259933.308025:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d505d8. 00000400:00000010:0.0:1734259933.308031:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734259933.308037:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098321920, portal 25 00000400:00000010:0.0:1734259933.308040:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734259933.308042:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098321920, offset 0 00000400:00000200:0.0:1734259933.308049:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259933.308060:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259933.308065:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259933.308068:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259933.308071:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259933.308073:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259933.308076:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1247:1247:256:4294967295] 192.168.202.108@tcp LPNI seq info [1246:1246:8:4294967295] 00000400:00000200:0.0:1734259933.308083:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259933.308088:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259933.308091:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 02000000:00000010:3.0:1734259933.308098:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259933.308101:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734259933.308103:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000800:00000200:0.0:1734259933.308104:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:3.0:1734259933.308105:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098322048, portal 10 00000400:00000010:3.0:1734259933.308108:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734259933.308109:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098322048, offset 0 00000800:00000200:0.0:1734259933.308111:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259933.308112:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259933.308114:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734259933.308116:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259933.308118:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259933.308119:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259933.308120:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259933.308122:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259933.308124:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1248:1248:255:4294967295] 192.168.202.108@tcp LPNI seq info [1247:1247:7:4294967295] 00000400:00000200:3.0:1734259933.308129:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259933.308132:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259933.308135:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734259933.308143:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259933.308146:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259933.308148:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259933.308207:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259933.308210:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734259933.308214:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259933.308217:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259933.308221:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:1.0:1734259933.308222:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:1.0:1734259933.308228:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098321920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259949 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259933.308287:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259933.308289:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:1.0:1734259933.308291:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259933.308294:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259933.308296:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:1.0:1734259933.308297:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:1.0:1734259933.308301:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098322048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259943 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259933.310494:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259933.310509:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626e00 00000400:00000200:0.0:1734259933.310516:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x27e9 [1] + 224 00000400:00000200:0.0:1734259933.310526:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259933.310529:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259933.310536:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098321920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259949 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259933.310597:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259933.310602:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626e80 00000400:00000200:0.0:1734259933.310607:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x27f1 [1] + 0 00000400:00000200:0.0:1734259933.310620:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259933.310623:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259933.310628:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098322048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259943 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259933.310839:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d505d8. 00000400:00000200:2.0:1734259933.310843:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:2.0:1734259933.310845:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:2.0:1734259933.310849:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098321920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259949 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259933.310855:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098321920/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259949 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259933.310876:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259933.310878:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259933.310879:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 02000000:00000010:2.0:1734259933.310883:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 00000100:00000200:3.0:1734259933.310883:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098322048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259943 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259933.310887:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000200:3.0:1734259933.310888:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098322048/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259943 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734259933.310890:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 02000000:00000010:3.0:1734259933.310901:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259933.310903:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734259933.310907:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:0.0:1734259938.315727:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734259938.315742:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734259938.315791:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734259938.315797:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734259938.315823:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259938.315829:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:0.0:1734259938.315830:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:0.0:1734259938.315834:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50580. 00000400:00000010:3.0:1734259938.315835:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:0.0:1734259938.315990:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:0.0:1734259938.316035:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098322304, portal 10 00000100:00000200:3.0:1734259938.316035:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098322176, portal 25 00000400:00000010:3.0:1734259938.316040:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000010:0.0:1734259938.316042:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000100:00000200:0.0:1734259938.316043:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098322304, offset 0 00000100:00000200:3.0:1734259938.316043:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098322176, offset 0 00000400:00000200:3.0:1734259938.316050:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259938.316055:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259938.316060:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259938.316066:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259938.316069:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259938.316072:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259938.316074:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259938.316076:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1249:1249:256:4294967295] 192.168.202.108@tcp LPNI seq info [1248:1248:8:4294967295] 00000400:00000200:3.0:1734259938.316083:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259938.316087:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259938.316088:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259938.316090:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000800:00000200:3.0:1734259938.316094:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259938.316097:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259938.316100:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259938.316102:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259938.316104:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259938.316106:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1250:1250:255:4294967295] 192.168.202.108@tcp LPNI seq info [1249:1249:7:4294967295] 00000800:00000200:3.0:1734259938.316106:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259938.316109:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734259938.316112:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259938.316116:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259938.316118:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734259938.316121:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259938.316125:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259938.316127:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259938.316199:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259938.316202:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:1.0:1734259938.316205:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259938.316208:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259938.316212:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:1.0:1734259938.316213:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:1.0:1734259938.316219:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098322176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259954 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259938.316278:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259938.316280:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734259938.316282:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259938.316285:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259938.316291:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:1.0:1734259938.316292:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:1.0:1734259938.316296:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098322304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259948 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259938.318277:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259938.318292:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c626f00 00000400:00000200:0.0:1734259938.318300:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x27f9 [1] + 224 00000400:00000200:0.0:1734259938.318311:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259938.318314:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259938.318322:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098322176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259954 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259938.318441:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259938.318446:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c626f80 00000400:00000200:0.0:1734259938.318451:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x27fd [1] + 0 00000400:00000200:0.0:1734259938.318464:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259938.318467:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259938.318471:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098322304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259948 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259938.318543:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259938.318547:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259938.318548:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259938.318552:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098322176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259954 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259938.318559:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098322176/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259954 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259938.318605:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259938.318611:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734259938.318614:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:1.0:1734259938.318706:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50580. 00000400:00000200:1.0:1734259938.318709:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000400:00000010:1.0:1734259938.318711:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:1.0:1734259938.318714:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098322304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259948 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259938.318720:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098322304/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259948 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259938.318733:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 02000000:00000010:1.0:1734259938.318736:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734259938.318738:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734259943.323839:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734259943.323857:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734259943.323907:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:3.0:1734259943.323921:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 02000000:00000010:0.0:1734259943.323926:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 00000400:00000010:3.0:1734259943.323926:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734259943.323931:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259943.323936:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098322432, portal 25 00000400:00000010:3.0:1734259943.323938:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734259943.323939:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098322432, offset 0 00000400:00000200:3.0:1734259943.323945:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259943.323954:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259943.323957:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259943.323960:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259943.323962:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259943.323963:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259943.323965:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1251:1251:256:4294967295] 192.168.202.108@tcp LPNI seq info [1250:1250:8:4294967295] 00000400:00000200:3.0:1734259943.323970:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259943.323974:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259943.323976:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734259943.323979:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259943.323984:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259943.323990:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734259943.324011:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734259943.324015:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259943.324018:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259943.324021:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098322560, portal 10 00000400:00000010:1.0:1734259943.324034:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734259943.324035:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098322560, offset 0 00000400:00000200:1.0:1734259943.324040:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259943.324045:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259943.324050:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259943.324052:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259943.324054:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259943.324055:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259943.324057:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1252:1252:255:4294967295] 192.168.202.108@tcp LPNI seq info [1251:1251:7:4294967295] 00000400:00000200:1.0:1734259943.324063:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259943.324066:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259943.324068:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734259943.324075:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259943.324079:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259943.324081:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259943.324102:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259943.324105:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734259943.324108:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259943.324111:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259943.324114:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734259943.324116:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734259943.324122:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098322432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259959 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259943.324147:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259943.324148:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734259943.324150:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259943.324153:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259943.324154:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:0.0:1734259943.324156:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:0.0:1734259943.324158:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098322560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259953 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259943.325564:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259943.325593:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627000 00000400:00000200:0.0:1734259943.325599:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2809 [1] + 224 00000400:00000200:0.0:1734259943.325615:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259943.325630:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259943.325638:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098322432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259959 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259943.325689:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259943.325693:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259943.325694:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259943.325698:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098322432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259959 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259943.325704:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098322432/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259959 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259943.325721:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259943.325726:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734259943.325729:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734259943.326124:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259943.326130:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627080 00000400:00000200:0.0:1734259943.326134:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2811 [1] + 0 00000400:00000200:0.0:1734259943.326144:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259943.326147:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259943.326150:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098322560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259953 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259943.326228:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259943.326231:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259943.326232:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259943.326236:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098322560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259953 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259943.326242:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098322560/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259953 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259943.326256:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734259943.326259:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734259943.326261:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734259948.331685:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734259948.331704:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734259948.331750:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734259948.331757:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:0.0:1734259948.331790:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734259948.331792:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:0.0:1734259948.331795:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50528. 00000400:00000010:1.0:1734259948.331796:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:0.0:1734259948.331800:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000400:00000010:1.0:1734259948.331800:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259948.331804:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098322688, portal 25 00000100:00000200:0.0:1734259948.331805:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098322816, portal 10 00000400:00000010:1.0:1734259948.331807:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734259948.331808:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098322688, offset 0 00000400:00000010:0.0:1734259948.331809:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000100:00000200:0.0:1734259948.331810:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098322816, offset 0 00000400:00000200:1.0:1734259948.331815:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259948.331823:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259948.331825:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259948.331829:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259948.331832:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259948.331835:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259948.331836:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259948.331839:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1253:1253:256:4294967295] 192.168.202.108@tcp LPNI seq info [1252:1252:8:4294967295] 00000400:00000200:1.0:1734259948.331846:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259948.331850:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259948.331851:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734259948.331853:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734259948.331854:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259948.331856:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259948.331858:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734259948.331858:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259948.331859:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259948.331862:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1254:1254:255:4294967295] 192.168.202.108@tcp LPNI seq info [1253:1253:7:4294967295] 00000400:00000200:0.0:1734259948.331867:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259948.331871:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259948.331873:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734259948.331875:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259948.331879:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259948.331879:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259948.331882:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259948.331882:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734259948.331969:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259948.331975:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:2.0:1734259948.331982:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259948.331989:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259948.331994:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:2.0:1734259948.331996:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:2.0:1734259948.332005:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098322816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259958 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259948.332073:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734259948.332075:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:2.0:1734259948.332077:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734259948.332081:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259948.332083:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:2.0:1734259948.332084:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:2.0:1734259948.332088:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098322688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259964 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259948.333405:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259948.333416:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627100 00000400:00000200:0.0:1734259948.333422:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2819 [1] + 224 00000400:00000200:0.0:1734259948.333431:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259948.333434:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259948.333450:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098322688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259964 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259948.333483:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259948.333488:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627180 00000400:00000200:0.0:1734259948.333491:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x281d [1] + 0 00000400:00000200:0.0:1734259948.333501:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259948.333504:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:1.0:1734259948.333505:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259948.333509:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259948.333510:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259948.333514:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098322688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259964 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734259948.333515:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098322816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259958 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259948.333519:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098322688/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259964 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259948.333534:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734259948.333538:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:1.0:1734259948.333541:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:2.0:1734259948.333621:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50528. 00000400:00000200:2.0:1734259948.333628:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:2.0:1734259948.333630:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:2.0:1734259948.333636:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098322816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259958 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259948.333644:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098322816/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259958 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259948.333669:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734259948.333674:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734259948.333677:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734259953.339676:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734259953.339696:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734259953.339752:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734259953.339758:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734259953.339855:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734259953.339862:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259953.339869:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259953.339875:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098322944, portal 25 00000400:00000010:1.0:1734259953.339878:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734259953.339880:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098322944, offset 0 00000400:00000200:1.0:1734259953.339887:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259953.339899:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259953.339903:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259953.339907:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 02000000:00000010:3.0:1734259953.339908:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000200:1.0:1734259953.339910:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259953.339912:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:3.0:1734259953.339913:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:1.0:1734259953.339915:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1255:1255:256:4294967295] 192.168.202.108@tcp LPNI seq info [1254:1254:8:4294967295] 00000400:00000010:3.0:1734259953.339916:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259953.339919:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098323072, portal 10 00000400:00000200:1.0:1734259953.339922:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:3.0:1734259953.339923:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734259953.339924:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098323072, offset 0 00000800:00000200:1.0:1734259953.339926:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259953.339929:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259953.339930:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734259953.339934:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259953.339935:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259953.339937:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734259953.339940:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259953.339948:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259953.339950:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259953.339952:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734259953.339953:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734259953.339954:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1256:1256:255:4294967295] 192.168.202.108@tcp LPNI seq info [1255:1255:7:4294967295] 00000400:00000200:3.0:1734259953.339963:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259953.339966:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259953.339969:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734259953.339972:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259953.339975:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259953.339977:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259953.340047:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259953.340049:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734259953.340053:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259953.340057:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259953.340060:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:0.0:1734259953.340062:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734259953.340069:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098322944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259969 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259953.340127:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259953.340129:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734259953.340132:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259953.340134:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259953.340136:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734259953.340137:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734259953.340141:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098323072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259963 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259953.341655:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259953.341678:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627200 00000400:00000200:0.0:1734259953.341684:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2829 [1] + 224 00000400:00000200:0.0:1734259953.341695:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259953.341697:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259953.341705:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098322944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259969 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259953.341739:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259953.341744:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627280 00000400:00000200:0.0:1734259953.341747:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2831 [1] + 0 00000400:00000200:0.0:1734259953.341758:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259953.341761:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259953.341765:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098323072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259963 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259953.341823:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259953.341828:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259953.341829:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259953.341833:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098323072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259963 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259953.341834:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259953.341838:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259953.341839:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:3.0:1734259953.341840:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098323072/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259963 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259953.341843:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098322944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259969 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259953.341851:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098322944/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259969 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259953.341862:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:1.0:1734259953.341865:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:3.0:1734259953.341865:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734259953.341868:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734259953.341868:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:1.0:1734259953.341870:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734259958.347830:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734259958.347849:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 02000000:00000010:2.0:1734259958.348488:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734259958.348504:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb58. 00000400:00000010:2.0:1734259958.348519:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734259958.348524:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098323200, portal 25 00000400:00000010:2.0:1734259958.348528:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734259958.348529:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098323200, offset 0 00000400:00000200:2.0:1734259958.348536:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259958.348546:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259958.348550:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259958.348554:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259958.348556:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259958.348558:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259958.348560:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1257:1257:256:4294967295] 192.168.202.108@tcp LPNI seq info [1256:1256:8:4294967295] 00000400:00000200:2.0:1734259958.348588:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259958.348593:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259958.348597:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259958.348601:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259958.348608:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259958.348611:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000100:00000010:0.0:1734259958.348694:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734259958.348702:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734259958.348733:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:0.0:1734259958.348736:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d504d0. 00000400:00000010:0.0:1734259958.348739:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:0.0:1734259958.348741:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098323328, portal 10 00000400:00000010:0.0:1734259958.348745:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000100:00000200:0.0:1734259958.348747:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098323328, offset 0 00000400:00000200:0.0:1734259958.348750:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259958.348754:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259958.348757:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259958.348758:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259958.348760:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259958.348761:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259958.348769:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1258:1258:255:4294967295] 192.168.202.108@tcp LPNI seq info [1257:1257:7:4294967295] 00000400:00000200:0.0:1734259958.348774:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259958.348778:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259958.348780:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000800:00000200:0.0:1734259958.348782:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259958.348785:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259958.348787:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259958.349069:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259958.349073:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259958.349076:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259958.349080:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259958.349083:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:1.0:1734259958.349084:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:1.0:1734259958.349091:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098323200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259974 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259958.349145:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259958.349147:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734259958.349148:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259958.349151:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259958.349153:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:1.0:1734259958.349154:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:1.0:1734259958.349157:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098323328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259968 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259958.351046:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259958.351060:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627380 00000400:00000200:0.0:1734259958.351066:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2841 [1] + 0 00000400:00000200:0.0:1734259958.351074:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259958.351076:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259958.351084:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098323328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259968 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259958.351117:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259958.351121:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627300 00000400:00000200:0.0:1734259958.351126:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2839 [1] + 224 00000400:00000200:0.0:1734259958.351137:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259958.351140:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259958.351143:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098323200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259974 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259958.351198:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb58. 00000400:00000200:3.0:1734259958.351202:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:3.0:1734259958.351204:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:3.0:1734259958.351208:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098323200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259974 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259958.351214:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098323200/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259974 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259958.351234:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:3.0:1734259958.351238:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000400:00000010:2.0:1734259958.351241:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d504d0. 00000100:00000010:3.0:1734259958.351241:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:2.0:1734259958.351244:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:2.0:1734259958.351245:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:2.0:1734259958.351249:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098323328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259968 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259958.351254:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098323328/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259968 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:2.0:1734259958.351266:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:2.0:1734259958.351272:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734259958.351275:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734259958.351276:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734259963.355681:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734259963.355698:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734259963.355758:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734259963.355765:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734259963.355799:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734259963.355800:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:0.0:1734259963.355805:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50478. 00000400:00000010:3.0:1734259963.355805:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:0.0:1734259963.355810:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000400:00000010:3.0:1734259963.355810:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259963.355815:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098323456, portal 25 00000400:00000010:3.0:1734259963.355818:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000100:00000200:3.0:1734259963.355820:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098323456, offset 0 00000100:00000200:0.0:1734259963.355822:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098323584, portal 10 00000400:00000010:0.0:1734259963.355825:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000400:00000200:3.0:1734259963.355827:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734259963.355833:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098323584, offset 0 00000400:00000200:0.0:1734259963.355837:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259963.355838:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259963.355842:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259963.355845:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259963.355848:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259963.355860:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259963.355863:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1259:1259:256:4294967295] 192.168.202.108@tcp LPNI seq info [1258:1258:8:4294967295] 00000400:00000200:3.0:1734259963.355869:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:0.0:1734259963.355873:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734259963.355874:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259963.355875:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259963.355876:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000010:3.0:1734259963.355877:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734259963.355878:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259963.355879:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259963.355881:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1260:1260:255:4294967295] 192.168.202.108@tcp LPNI seq info [1259:1259:7:4294967295] 00000800:00000200:3.0:1734259963.355882:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259963.355885:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259963.355888:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734259963.355888:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:0.0:1734259963.355890:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000800:00000200:0.0:1734259963.355892:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259963.355892:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734259963.355894:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259963.355896:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259963.356020:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259963.356023:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:1.0:1734259963.356029:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259963.356044:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259963.356048:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:1.0:1734259963.356054:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:1.0:1734259963.356061:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098323456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259979 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259963.356122:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259963.356124:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734259963.356126:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259963.356139:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259963.356142:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:1.0:1734259963.356143:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:1.0:1734259963.356147:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098323584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259973 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259963.357702:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259963.357716:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627400 00000400:00000200:0.0:1734259963.357724:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2849 [1] + 224 00000400:00000200:0.0:1734259963.357733:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259963.357736:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259963.357743:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098323456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259979 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259963.357776:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259963.357780:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627480 00000400:00000200:0.0:1734259963.357784:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2851 [1] + 0 00000400:00000200:0.0:1734259963.357797:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259963.357800:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259963.357804:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098323584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259973 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259963.357985:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50478. 00000400:00000200:1.0:1734259963.357990:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:1.0:1734259963.357991:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:1.0:1734259963.357996:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098323584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259973 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259963.358003:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098323584/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259973 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259963.358027:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:1.0:1734259963.358031:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734259963.358034:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:3.0:1734259963.358135:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259963.358139:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259963.358140:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259963.358145:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098323456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259979 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259963.358150:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098323456/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259979 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259963.358162:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259963.358166:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734259963.358168:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734259968.363753:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734259968.363770:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734259968.363822:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734259968.363827:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734259968.363843:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 02000000:00000010:0.0:1734259968.363858:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734259968.363862:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50420. 00000400:00000010:2.0:1734259968.363864:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58cb00. 00000400:00000010:0.0:1734259968.363868:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000400:00000010:2.0:1734259968.363868:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734259968.363873:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098323840, portal 10 00000100:00000200:2.0:1734259968.363873:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098323712, portal 25 00000400:00000010:0.0:1734259968.363877:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000400:00000010:2.0:1734259968.363877:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:0.0:1734259968.363879:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098323840, offset 0 00000100:00000200:2.0:1734259968.363879:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098323712, offset 0 00000400:00000200:0.0:1734259968.363886:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259968.363891:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259968.363895:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259968.363915:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259968.363918:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259968.363921:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259968.363923:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259968.363925:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1261:1261:256:4294967295] 192.168.202.108@tcp LPNI seq info [1260:1260:8:4294967295] 00000400:00000200:0.0:1734259968.363931:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259968.363936:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259968.363938:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259968.363940:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259968.363942:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000010:0.0:1734259968.363943:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000400:00000200:2.0:1734259968.363944:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259968.363946:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734259968.363948:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259968.363948:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1262:1262:255:4294967295] 192.168.202.108@tcp LPNI seq info [1261:1261:7:4294967295] 00000400:00000200:2.0:1734259968.363953:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259968.363954:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259968.363956:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734259968.363957:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 00000800:00000010:2.0:1734259968.363959:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734259968.363962:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259968.363966:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259968.363968:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259968.364028:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259968.364031:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:1.0:1734259968.364035:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259968.364038:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259968.364042:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:1.0:1734259968.364043:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:1.0:1734259968.364049:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098323840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259978 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259968.364108:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259968.364110:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734259968.364112:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259968.364118:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259968.364120:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000400:00000010:1.0:1734259968.364120:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000100:00000200:1.0:1734259968.364123:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098323712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259984 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259968.365587:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259968.365600:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627580 00000400:00000200:0.0:1734259968.365607:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x285d [1] + 0 00000400:00000200:0.0:1734259968.365616:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259968.365618:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259968.365631:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098323840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259978 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259968.365668:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259968.365672:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627500 00000400:00000200:0.0:1734259968.365676:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2859 [1] + 224 00000400:00000200:0.0:1734259968.365687:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259968.365690:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259968.365694:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098323712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259984 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259968.365700:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50420. 00000400:00000200:2.0:1734259968.365705:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:2.0:1734259968.365707:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:2.0:1734259968.365711:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098323840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259978 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259968.365719:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098323840/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259978 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259968.365740:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734259968.365745:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734259968.365747:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:3.0:1734259968.365776:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58cb00. 00000400:00000200:3.0:1734259968.365780:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:3.0:1734259968.365781:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:3.0:1734259968.365785:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098323712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259984 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259968.365791:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098323712/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259984 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259968.365801:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:3.0:1734259968.365803:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734259968.365805:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734259973.371763:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734259973.371782:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734259973.372076:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734259973.372082:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734259973.372097:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734259973.372105:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259973.372111:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259973.372117:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098323968, portal 25 00000400:00000010:1.0:1734259973.372121:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734259973.372123:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098323968, offset 0 00000400:00000200:1.0:1734259973.372131:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259973.372142:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259973.372146:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259973.372150:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259973.372152:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259973.372154:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259973.372156:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1263:1263:256:4294967295] 192.168.202.108@tcp LPNI seq info [1262:1262:8:4294967295] 00000400:00000200:1.0:1734259973.372163:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259973.372168:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259973.372171:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734259973.372176:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734259973.372183:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734259973.372186:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734259973.372209:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734259973.372214:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734259973.372226:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734259973.372228:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098324096, portal 10 00000400:00000010:2.0:1734259973.372232:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000100:00000200:2.0:1734259973.372233:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098324096, offset 0 00000400:00000200:2.0:1734259973.372238:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259973.372241:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259973.372244:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259973.372245:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259973.372247:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259973.372248:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259973.372250:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1264:1264:255:4294967295] 192.168.202.108@tcp LPNI seq info [1263:1263:7:4294967295] 00000400:00000200:2.0:1734259973.372256:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259973.372259:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259973.372261:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734259973.372264:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259973.372267:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259973.372270:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259973.372389:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259973.372391:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734259973.372395:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259973.372408:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259973.372411:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:0.0:1734259973.372413:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:0.0:1734259973.372419:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098323968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259989 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259973.372475:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259973.372477:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734259973.372479:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259973.372482:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259973.372484:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:0.0:1734259973.372485:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:0.0:1734259973.372488:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098324096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259983 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259973.374072:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259973.374094:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627600 00000400:00000200:0.0:1734259973.374100:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2869 [1] + 224 00000400:00000200:0.0:1734259973.374111:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259973.374114:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259973.374121:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098323968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259973.374155:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259973.374159:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627680 00000400:00000200:0.0:1734259973.374162:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2871 [1] + 0 00000400:00000200:0.0:1734259973.374174:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259973.374177:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259973.374180:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098324096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259983 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259973.374250:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734259973.374254:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734259973.374256:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000400:00000010:1.0:1734259973.374260:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000100:00000200:2.0:1734259973.374261:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098324096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259983 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734259973.374264:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259973.374265:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:2.0:1734259973.374268:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098324096/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259983 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259973.374270:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098323968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259989 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259973.374276:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098323968/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259989 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259973.374290:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259973.374295:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 02000000:00000010:1.0:1734259973.374296:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734259973.374299:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734259973.374300:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:1.0:1734259973.374301:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734259978.379696:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734259978.379715:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734259978.379770:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734259978.379775:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734259978.379793:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 00000400:00000010:2.0:1734259978.379801:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734259978.379806:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 02000000:00000010:3.0:1734259978.379808:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734259978.379813:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000100:00000200:2.0:1734259978.379822:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098324224, portal 25 00000400:00000010:3.0:1734259978.379822:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259978.379825:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098324352, portal 10 00000400:00000010:2.0:1734259978.379826:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734259978.379828:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098324224, offset 0 00000400:00000010:3.0:1734259978.379830:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734259978.379832:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098324352, offset 0 00000400:00000200:2.0:1734259978.379837:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259978.379844:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259978.379847:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259978.379851:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259978.379855:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259978.379857:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259978.379860:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259978.379862:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1265:1265:256:4294967295] 192.168.202.108@tcp LPNI seq info [1264:1264:8:4294967295] 00000400:00000200:2.0:1734259978.379869:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259978.379874:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259978.379874:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734259978.379877:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000400:00000200:3.0:1734259978.379877:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259978.379879:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259978.379881:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734259978.379882:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259978.379883:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259978.379885:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1266:1266:255:4294967295] 192.168.202.108@tcp LPNI seq info [1265:1265:7:4294967295] 00000800:00000200:2.0:1734259978.379888:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259978.379891:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734259978.379891:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259978.379894:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259978.379896:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734259978.379899:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259978.379903:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259978.379905:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259978.379977:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259978.379980:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734259978.379984:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259978.379988:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259978.379991:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734259978.379992:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734259978.379998:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098324224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259994 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259978.380055:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259978.380057:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734259978.380059:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259978.380062:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259978.380064:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734259978.380069:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734259978.380073:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098324352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259988 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259978.381322:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259978.381334:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627700 00000400:00000200:0.0:1734259978.381339:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2879 [1] + 224 00000400:00000200:0.0:1734259978.381348:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259978.381350:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259978.381356:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098324224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259994 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259978.381398:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259978.381403:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627780 00000400:00000200:0.0:1734259978.381406:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x287d [1] + 0 00000400:00000200:0.0:1734259978.381421:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:2.0:1734259978.381422:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:0.0:1734259978.381424:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734259978.381427:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734259978.381428:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734259978.381432:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098324224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259994 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734259978.381435:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098324352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259988 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259978.381438:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098324224/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259994 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259978.381454:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:2.0:1734259978.381458:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734259978.381460:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:3.0:1734259978.381522:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259978.381526:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259978.381527:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259978.381530:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098324352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259988 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259978.381536:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098324352/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259988 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259978.381551:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734259978.381553:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:3.0:1734259978.381557:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734259983.387680:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734259983.387699:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734259983.387752:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734259983.387758:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734259983.387777:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734259983.387785:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:0.0:1734259983.387790:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 00000400:00000010:3.0:1734259983.387792:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:0.0:1734259983.387793:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d503c8. 00000400:00000010:0.0:1734259983.387797:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000100:00000200:0.0:1734259983.387803:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098324608, portal 10 00000100:00000200:3.0:1734259983.387803:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098324480, portal 25 00000400:00000010:3.0:1734259983.387806:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000400:00000010:0.0:1734259983.387807:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:3.0:1734259983.387808:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098324480, offset 0 00000100:00000200:0.0:1734259983.387809:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098324608, offset 0 00000400:00000200:0.0:1734259983.387815:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259983.387822:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259983.387826:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734259983.387835:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259983.387839:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734259983.387842:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259983.387844:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259983.387846:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1267:1267:256:4294967295] 192.168.202.108@tcp LPNI seq info [1266:1266:8:4294967295] 00000400:00000200:0.0:1734259983.387853:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259983.387858:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259983.387860:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734259983.387861:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4800. 00000400:00000200:3.0:1734259983.387862:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259983.387864:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:0.0:1734259983.387866:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734259983.387866:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259983.387868:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259983.387870:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1268:1268:255:4294967295] 192.168.202.108@tcp LPNI seq info [1267:1267:7:4294967295] 00000800:00000200:0.0:1734259983.387873:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734259983.387875:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259983.387876:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734259983.387879:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734259983.387881:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734259983.387884:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734259983.387887:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259983.387890:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734259983.387956:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259983.387959:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4800. 00000400:00000200:1.0:1734259983.387964:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259983.387968:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259983.387972:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:1.0:1734259983.387973:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:1.0:1734259983.387985:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098324608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259993 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259983.388039:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259983.388041:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:1.0:1734259983.388043:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259983.388046:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259983.388048:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:1.0:1734259983.388049:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:1.0:1734259983.388052:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098324480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259999 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259983.389456:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259983.389468:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627880 00000400:00000200:0.0:1734259983.389474:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2889 [1] + 0 00000400:00000200:0.0:1734259983.389482:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259983.389484:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259983.389492:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098324608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259993 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259983.389529:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259983.389533:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627800 00000400:00000200:0.0:1734259983.389537:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x288d [1] + 224 00000400:00000200:0.0:1734259983.389549:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259983.389552:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259983.389556:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098324480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259999 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259983.389557:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d503c8. 00000400:00000200:2.0:1734259983.389562:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:2.0:1734259983.389563:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:2.0:1734259983.389593:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098324608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259993 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259983.389611:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098324608/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259993 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259983.389629:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:2.0:1734259983.389630:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734259983.389632:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000400:00000200:3.0:1734259983.389633:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000100:00000010:2.0:1734259983.389634:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:3.0:1734259983.389634:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259983.389638:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098324480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259999 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259983.389645:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098324480/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734259999 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259983.389657:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259983.389661:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734259983.389663:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734259988.395892:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734259988.395918:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734259988.395980:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734259988.396002:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:1.0:1734259988.396028:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0000. 00000400:00000010:1.0:1734259988.396036:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259988.396042:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259988.396050:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098324736, portal 25 00000400:00000010:1.0:1734259988.396054:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734259988.396056:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098324736, offset 0 00000400:00000200:1.0:1734259988.396066:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259988.396080:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734259988.396085:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734259988.396089:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259988.396093:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734259988.396095:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:2.0:1734259988.396101:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000200:1.0:1734259988.396102:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1269:1269:256:4294967295] 192.168.202.108@tcp LPNI seq info [1268:1268:8:4294967295] 00000400:00000200:1.0:1734259988.396108:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259988.396113:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259988.396114:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000800:00000010:1.0:1734259988.396116:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000400:00000010:2.0:1734259988.396120:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000800:00000200:1.0:1734259988.396121:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:2.0:1734259988.396125:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098324864, portal 10 00000800:00000200:1.0:1734259988.396129:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:2.0:1734259988.396132:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000800:00000200:1.0:1734259988.396133:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:2.0:1734259988.396134:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098324864, offset 0 00000400:00000200:2.0:1734259988.396142:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734259988.396153:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734259988.396158:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734259988.396161:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259988.396163:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259988.396166:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259988.396168:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1270:1270:255:4294967295] 192.168.202.108@tcp LPNI seq info [1269:1269:7:4294967295] 00000400:00000200:2.0:1734259988.396176:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734259988.396180:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259988.396184:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734259988.396189:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259988.396196:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259988.396199:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259988.396249:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259988.396252:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734259988.396256:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259988.396262:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259988.396266:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734259988.396268:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734259988.396274:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098324736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734259988.396353:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259988.396355:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734259988.396358:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259988.396361:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259988.396363:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734259988.396365:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734259988.396368:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098324864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259998 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259988.397810:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259988.397824:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627900 00000400:00000200:0.0:1734259988.397831:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2899 [1] + 224 00000400:00000200:0.0:1734259988.397843:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259988.397852:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259988.397859:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098324736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260004 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259988.397893:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259988.397898:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627980 00000400:00000200:0.0:1734259988.397903:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x28a1 [1] + 0 00000400:00000200:0.0:1734259988.397920:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259988.397922:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259988.397927:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098324864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259998 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259988.398020:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259988.398024:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259988.398026:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259988.398031:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098324736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259988.398037:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098324736/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260004 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259988.398063:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0000. 02000000:00000010:1.0:1734259988.398068:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:1.0:1734259988.398071:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:2.0:1734259988.398214:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734259988.398219:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734259988.398220:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734259988.398225:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098324864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259998 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259988.398242:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098324864/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734259998 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259988.398260:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259988.398265:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:2.0:1734259988.398267:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734259993.403832:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734259993.403850:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734259993.403903:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734259993.403909:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:1.0:1734259993.403988:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0000. 00000400:00000010:1.0:1734259993.403996:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734259993.404002:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259993.404007:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098324992, portal 25 00000400:00000010:1.0:1734259993.404011:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 02000000:00000010:2.0:1734259993.404011:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000100:00000200:1.0:1734259993.404013:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098324992, offset 0 00000400:00000010:2.0:1734259993.404016:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000200:1.0:1734259993.404020:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734259993.404027:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734259993.404030:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098325120, portal 10 00000400:00000200:1.0:1734259993.404031:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734259993.404034:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000400:00000200:1.0:1734259993.404035:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:2.0:1734259993.404035:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098325120, offset 0 00000400:00000200:1.0:1734259993.404039:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734259993.404042:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259993.404043:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734259993.404044:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734259993.404047:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1271:1271:256:4294967295] 192.168.202.108@tcp LPNI seq info [1270:1270:8:4294967295] 00000400:00000200:1.0:1734259993.404066:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734259993.404071:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734259993.404074:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734259993.404078:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734259993.404083:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734259993.404084:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734259993.404085:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734259993.404087:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734259993.404088:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734259993.404089:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734259993.404091:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734259993.404093:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1272:1272:255:4294967295] 192.168.202.108@tcp LPNI seq info [1271:1271:7:4294967295] 00000400:00000200:2.0:1734259993.404099:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259993.404274:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259993.404276:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734259993.404280:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259993.404284:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259993.404287:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:0.0:1734259993.404288:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:0.0:1734259993.404294:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098324992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734259993.404414:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734259993.404418:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734259993.404421:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734259993.404424:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734259993.404426:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734259993.404933:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734259993.404935:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734259993.404938:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259993.404941:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734259993.404944:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:0.0:1734259993.404945:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:0.0:1734259993.404949:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098325120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260003 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259993.405942:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259993.406017:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627a00 00000400:00000200:0.0:1734259993.406049:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x28a9 [1] + 224 00000400:00000200:0.0:1734259993.406066:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259993.406069:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259993.406075:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098324992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260009 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734259993.406146:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734259993.406151:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734259993.406153:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734259993.406157:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098324992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260009 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734259993.406164:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098324992/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260009 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734259993.406180:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0000. 02000000:00000010:1.0:1734259993.406184:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:1.0:1734259993.406187:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734259993.407116:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259993.407125:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627a80 00000400:00000200:0.0:1734259993.407136:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x28b1 [1] + 0 00000400:00000200:0.0:1734259993.407147:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259993.407150:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259993.407156:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098325120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260003 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259993.407386:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734259993.407391:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734259993.407393:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734259993.407397:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098325120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260003 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259993.407412:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098325120/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260003 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259993.407429:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734259993.407433:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:2.0:1734259993.407436:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734259998.411704:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734259998.411724:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734259998.411781:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734259998.411787:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:0.0:1734259998.411823:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734259998.411825:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:0.0:1734259998.411829:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50370. 00000400:00000010:3.0:1734259998.411830:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:0.0:1734259998.411834:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000400:00000010:3.0:1734259998.411834:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259998.411840:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098325248, portal 25 00000400:00000010:3.0:1734259998.411843:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734259998.412076:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098325376, portal 10 00000100:00000200:3.0:1734259998.412077:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098325248, offset 0 00000400:00000010:0.0:1734259998.412083:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000400:00000200:3.0:1734259998.412087:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734259998.412090:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098325376, offset 0 00000400:00000200:0.0:1734259998.412095:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734259998.412098:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734259998.412102:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734259998.412105:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734259998.412108:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734259998.412110:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734259998.412112:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1273:1273:256:4294967295] 192.168.202.108@tcp LPNI seq info [1272:1272:8:4294967295] 00000400:00000200:3.0:1734259998.412119:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734259998.412124:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734259998.412125:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734259998.412127:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734259998.412128:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734259998.412129:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734259998.412131:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734259998.412132:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734259998.412133:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734259998.412135:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1274:1274:255:4294967295] 192.168.202.108@tcp LPNI seq info [1273:1273:7:4294967295] 00000800:00000200:3.0:1734259998.412138:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734259998.412140:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734259998.412141:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734259998.412145:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734259998.412147:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734259998.412150:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734259998.412153:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734259998.412155:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734259998.412285:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259998.412288:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:1.0:1734259998.412292:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259998.412296:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259998.412299:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:1.0:1734259998.412301:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:1.0:1734259998.412307:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098325248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734259998.412365:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734259998.412367:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:1.0:1734259998.412369:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734259998.412373:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734259998.412374:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:1.0:1734259998.412375:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:1.0:1734259998.412378:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098325376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260008 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734259998.415090:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259998.415115:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627b00 00000400:00000200:0.0:1734259998.415122:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x28b9 [1] + 224 00000400:00000200:0.0:1734259998.415141:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259998.415144:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259998.415152:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098325248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734259998.415397:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734259998.415402:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734259998.415404:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734259998.415409:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098325248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734259998.415415:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098325248/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260014 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734259998.415436:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734259998.415441:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734259998.415444:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000400:00000200:0.0:1734259998.415539:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734259998.415545:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627b80 00000400:00000200:0.0:1734259998.415550:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x28bd [1] + 0 00000400:00000200:0.0:1734259998.415560:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734259998.415562:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734259998.415566:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098325376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260008 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734259998.415801:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50370. 00000400:00000200:2.0:1734259998.415805:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:2.0:1734259998.415807:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:2.0:1734259998.415811:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098325376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260008 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734259998.415818:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098325376/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260008 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734259998.415833:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734259998.415836:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734259998.415838:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:0.0:1734260003.419713:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734260003.419731:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 02000000:00000010:3.0:1734260003.419811:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260003.419818:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260003.419823:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260003.419828:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098325504, portal 25 00000400:00000010:3.0:1734260003.419831:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000100:00000200:3.0:1734260003.419832:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098325504, offset 0 00000400:00000200:3.0:1734260003.419838:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260003.419858:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000010:0.0:1734260003.419863:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 00000400:00000200:3.0:1734260003.419863:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260003.419867:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260003.419869:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 02000000:00000010:0.0:1734260003.419870:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 00000400:00000200:3.0:1734260003.419871:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260003.419874:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1275:1275:256:4294967295] 192.168.202.108@tcp LPNI seq info [1274:1274:8:4294967295] 00000400:00000200:3.0:1734260003.419882:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260003.419887:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260003.419890:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734260003.419896:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260003.419903:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 02000000:00000010:2.0:1734260003.419906:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000800:00000200:3.0:1734260003.419906:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:2.0:1734260003.419917:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734260003.419923:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734260003.419928:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098325632, portal 10 00000400:00000010:2.0:1734260003.419936:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e880. 00000100:00000200:2.0:1734260003.419938:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098325632, offset 0 00000400:00000200:2.0:1734260003.419945:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260003.419955:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260003.419959:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260003.419962:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260003.419965:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260003.419967:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260003.419970:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1276:1276:255:4294967295] 192.168.202.108@tcp LPNI seq info [1275:1275:7:4294967295] 00000400:00000200:2.0:1734260003.419977:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260003.419997:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260003.420000:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734260003.420004:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260003.420011:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260003.420014:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260003.420021:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260003.420024:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734260003.420026:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260003.420030:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260003.420033:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:1.0:1734260003.420034:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:1.0:1734260003.420040:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098325504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260003.420100:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260003.420102:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734260003.420104:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260003.420107:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260003.420110:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e880 00000400:00000010:1.0:1734260003.420111:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e880. 00000100:00000200:1.0:1734260003.420114:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098325632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260013 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260003.421727:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260003.421741:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627c00 00000400:00000200:0.0:1734260003.421748:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x28c9 [1] + 224 00000400:00000200:0.0:1734260003.421756:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260003.421759:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260003.421766:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098325504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260019 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260003.421805:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260003.421809:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627c80 00000400:00000200:0.0:1734260003.421813:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x28d1 [1] + 0 00000400:00000200:0.0:1734260003.421838:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260003.421847:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260003.421852:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098325632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260003.421904:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260003.421909:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260003.421910:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260003.421914:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098325504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260003.421919:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098325504/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260019 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260003.421929:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734260003.421932:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734260003.421933:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734260003.421936:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098325632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260013 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260003.421939:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 00000100:00000200:2.0:1734260003.421941:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098325632/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260013 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260003.421943:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:3.0:1734260003.421946:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 02000000:00000010:2.0:1734260003.421955:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734260003.421958:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:2.0:1734260003.421961:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734260008.427687:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734260008.427703:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734260008.427756:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734260008.427761:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734260008.427834:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734260008.427839:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:2.0:1734260008.427842:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:3.0:1734260008.427844:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:2.0:1734260008.427847:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000400:00000010:3.0:1734260008.427847:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260008.427853:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098325760, portal 25 00000400:00000010:3.0:1734260008.427856:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:2.0:1734260008.427857:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098325888, portal 10 00000100:00000200:3.0:1734260008.427858:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098325760, offset 0 00000400:00000010:2.0:1734260008.427861:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e7f8. 00000400:00000200:3.0:1734260008.427865:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734260008.427869:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098325888, offset 0 00000400:00000200:2.0:1734260008.427873:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260008.427876:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260008.427880:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260008.427893:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260008.427896:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260008.427898:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260008.427900:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1277:1277:256:4294967295] 192.168.202.108@tcp LPNI seq info [1276:1276:8:4294967295] 00000400:00000200:3.0:1734260008.427907:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260008.427912:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260008.427913:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260008.427915:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000400:00000200:2.0:1734260008.427916:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260008.427918:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734260008.427919:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734260008.427920:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260008.427922:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260008.427924:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1278:1278:255:4294967295] 192.168.202.108@tcp LPNI seq info [1277:1277:7:4294967295] 00000800:00000200:3.0:1734260008.427925:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260008.427928:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734260008.427930:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260008.427933:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260008.427940:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734260008.427943:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260008.427947:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260008.427949:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260008.427993:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260008.427996:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734260008.428000:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260008.428004:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260008.428007:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734260008.428009:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734260008.428014:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098325760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260024 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260008.428070:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260008.428072:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734260008.428074:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260008.428077:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260008.428079:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e7f8 00000400:00000010:0.0:1734260008.428080:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e7f8. 00000100:00000200:0.0:1734260008.428083:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098325888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260018 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260008.429382:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260008.429396:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627d00 00000400:00000200:0.0:1734260008.429402:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x28d9 [1] + 224 00000400:00000200:0.0:1734260008.429410:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260008.429413:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260008.429420:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098325760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260024 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260008.429465:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260008.429469:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627d80 00000400:00000200:0.0:1734260008.429473:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x28dd [1] + 0 00000400:00000200:0.0:1734260008.429486:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260008.429489:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260008.429493:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098325888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260008.429559:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260008.429567:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260008.429604:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000400:00000010:2.0:1734260008.429611:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000100:00000200:3.0:1734260008.429614:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098325760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260024 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:2.0:1734260008.429616:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734260008.429618:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:3.0:1734260008.429622:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098325760/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260024 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260008.429623:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098325888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260018 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260008.429630:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098325888/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260018 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260008.429645:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260008.429652:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 02000000:00000010:2.0:1734260008.429653:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 00000100:00000010:3.0:1734260008.429656:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 02000000:00000010:2.0:1734260008.429659:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734260008.429663:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734260013.436133:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734260013.436151:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734260013.436210:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734260013.436216:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734260013.436316:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734260013.436326:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:2.0:1734260013.436332:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734260013.436337:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098326144, portal 10 00000400:00000010:2.0:1734260013.436343:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e3b8. 00000100:00000200:2.0:1734260013.436344:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098326144, offset 0 00000400:00000200:2.0:1734260013.436352:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260013.436363:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260013.436368:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260013.436371:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260013.436374:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260013.436376:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260013.436378:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1279:1279:256:4294967295] 192.168.202.108@tcp LPNI seq info [1278:1278:8:4294967295] 00000400:00000200:2.0:1734260013.436385:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260013.436390:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260013.436393:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734260013.436408:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260013.436414:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260013.436417:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734260013.436472:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260013.436476:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260013.436479:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260013.436481:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098326016, portal 25 00000400:00000010:3.0:1734260013.436484:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734260013.436486:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098326016, offset 0 00000400:00000200:3.0:1734260013.436490:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260013.436494:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260013.436496:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260013.436498:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260013.436500:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260013.436506:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260013.436508:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1280:1280:255:4294967295] 192.168.202.108@tcp LPNI seq info [1279:1279:7:4294967295] 00000400:00000200:3.0:1734260013.436514:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260013.436517:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260013.436520:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734260013.436522:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260013.436525:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260013.436527:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260013.436603:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260013.436605:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734260013.436609:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260013.436613:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260013.436616:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e3b8 00000400:00000010:0.0:1734260013.436618:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e3b8. 00000100:00000200:0.0:1734260013.436624:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098326144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260023 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260013.436685:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260013.436687:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734260013.436690:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260013.436692:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260013.436694:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734260013.436695:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734260013.436698:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098326016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260029 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260013.438598:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260013.438615:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627e00 00000400:00000200:0.0:1734260013.438630:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x28f1 [1] + 224 00000400:00000200:0.0:1734260013.438641:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260013.438644:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260013.438651:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098326016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260013.438685:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260013.438689:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627e80 00000400:00000200:0.0:1734260013.438694:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x28e9 [1] + 0 00000400:00000200:0.0:1734260013.438706:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260013.438708:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260013.438713:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098326144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260023 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260013.438797:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260013.438801:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260013.438802:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260013.438806:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098326016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260029 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260013.438813:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098326016/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260029 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260013.438835:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260013.438840:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734260013.438843:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000400:00000010:2.0:1734260013.438885:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:2.0:1734260013.438888:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 00000400:00000010:2.0:1734260013.438890:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 00000100:00000200:2.0:1734260013.438893:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098326144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260023 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260013.438897:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098326144/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260023 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260013.438908:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734260013.438910:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734260013.438912:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:0.0:1734260018.443683:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734260018.443701:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734260018.443755:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734260018.443760:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734260018.443784:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc000. 02000000:00000010:0.0:1734260018.443792:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732400. 00000400:00000010:2.0:1734260018.443792:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58caa8. 00000400:00000010:0.0:1734260018.443796:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50318. 00000400:00000010:2.0:1734260018.443797:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ee58. 00000400:00000010:0.0:1734260018.443799:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000100:00000200:0.0:1734260018.443803:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098326400, portal 10 00000100:00000200:2.0:1734260018.443803:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098326272, portal 25 00000400:00000010:2.0:1734260018.443807:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ea18. 00000400:00000010:0.0:1734260018.443808:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000100:00000200:0.0:1734260018.443809:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098326400, offset 0 00000100:00000200:2.0:1734260018.443809:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098326272, offset 0 00000400:00000200:0.0:1734260018.443816:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260018.443826:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260018.443836:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260018.443841:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260018.443844:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260018.443847:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260018.443849:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260018.443852:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1281:1281:256:4294967295] 192.168.202.108@tcp LPNI seq info [1280:1280:8:4294967295] 00000400:00000200:2.0:1734260018.443858:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260018.443863:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260018.443865:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734260018.443867:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734260018.443868:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260018.443869:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260018.443871:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734260018.443872:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734260018.443873:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260018.443875:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1282:1282:255:4294967295] 192.168.202.108@tcp LPNI seq info [1281:1281:7:4294967295] 00000400:00000200:0.0:1734260018.443881:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260018.443888:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260018.443891:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260018.443955:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260018.443957:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734260018.443960:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260018.443964:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260018.443966:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260018.444005:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260018.444008:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:1.0:1734260018.444012:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260018.444016:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260018.444019:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ea18 00000400:00000010:1.0:1734260018.444021:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ea18. 00000100:00000200:1.0:1734260018.444027:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098326272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260034 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260018.444117:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260018.444119:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:1.0:1734260018.444125:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260018.444128:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260018.444130:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:1.0:1734260018.444131:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:1.0:1734260018.444135:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098326400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260028 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260018.446011:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260018.446030:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c627f80 00000400:00000200:0.0:1734260018.446037:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x28fd [1] + 0 00000400:00000200:0.0:1734260018.446047:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260018.446050:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260018.446058:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098326400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260028 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260018.446106:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260018.446111:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c627f00 00000400:00000200:0.0:1734260018.446115:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x28f9 [1] + 224 00000400:00000200:0.0:1734260018.446131:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260018.446134:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260018.446137:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098326272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260018.446173:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50318. 00000400:00000200:2.0:1734260018.446177:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:2.0:1734260018.446178:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:2.0:1734260018.446187:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098326400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260028 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260018.446195:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098326400/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260028 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260018.446214:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58caa8. 00000400:00000200:3.0:1734260018.446217:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ee58 02000000:00000010:2.0:1734260018.446218:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732400. 00000400:00000010:3.0:1734260018.446219:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ee58. 02000000:00000010:2.0:1734260018.446222:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000200:3.0:1734260018.446222:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098326272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260034 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:2.0:1734260018.446225:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000200:3.0:1734260018.446227:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098326272/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260034 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260018.446235:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc000. 02000000:00000010:3.0:1734260018.446237:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734260018.446239:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734260023.451681:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734260023.451699:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734260023.451756:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734260023.451761:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734260023.451776:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260023.451783:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:0.0:1734260023.451791:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137733000. 00000400:00000010:0.0:1734260023.451795:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d502c0. 00000400:00000010:0.0:1734260023.451800:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000400:00000010:3.0:1734260023.451801:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734260023.451806:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098326656, portal 10 00000100:00000200:3.0:1734260023.451806:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098326528, portal 25 00000400:00000010:3.0:1734260023.451809:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000400:00000010:0.0:1734260023.451810:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000100:00000200:3.0:1734260023.451810:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098326528, offset 0 00000400:00000200:3.0:1734260023.451817:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260023.451828:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260023.451832:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260023.451835:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260023.451837:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260023.451839:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260023.451841:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1283:1283:256:4294967295] 192.168.202.108@tcp LPNI seq info [1282:1282:8:4294967295] 00000400:00000200:3.0:1734260023.451847:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260023.451851:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260023.451854:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734260023.451859:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260023.451865:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260023.451868:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:0.0:1734260023.451890:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098326656, offset 0 00000400:00000200:0.0:1734260023.451896:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260023.451900:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260023.451902:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260023.451905:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260023.451907:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260023.451908:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260023.451910:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1284:1284:255:4294967295] 192.168.202.108@tcp LPNI seq info [1283:1283:7:4294967295] 00000400:00000200:0.0:1734260023.451916:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260023.451921:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260023.451923:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734260023.451925:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260023.451929:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260023.451931:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260023.452022:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260023.452026:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:1.0:1734260023.452030:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260023.452063:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260023.452066:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:1.0:1734260023.452068:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:1.0:1734260023.452074:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098326528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260039 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260023.452127:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260023.452129:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734260023.452131:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260023.452134:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260023.452136:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:1.0:1734260023.452137:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000100:00000200:1.0:1734260023.452140:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098326656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260033 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260023.453483:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260023.453495:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628000 00000400:00000200:0.0:1734260023.453500:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x290d [1] + 224 00000400:00000200:0.0:1734260023.453509:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260023.453511:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260023.453518:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098326528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260039 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260023.453553:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260023.453557:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628080 00000400:00000200:0.0:1734260023.453560:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2909 [1] + 0 00000400:00000200:0.0:1734260023.453589:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260023.453592:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260023.453596:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098326656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260023.453686:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260023.453691:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260023.453692:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260023.453697:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098326528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260039 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260023.453702:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098326528/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260039 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260023.453718:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260023.453722:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734260023.453724:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:1.0:1734260023.453735:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d502c0. 00000400:00000200:1.0:1734260023.453738:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:1.0:1734260023.453739:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:1.0:1734260023.453743:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098326656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260033 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260023.453748:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098326656/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260033 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260023.453766:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137733000. 02000000:00000010:1.0:1734260023.453769:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734260023.453772:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734260028.459713:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734260028.459731:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734260028.459780:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734260028.459787:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734260028.459802:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260028.459810:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:1.0:1734260028.459814:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:3.0:1734260028.459817:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:1.0:1734260028.459819:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260028.459823:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:3.0:1734260028.459823:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098326784, portal 25 00000100:00000200:1.0:1734260028.459825:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098326912, portal 10 00000400:00000010:3.0:1734260028.459836:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:3.0:1734260028.459838:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098326784, offset 0 00000400:00000010:1.0:1734260028.459841:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000400:00000200:3.0:1734260028.459846:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:1.0:1734260028.459850:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098326912, offset 0 00000400:00000200:1.0:1734260028.459855:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260028.459857:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260028.459862:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260028.459865:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260028.459868:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260028.459870:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260028.459873:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1285:1285:256:4294967295] 192.168.202.108@tcp LPNI seq info [1284:1284:8:4294967295] 00000400:00000200:3.0:1734260028.459880:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734260028.459886:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734260028.459886:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260028.459888:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734260028.459888:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000400:00000200:1.0:1734260028.459890:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260028.459892:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734260028.459893:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260028.459894:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260028.459896:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1286:1286:255:4294967295] 192.168.202.108@tcp LPNI seq info [1285:1285:7:4294967295] 00000800:00000200:3.0:1734260028.459898:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260028.459901:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260028.459902:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260028.459905:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260028.459908:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734260028.459910:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260028.459914:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260028.459916:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260028.459988:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260028.459990:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734260028.460024:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260028.460029:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260028.460032:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734260028.460034:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734260028.460040:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098326784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260044 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260028.460100:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260028.460102:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734260028.460104:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260028.460107:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260028.460109:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:0.0:1734260028.460110:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:0.0:1734260028.460113:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098326912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260038 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260028.461527:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260028.461545:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628100 00000400:00000200:0.0:1734260028.461553:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2919 [1] + 224 00000400:00000200:0.0:1734260028.461565:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260028.461598:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260028.461607:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098326784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260044 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260028.461648:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260028.461653:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628180 00000400:00000200:0.0:1734260028.461668:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x291d [1] + 0 00000400:00000200:0.0:1734260028.461681:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260028.461684:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260028.461689:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098326912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260038 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260028.461762:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260028.461770:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260028.461771:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260028.461776:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000100:00000200:1.0:1734260028.461777:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098326912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260038 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734260028.461780:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260028.461781:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734260028.461784:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098326912/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260038 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260028.461787:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098326784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260044 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260028.461794:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098326784/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260044 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260028.461804:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:3.0:1734260028.461805:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:1.0:1734260028.461808:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 02000000:00000010:3.0:1734260028.461809:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734260028.461811:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:1.0:1734260028.461812:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734260033.467722:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734260033.467742:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734260033.467798:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734260033.467804:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734260033.467839:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260033.467846:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260033.467851:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260033.467857:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098327040, portal 25 00000400:00000010:3.0:1734260033.467861:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734260033.467873:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098327040, offset 0 00000400:00000200:3.0:1734260033.467882:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260033.467892:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260033.467897:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260033.467901:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 02000000:00000010:1.0:1734260033.467904:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:3.0:1734260033.467904:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260033.467906:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260033.467908:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1287:1287:256:4294967295] 192.168.202.108@tcp LPNI seq info [1286:1286:8:4294967295] 00000400:00000010:1.0:1734260033.467909:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260033.467912:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260033.467915:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098327168, portal 10 00000400:00000200:3.0:1734260033.467915:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260033.467919:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734260033.467920:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000800:00000010:3.0:1734260033.467922:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000100:00000200:1.0:1734260033.467927:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098327168, offset 0 00000800:00000200:3.0:1734260033.467927:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260033.467931:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734260033.467933:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260033.467936:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734260033.467936:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260033.467938:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260033.467940:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260033.467941:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260033.467943:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260033.467945:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1288:1288:255:4294967295] 192.168.202.108@tcp LPNI seq info [1287:1287:7:4294967295] 00000400:00000200:1.0:1734260033.467951:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260033.467955:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260033.467957:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734260033.467974:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260033.467978:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260033.467980:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260033.468045:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260033.468048:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:0.0:1734260033.468051:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260033.468055:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260033.468059:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:0.0:1734260033.468060:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:0.0:1734260033.468067:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098327040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260049 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260033.468126:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260033.468128:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734260033.468130:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260033.468133:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260033.468135:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:0.0:1734260033.468136:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:0.0:1734260033.468139:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098327168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260043 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260033.469403:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260033.469415:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628200 00000400:00000200:0.0:1734260033.469421:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2929 [1] + 224 00000400:00000200:0.0:1734260033.469435:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260033.469438:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260033.469450:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098327040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260049 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260033.469538:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260033.469542:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260033.469543:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260033.469547:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098327040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260049 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260033.469555:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098327040/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260049 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260033.469771:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260033.469775:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734260033.469778:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000400:00000200:0.0:1734260033.470092:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260033.470100:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628280 00000400:00000200:0.0:1734260033.470105:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2931 [1] + 0 00000400:00000200:0.0:1734260033.470116:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260033.470119:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260033.470124:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098327168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260043 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260033.470267:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260033.470271:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260033.470272:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260033.470276:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098327168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260043 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260033.470281:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098327168/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260043 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260033.470295:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260033.470299:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734260033.470300:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000100:00000010:0.0:1734260038.475762:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734260038.475778:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734260038.475825:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734260038.475829:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734260038.475905:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc800. 00000400:00000010:2.0:1734260038.475911:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260038.475916:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260038.475920:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098327296, portal 25 00000400:00000010:2.0:1734260038.475950:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ec38. 00000100:00000200:2.0:1734260038.475952:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098327296, offset 0 00000400:00000200:2.0:1734260038.475960:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260038.475972:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260038.475977:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260038.475981:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260038.475984:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260038.475986:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260038.475988:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1289:1289:256:4294967295] 192.168.202.108@tcp LPNI seq info [1288:1288:8:4294967295] 00000400:00000200:2.0:1734260038.475994:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260038.475999:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260038.476002:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734260038.476005:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260038.476011:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260038.476024:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734260038.476120:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260038.476125:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260038.476128:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260038.476130:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098327424, portal 10 00000400:00000010:1.0:1734260038.476134:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000100:00000200:1.0:1734260038.476135:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098327424, offset 0 00000400:00000200:1.0:1734260038.476144:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260038.476148:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260038.476150:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260038.476152:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260038.476153:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260038.476155:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260038.476157:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1290:1290:255:4294967295] 192.168.202.108@tcp LPNI seq info [1289:1289:7:4294967295] 00000800:00000200:0.0:1734260038.476160:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:1.0:1734260038.476162:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000010:0.0:1734260038.476163:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734260038.476165:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000800:00000200:1.0:1734260038.476165:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260038.476167:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734260038.476169:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000800:00000200:1.0:1734260038.476170:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734260038.476172:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ec38 00000800:00000200:1.0:1734260038.476173:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:0.0:1734260038.476174:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ec38. 00000800:00000200:1.0:1734260038.476175:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:0.0:1734260038.476183:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098327296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260054 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260038.476208:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260038.476210:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734260038.476211:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260038.476214:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260038.476216:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:0.0:1734260038.476217:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:0.0:1734260038.476219:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098327424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260048 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260038.477758:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260038.477782:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628300 00000400:00000200:0.0:1734260038.477787:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2939 [1] + 224 00000400:00000200:0.0:1734260038.477798:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260038.477800:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260038.477807:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098327296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260054 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260038.477837:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260038.477841:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628380 00000400:00000200:0.0:1734260038.477845:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2941 [1] + 0 00000400:00000200:0.0:1734260038.477858:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260038.477861:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260038.477865:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098327424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260048 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260038.477868:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260038.477872:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260038.477873:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260038.477876:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098327296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260054 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260038.477882:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098327296/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260054 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260038.477900:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc800. 02000000:00000010:2.0:1734260038.477903:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734260038.477906:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000400:00000010:1.0:1734260038.477968:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260038.477971:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260038.477972:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260038.477976:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098327424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260048 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260038.477981:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098327424/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260048 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260038.477995:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260038.477998:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734260038.478000:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000100:00000010:0.0:1734260043.483709:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734260043.483727:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734260043.483780:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734260043.483786:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734260043.483808:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260043.483815:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260043.483821:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260043.483826:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098327552, portal 25 00000400:00000010:3.0:1734260043.483830:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:3.0:1734260043.483832:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098327552, offset 0 00000400:00000200:3.0:1734260043.483839:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260043.483859:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260043.483864:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260043.483867:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260043.483870:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260043.483872:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260043.483874:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1291:1291:256:4294967295] 192.168.202.108@tcp LPNI seq info [1290:1290:8:4294967295] 00000400:00000200:3.0:1734260043.483881:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:1.0:1734260043.483883:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000800:00000200:3.0:1734260043.483898:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260043.483902:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734260043.483906:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:1.0:1734260043.483912:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000800:00000200:3.0:1734260043.483913:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:1.0:1734260043.483915:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000800:00000200:3.0:1734260043.483916:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:1.0:1734260043.483917:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098327680, portal 10 00000400:00000010:1.0:1734260043.483921:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000100:00000200:1.0:1734260043.483923:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098327680, offset 0 00000400:00000200:1.0:1734260043.483927:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260043.483935:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260043.483938:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260043.483940:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260043.483942:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260043.483943:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260043.483945:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1292:1292:255:4294967295] 192.168.202.108@tcp LPNI seq info [1291:1291:7:4294967295] 00000400:00000200:1.0:1734260043.483951:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260043.483954:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260043.483957:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734260043.483959:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260043.483963:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260043.483965:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260043.484041:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260043.484044:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734260043.484048:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260043.484052:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260043.484056:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734260043.484057:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734260043.484063:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098327552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260059 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260043.484212:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260043.484214:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734260043.484216:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260043.484219:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260043.484221:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:0.0:1734260043.484228:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:0.0:1734260043.484232:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098327680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260053 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260043.485588:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260043.485600:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628400 00000400:00000200:0.0:1734260043.485607:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2949 [1] + 224 00000400:00000200:0.0:1734260043.485616:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260043.485619:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260043.485625:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098327552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260059 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260043.485662:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260043.485667:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628480 00000400:00000200:0.0:1734260043.485671:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2951 [1] + 0 00000400:00000200:0.0:1734260043.485684:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260043.485686:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260043.485690:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098327680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260053 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260043.485705:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260043.485708:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260043.485713:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260043.485717:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098327552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260059 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260043.485723:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098327552/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260059 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260043.485742:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260043.485747:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734260043.485750:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:1.0:1734260043.485809:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260043.485811:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260043.485812:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260043.485816:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098327680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260053 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260043.485822:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098327680/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260053 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260043.485836:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260043.485839:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734260043.485841:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734260048.491788:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734260048.491805:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 02000000:00000010:3.0:1734260048.491905:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260048.491911:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260048.491917:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000010:0.0:1734260048.491921:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 00000100:00000200:3.0:1734260048.491922:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098327808, portal 25 00000400:00000010:3.0:1734260048.491925:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 02000000:00000010:0.0:1734260048.491927:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 00000100:00000200:3.0:1734260048.491927:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098327808, offset 0 00000400:00000200:3.0:1734260048.491934:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260048.491944:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260048.491948:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260048.491960:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260048.491963:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260048.491966:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260048.491968:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1293:1293:256:4294967295] 192.168.202.108@tcp LPNI seq info [1292:1292:8:4294967295] 00000400:00000200:3.0:1734260048.491976:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260048.491981:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260048.491984:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734260048.491989:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260048.491995:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260048.491998:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734260048.492099:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260048.492103:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:2.0:1734260048.492106:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260048.492110:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260048.492113:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:2.0:1734260048.492114:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:2.0:1734260048.492120:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098327808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260064 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260048.492168:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260048.492172:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260048.492175:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260048.492177:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098327936, portal 10 00000400:00000010:1.0:1734260048.492181:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734260048.492183:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098327936, offset 0 00000400:00000200:1.0:1734260048.492187:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260048.492191:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260048.492198:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260048.492200:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260048.492201:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260048.492203:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260048.492205:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1294:1294:256:4294967295] 192.168.202.108@tcp LPNI seq info [1293:1293:8:4294967295] 00000400:00000200:1.0:1734260048.492211:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260048.492214:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260048.492217:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734260048.492219:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260048.492223:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260048.492224:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260048.492316:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260048.492318:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734260048.492320:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260048.492323:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260048.492325:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:0.0:1734260048.492326:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:0.0:1734260048.492329:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098327936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260058 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260048.494410:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260048.494424:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628500 00000400:00000200:0.0:1734260048.494430:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2959 [1] + 224 00000400:00000200:0.0:1734260048.494446:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260048.494448:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260048.494455:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098327808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260064 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260048.494542:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260048.494546:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260048.494548:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260048.494552:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098327808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260064 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260048.494558:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098327808/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260064 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260048.494605:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260048.494610:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:3.0:1734260048.494613:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000400:00000200:0.0:1734260048.495121:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260048.495127:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628580 00000400:00000200:0.0:1734260048.495132:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2961 [1] + 0 00000400:00000200:0.0:1734260048.495142:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260048.495145:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260048.495150:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098327936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260058 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260048.495281:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260048.495285:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260048.495286:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260048.495290:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098327936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260058 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260048.495296:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098327936/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260058 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260048.495312:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260048.495316:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734260048.495318:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734260053.499741:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734260053.499761:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4900. 00000100:00000010:0.0:1734260053.499846:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734260053.499852:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734260053.499868:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260053.499876:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260053.499882:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260053.499888:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098328064, portal 25 00000400:00000010:3.0:1734260053.499892:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734260053.499894:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098328064, offset 0 00000400:00000200:3.0:1734260053.499902:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260053.499913:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260053.499918:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260053.499921:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260053.499924:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260053.499934:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260053.499936:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1295:1295:256:4294967295] 192.168.202.108@tcp LPNI seq info [1294:1294:8:4294967295] 00000400:00000200:3.0:1734260053.499942:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260053.499947:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260053.499955:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734260053.499959:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260053.499966:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260053.499969:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734260053.499981:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260053.499986:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260053.499989:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260053.499992:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098328192, portal 10 00000400:00000010:1.0:1734260053.499996:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000100:00000200:1.0:1734260053.499998:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098328192, offset 0 00000400:00000200:1.0:1734260053.500002:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260053.500006:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260053.500008:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260053.500015:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260053.500017:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260053.500019:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260053.500021:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1296:1296:255:4294967295] 192.168.202.108@tcp LPNI seq info [1295:1295:7:4294967295] 00000400:00000200:1.0:1734260053.500026:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260053.500030:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260053.500032:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734260053.500035:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260053.500038:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260053.500040:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260053.500080:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260053.500083:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734260053.500088:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260053.500093:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260053.500096:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734260053.500098:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734260053.500103:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098328064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260069 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260053.500158:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260053.500160:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734260053.500167:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260053.500170:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260053.500172:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:0.0:1734260053.500173:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:0.0:1734260053.500177:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098328192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260063 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260053.501427:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260053.501438:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628600 00000400:00000200:0.0:1734260053.501443:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2969 [1] + 224 00000400:00000200:0.0:1734260053.501452:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260053.501454:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260053.501460:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098328064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260069 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260053.501487:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260053.501491:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628680 00000400:00000200:0.0:1734260053.501494:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2971 [1] + 0 00000400:00000200:0.0:1734260053.501504:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260053.501506:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260053.501509:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098328192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260063 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260053.501511:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260053.501515:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260053.501516:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260053.501521:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098328064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260069 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260053.501528:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098328064/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260069 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260053.501544:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260053.501548:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4900. 00000100:00000010:3.0:1734260053.501550:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:1.0:1734260053.501566:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260053.501595:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260053.501596:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260053.501600:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098328192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260063 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260053.501605:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098328192/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260063 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260053.501619:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260053.501623:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734260053.501626:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734260058.508078:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734260058.508104:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734260058.508170:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734260058.508177:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:2.0:1734260058.508226:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734260058.508236:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260058.508242:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260058.508247:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098328320, portal 25 00000400:00000010:2.0:1734260058.508251:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e5d8. 00000100:00000200:2.0:1734260058.508253:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098328320, offset 0 00000400:00000200:2.0:1734260058.508260:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260058.508270:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260058.508274:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:1.0:1734260058.508277:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:2.0:1734260058.508278:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260058.508280:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260058.508282:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:1.0:1734260058.508284:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000200:2.0:1734260058.508285:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1297:1297:256:4294967295] 192.168.202.108@tcp LPNI seq info [1296:1296:8:4294967295] 00000400:00000010:1.0:1734260058.508289:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260058.508293:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098328448, portal 10 00000400:00000010:1.0:1734260058.508300:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720770. 00000400:00000200:2.0:1734260058.508302:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000100:00000200:1.0:1734260058.508303:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098328448, offset 0 00000800:00000200:2.0:1734260058.508307:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260058.508309:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260058.508310:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734260058.508315:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260058.508318:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:2.0:1734260058.508321:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260058.508322:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260058.508325:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734260058.508325:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260058.508336:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260058.508338:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260058.508341:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1298:1298:255:4294967295] 192.168.202.108@tcp LPNI seq info [1297:1297:7:4294967295] 00000400:00000200:1.0:1734260058.508348:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260058.508352:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260058.508356:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734260058.508360:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260058.508372:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260058.508374:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260058.508421:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260058.508425:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734260058.508429:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260058.508434:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260058.508437:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e5d8 00000400:00000010:0.0:1734260058.508443:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e5d8. 00000100:00000200:0.0:1734260058.508450:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098328320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260074 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260058.508505:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260058.508507:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:0.0:1734260058.508509:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260058.508512:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260058.508514:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720770 00000400:00000010:0.0:1734260058.508516:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720770. 00000100:00000200:0.0:1734260058.508519:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098328448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260068 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260058.510119:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260058.510132:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628700 00000400:00000200:0.0:1734260058.510138:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2979 [1] + 224 00000400:00000200:0.0:1734260058.510147:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260058.510150:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260058.510157:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098328320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260074 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260058.510190:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260058.510194:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628780 00000400:00000200:0.0:1734260058.510198:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2981 [1] + 0 00000400:00000200:0.0:1734260058.510211:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260058.510214:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260058.510219:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098328448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260068 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260058.510225:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260058.510230:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260058.510231:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260058.510236:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098328320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260074 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260058.510247:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098328320/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260074 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260058.510266:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734260058.510269:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734260058.510272:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000400:00000010:1.0:1734260058.510339:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260058.510343:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260058.510344:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260058.510348:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098328448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260068 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260058.510354:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098328448/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260068 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260058.510369:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260058.510371:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734260058.510373:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000100:00000010:0.0:1734260063.515690:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734260063.515709:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 00000100:00000010:0.0:1734260063.515771:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734260063.515777:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734260063.515794:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260063.515801:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260063.515806:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260063.515812:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098328576, portal 25 00000400:00000010:3.0:1734260063.515815:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734260063.515817:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098328576, offset 0 00000400:00000200:3.0:1734260063.515824:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260063.515833:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260063.515837:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260063.515841:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260063.515844:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260063.515845:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260063.515848:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1299:1299:256:4294967295] 192.168.202.108@tcp LPNI seq info [1298:1298:8:4294967295] 00000400:00000200:3.0:1734260063.515860:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260063.515865:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260063.515869:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734260063.515872:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260063.515878:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260063.515880:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734260063.515905:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260063.515916:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260063.515921:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260063.515927:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098328704, portal 10 00000400:00000010:1.0:1734260063.515933:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720220. 00000100:00000200:1.0:1734260063.515935:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098328704, offset 0 00000400:00000200:1.0:1734260063.515941:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260063.515951:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260063.515955:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260063.515958:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260063.515960:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260063.515971:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260063.515973:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1300:1300:255:4294967295] 192.168.202.108@tcp LPNI seq info [1299:1299:7:4294967295] 00000800:00000200:0.0:1734260063.515974:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260063.515976:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734260063.515979:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260063.515981:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:0.0:1734260063.515982:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260063.515985:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734260063.515986:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000800:00000200:1.0:1734260063.515986:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260063.515989:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000100:00000200:0.0:1734260063.515991:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098328576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260079 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260063.515994:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260063.516000:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260063.516003:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260063.516032:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260063.516034:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734260063.516035:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260063.516037:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260063.516038:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720220 00000400:00000010:0.0:1734260063.516039:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720220. 00000100:00000200:0.0:1734260063.516042:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098328704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260073 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260063.517145:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260063.517155:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628800 00000400:00000200:0.0:1734260063.517160:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2989 [1] + 224 00000400:00000200:0.0:1734260063.517167:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260063.517169:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260063.517173:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098328576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260063.517199:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260063.517203:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628880 00000400:00000200:0.0:1734260063.517207:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2991 [1] + 0 00000400:00000200:0.0:1734260063.517217:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260063.517220:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:3.0:1734260063.517223:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260063.517228:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260063.517229:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734260063.517233:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098328704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260073 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260063.517233:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098328576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260079 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260063.517240:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098328576/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260079 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260063.517257:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260063.517262:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:3.0:1734260063.517264:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:1.0:1734260063.517295:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260063.517299:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260063.517300:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260063.517305:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098328704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260073 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260063.517312:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098328704/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260073 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260063.517328:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260063.517332:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734260063.517334:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734260068.523783:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734260068.523800:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734260068.523854:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734260068.523860:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734260068.523900:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734260068.523906:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260068.523910:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260068.523915:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098328832, portal 25 00000400:00000010:2.0:1734260068.523917:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e440. 00000100:00000200:2.0:1734260068.523919:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098328832, offset 0 00000400:00000200:2.0:1734260068.523925:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:1.0:1734260068.523928:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260068.523933:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000200:2.0:1734260068.523935:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734260068.523937:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260068.523939:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098328960, portal 10 00000400:00000200:2.0:1734260068.523939:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260068.523941:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:1.0:1734260068.523943:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720330. 00000400:00000200:2.0:1734260068.523943:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:1.0:1734260068.523944:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098328960, offset 0 00000400:00000200:2.0:1734260068.523945:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260068.523947:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1301:1301:256:4294967295] 192.168.202.108@tcp LPNI seq info [1300:1300:8:4294967295] 00000400:00000200:1.0:1734260068.523949:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260068.523952:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260068.523963:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260068.523965:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734260068.523966:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734260068.523967:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260068.523969:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734260068.523970:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260068.523971:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260068.523973:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:2.0:1734260068.523975:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260068.523978:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260068.523979:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1302:1302:255:4294967295] 192.168.202.108@tcp LPNI seq info [1301:1301:7:4294967295] 00000400:00000200:1.0:1734260068.523985:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260068.523989:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260068.523991:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734260068.523994:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260068.523998:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260068.524000:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260068.524340:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260068.524343:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734260068.524347:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260068.524352:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260068.524355:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e440 00000400:00000010:0.0:1734260068.524357:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e440. 00000100:00000200:0.0:1734260068.524363:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098328832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260084 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260068.524421:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260068.524423:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734260068.524426:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260068.524429:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260068.524431:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720330 00000400:00000010:0.0:1734260068.524432:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720330. 00000100:00000200:0.0:1734260068.524435:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098328960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260078 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260068.526159:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260068.526173:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628900 00000400:00000200:0.0:1734260068.526180:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2999 [1] + 224 00000400:00000200:0.0:1734260068.526190:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260068.526192:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260068.526199:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098328832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260084 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260068.526237:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260068.526241:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628980 00000400:00000200:0.0:1734260068.526254:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x29a1 [1] + 0 00000400:00000200:0.0:1734260068.526267:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260068.526270:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260068.526274:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098328960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260078 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260068.526324:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260068.526329:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260068.526330:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260068.526335:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098328832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260084 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260068.526341:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098328832/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260084 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260068.526358:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734260068.526362:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:2.0:1734260068.526365:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000010:1.0:1734260068.526408:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260068.526412:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260068.526413:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260068.526418:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098328960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260078 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260068.526424:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098328960/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260078 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260068.526439:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260068.526442:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734260068.526444:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734260073.531688:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734260073.531706:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734260073.531757:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734260073.531763:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:1.0:1734260073.531845:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 02000000:00000010:3.0:1734260073.531852:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:1.0:1734260073.531853:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260073.531859:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260073.531864:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000100:00000200:1.0:1734260073.531865:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098329216, portal 10 00000400:00000010:1.0:1734260073.531871:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720c38. 00000400:00000010:3.0:1734260073.531871:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734260073.531873:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098329216, offset 0 00000100:00000200:3.0:1734260073.531876:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098329088, portal 25 00000400:00000010:3.0:1734260073.531880:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000400:00000200:1.0:1734260073.531881:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734260073.531884:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098329088, offset 0 00000400:00000200:1.0:1734260073.531892:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260073.531893:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260073.531896:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260073.531900:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260073.531903:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260073.531905:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260073.531907:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1303:1303:256:4294967295] 192.168.202.108@tcp LPNI seq info [1302:1302:8:4294967295] 00000400:00000200:1.0:1734260073.531929:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260073.531935:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260073.531939:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000400:00000200:3.0:1734260073.531939:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734260073.531943:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260073.531943:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260073.531947:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260073.531949:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734260073.531950:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734260073.531952:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:1.0:1734260073.531954:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734260073.531954:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1304:1304:255:4294967295] 192.168.202.108@tcp LPNI seq info [1303:1303:7:4294967295] 00000400:00000200:3.0:1734260073.531961:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260073.531975:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260073.531978:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734260073.531983:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260073.531990:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260073.531993:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260073.532008:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260073.532011:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734260073.532015:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260073.532020:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260073.532023:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720c38 00000400:00000010:0.0:1734260073.532025:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720c38. 00000100:00000200:0.0:1734260073.532031:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098329216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260083 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260073.532090:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260073.532092:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734260073.532094:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260073.532097:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260073.532099:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:0.0:1734260073.532100:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734260073.532104:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098329088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260089 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260073.533406:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260073.533416:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628a80 00000400:00000200:0.0:1734260073.533421:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x29a9 [1] + 0 00000400:00000200:0.0:1734260073.533427:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260073.533429:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260073.533439:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098329216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260083 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260073.533463:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260073.533467:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628a00 00000400:00000200:0.0:1734260073.533471:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x29b1 [1] + 224 00000400:00000200:0.0:1734260073.533482:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260073.533485:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260073.533488:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098329088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260089 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260073.533493:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260073.533497:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260073.533498:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260073.533502:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098329216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260083 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260073.533508:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098329216/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260083 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260073.533528:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260073.533533:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734260073.533537:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:3.0:1734260073.533563:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260073.533593:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260073.533594:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260073.533600:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098329088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260089 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260073.533607:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098329088/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260089 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260073.533618:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260073.533622:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734260073.533623:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:0.0:1734260078.539722:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734260078.539740:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734260078.539871:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734260078.539877:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734260078.539952:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 02000000:00000010:1.0:1734260078.539959:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:3.0:1734260078.539959:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:1.0:1734260078.539963:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:3.0:1734260078.539964:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:1.0:1734260078.539965:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260078.539969:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098329472, portal 10 00000100:00000200:3.0:1734260078.539969:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098329344, portal 25 00000400:00000010:3.0:1734260078.539973:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000400:00000010:1.0:1734260078.539974:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37206e8. 00000100:00000200:1.0:1734260078.539975:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098329472, offset 0 00000100:00000200:3.0:1734260078.539975:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098329344, offset 0 00000400:00000200:3.0:1734260078.539982:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260078.539988:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260078.539993:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260078.539997:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260078.540000:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260078.540003:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260078.540005:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260078.540008:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1305:1305:256:4294967295] 192.168.202.108@tcp LPNI seq info [1304:1304:8:4294967295] 00000400:00000200:3.0:1734260078.540015:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734260078.540019:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260078.540020:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:3.0:1734260078.540020:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260078.540022:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260078.540023:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260078.540024:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260078.540026:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1306:1306:255:4294967295] 192.168.202.108@tcp LPNI seq info [1305:1305:7:4294967295] 00000400:00000200:1.0:1734260078.540031:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000010:3.0:1734260078.540031:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734260078.540036:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260078.540038:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260078.540040:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:3.0:1734260078.540042:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260078.540043:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260078.540045:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260078.540045:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260078.540047:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260078.540123:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260078.540125:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734260078.540129:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260078.540132:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260078.540135:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734260078.540137:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734260078.540143:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098329344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260094 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260078.540191:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260078.540192:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734260078.540194:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260078.540195:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260078.540196:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37206e8 00000400:00000010:0.0:1734260078.540197:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37206e8. 00000100:00000200:0.0:1734260078.540199:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098329472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260088 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260078.541794:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260078.541816:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628b00 00000400:00000200:0.0:1734260078.541828:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x29b9 [1] + 224 00000400:00000200:0.0:1734260078.541839:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260078.541841:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260078.541848:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098329344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260094 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260078.541883:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260078.541892:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628b80 00000400:00000200:0.0:1734260078.541896:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x29bd [1] + 0 00000400:00000200:0.0:1734260078.541910:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260078.541913:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260078.541917:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098329472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260088 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260078.541949:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260078.541958:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260078.541961:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260078.541970:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098329344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260094 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260078.541978:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098329344/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260094 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260078.541997:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260078.542001:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260078.542003:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 02000000:00000010:3.0:1734260078.542004:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 00000100:00000200:1.0:1734260078.542007:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098329472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260088 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260078.542011:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000200:1.0:1734260078.542013:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098329472/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260088 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:3.0:1734260078.542015:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 02000000:00000010:1.0:1734260078.542039:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260078.542043:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734260078.542048:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:0.0:1734260083.547696:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734260083.547717:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734260083.547764:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734260083.547769:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734260083.547805:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734260083.547813:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260083.547818:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260083.547824:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098329600, portal 25 00000400:00000010:2.0:1734260083.547827:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ef68. 00000100:00000200:2.0:1734260083.547829:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098329600, offset 0 00000400:00000200:2.0:1734260083.547835:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260083.547846:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260083.547851:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260083.547854:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260083.547856:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260083.547858:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260083.547861:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1307:1307:256:4294967295] 192.168.202.108@tcp LPNI seq info [1306:1306:8:4294967295] 00000400:00000200:2.0:1734260083.547868:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260083.547872:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260083.547884:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734260083.547888:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260083.547895:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260083.547898:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734260083.547979:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260083.547983:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260083.547986:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260083.547988:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098329728, portal 10 00000400:00000010:1.0:1734260083.547992:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37204c8. 00000100:00000200:1.0:1734260083.547994:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098329728, offset 0 00000400:00000200:1.0:1734260083.547997:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260083.548002:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260083.548004:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260083.548006:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260083.548008:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260083.548009:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260083.548011:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1308:1308:255:4294967295] 192.168.202.108@tcp LPNI seq info [1307:1307:7:4294967295] 00000400:00000200:1.0:1734260083.548017:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260083.548020:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260083.548027:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734260083.548030:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260083.548034:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260083.548035:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260083.548824:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260083.548828:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734260083.548832:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260083.548837:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260083.548841:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ef68 00000400:00000010:0.0:1734260083.548842:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ef68. 00000100:00000200:0.0:1734260083.548848:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098329600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260099 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260083.549044:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260083.549047:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734260083.549049:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260083.549052:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260083.549055:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37204c8 00000400:00000010:0.0:1734260083.549061:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37204c8. 00000100:00000200:0.0:1734260083.549065:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098329728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260093 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260083.549638:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260083.549648:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628c00 00000400:00000200:0.0:1734260083.549654:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x29c9 [1] + 224 00000400:00000200:0.0:1734260083.549667:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260083.549670:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260083.549675:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098329600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260099 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260083.549734:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260083.549738:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260083.549739:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260083.549743:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098329600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260099 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260083.549749:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098329600/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260099 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260083.549764:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734260083.549767:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:2.0:1734260083.549771:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000400:00000200:0.0:1734260083.550383:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260083.550390:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628c80 00000400:00000200:0.0:1734260083.550394:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x29d1 [1] + 0 00000400:00000200:0.0:1734260083.550404:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260083.550408:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260083.550413:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098329728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260093 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260083.550641:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260083.550646:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260083.550647:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260083.550651:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098329728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260093 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260083.550658:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098329728/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260093 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260083.550674:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260083.550678:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734260083.550681:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000100:00000010:0.0:1734260088.555686:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734260088.555704:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4400. 00000100:00000010:0.0:1734260088.555754:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734260088.555760:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:3.0:1734260088.555821:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260088.555834:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260088.555842:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260088.555849:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098329856, portal 25 00000400:00000010:3.0:1734260088.555854:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 02000000:00000010:1.0:1734260088.555856:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000100:00000200:3.0:1734260088.555856:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098329856, offset 0 00000400:00000010:1.0:1734260088.555863:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000200:3.0:1734260088.555865:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734260088.555871:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260088.555877:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098329984, portal 10 00000400:00000200:3.0:1734260088.555878:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734260088.555882:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37205d8. 00000100:00000200:1.0:1734260088.555884:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098329984, offset 0 00000400:00000200:3.0:1734260088.555884:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260088.555888:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260088.555890:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260088.555892:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260088.555894:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260088.555896:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1309:1309:256:4294967295] 192.168.202.108@tcp LPNI seq info [1308:1308:8:4294967295] 00000400:00000200:3.0:1734260088.555904:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260088.555910:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260088.555913:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260088.555914:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000400:00000200:1.0:1734260088.555917:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260088.555920:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260088.555923:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260088.555925:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260088.555927:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1310:1310:255:4294967295] 192.168.202.108@tcp LPNI seq info [1309:1309:7:4294967295] 00000800:00000200:3.0:1734260088.555934:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260088.555935:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260088.555939:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260088.555943:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:3.0:1734260088.555943:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260088.555947:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260088.555958:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260088.555965:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260088.555968:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260088.556060:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260088.556063:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734260088.556068:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260088.556073:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260088.556077:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734260088.556079:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734260088.556087:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098329856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260104 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260088.556169:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260088.556171:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734260088.556174:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260088.556177:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260088.556179:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37205d8 00000400:00000010:0.0:1734260088.556180:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37205d8. 00000100:00000200:0.0:1734260088.556185:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098329984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260098 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260088.557995:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260088.558012:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628d00 00000400:00000200:0.0:1734260088.558020:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x29d9 [1] + 224 00000400:00000200:0.0:1734260088.558031:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260088.558034:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260088.558042:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098329856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260104 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260088.558077:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260088.558081:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628d80 00000400:00000200:0.0:1734260088.558085:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x29e1 [1] + 0 00000400:00000200:0.0:1734260088.558101:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260088.558105:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260088.558109:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098329984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260098 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260088.558223:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260088.558231:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260088.558233:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260088.558241:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098329984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260098 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260088.558250:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098329984/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260098 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260088.558274:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260088.558279:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734260088.558283:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000400:00000010:3.0:1734260088.558302:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260088.558306:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260088.558308:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260088.558313:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098329856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260104 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260088.558320:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098329856/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260104 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260088.558332:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260088.558335:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4400. 00000100:00000010:3.0:1734260088.558338:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734260093.563787:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734260093.563806:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734260093.563858:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734260093.563864:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:2.0:1734260093.563886:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 00000400:00000010:2.0:1734260093.563894:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260093.563900:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260093.563905:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098330112, portal 25 00000400:00000010:2.0:1734260093.563909:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eee0. 00000100:00000200:2.0:1734260093.563911:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098330112, offset 0 00000400:00000200:2.0:1734260093.563918:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260093.563929:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260093.563933:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260093.563937:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260093.563940:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260093.563942:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260093.563944:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1311:1311:256:4294967295] 192.168.202.108@tcp LPNI seq info [1310:1310:8:4294967295] 00000400:00000200:2.0:1734260093.563952:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260093.563956:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260093.563960:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734260093.563975:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260093.563981:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260093.563985:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734260093.564153:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260093.564157:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260093.564161:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260093.564165:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098330240, portal 10 00000400:00000010:1.0:1734260093.564168:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000100:00000200:1.0:1734260093.564169:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098330240, offset 0 00000400:00000200:1.0:1734260093.564173:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260093.564178:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260093.564180:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260093.564182:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260093.564184:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260093.564185:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260093.564187:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1312:1312:255:4294967295] 192.168.202.108@tcp LPNI seq info [1311:1311:7:4294967295] 00000400:00000200:1.0:1734260093.564192:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260093.564195:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260093.564198:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734260093.564200:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260093.564208:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260093.564210:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260093.564224:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260093.564227:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734260093.564235:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260093.564239:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260093.564242:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eee0 00000400:00000010:0.0:1734260093.564243:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eee0. 00000100:00000200:0.0:1734260093.564249:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098330112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260109 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260093.564356:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260093.564358:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734260093.564361:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260093.564363:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260093.564366:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734260093.564367:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734260093.564370:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098330240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260103 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260093.566694:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260093.566707:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628e00 00000400:00000200:0.0:1734260093.566714:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x29e9 [1] + 224 00000400:00000200:0.0:1734260093.566724:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260093.566727:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260093.566735:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098330112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260109 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260093.566772:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260093.566776:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628e80 00000400:00000200:0.0:1734260093.566780:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x29f1 [1] + 0 00000400:00000200:0.0:1734260093.566794:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260093.566797:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260093.566801:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098330240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260103 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260093.566806:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260093.566811:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260093.566813:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260093.566818:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098330112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260109 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260093.566825:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098330112/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260109 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260093.566842:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734260093.566846:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:2.0:1734260093.566848:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:1.0:1734260093.566877:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260093.566880:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260093.566881:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260093.566885:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098330240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260103 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260093.566890:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098330240/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260103 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260093.566906:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260093.566910:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734260093.566913:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:0.0:1734260098.571683:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734260098.571712:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734260098.571770:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734260098.571776:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:2.0:1734260098.571849:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bd600. 02000000:00000010:1.0:1734260098.571856:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:2.0:1734260098.571856:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:1.0:1734260098.571860:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:2.0:1734260098.571862:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000400:00000010:1.0:1734260098.571864:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260098.571867:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098330496, portal 10 00000100:00000200:2.0:1734260098.571867:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098330368, portal 25 00000400:00000010:2.0:1734260098.571870:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ed48. 00000400:00000010:1.0:1734260098.571871:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734260098.571872:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098330496, offset 0 00000100:00000200:2.0:1734260098.571872:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098330368, offset 0 00000400:00000200:1.0:1734260098.571878:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260098.571883:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260098.571887:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260098.571890:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260098.571893:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260098.571895:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260098.571897:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260098.571899:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1313:1313:256:4294967295] 192.168.202.108@tcp LPNI seq info [1312:1312:8:4294967295] 00000400:00000200:1.0:1734260098.571904:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260098.571907:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260098.571909:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734260098.571910:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000400:00000200:2.0:1734260098.571912:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734260098.571913:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734260098.571914:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260098.571915:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260098.571917:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260098.571919:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1314:1314:255:4294967295] 192.168.202.108@tcp LPNI seq info [1313:1313:7:4294967295] 00000800:00000200:1.0:1734260098.571920:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734260098.571925:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260098.571926:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260098.571929:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260098.571931:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734260098.571934:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260098.571941:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260098.571943:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260098.571992:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260098.571995:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734260098.571999:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260098.572003:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260098.572007:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:0.0:1734260098.572009:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:0.0:1734260098.572015:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098330496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260108 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260098.572070:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260098.572072:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734260098.572075:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260098.572078:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260098.572080:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ed48 00000400:00000010:0.0:1734260098.572081:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ed48. 00000100:00000200:0.0:1734260098.572084:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098330368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260114 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260098.573342:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260098.573355:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c628f00 00000400:00000200:0.0:1734260098.573361:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x29f9 [1] + 224 00000400:00000200:0.0:1734260098.573370:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260098.573373:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260098.573380:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098330368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260114 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260098.573413:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260098.573417:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c628f80 00000400:00000200:0.0:1734260098.573420:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x29fd [1] + 0 00000400:00000200:0.0:1734260098.573435:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260098.573443:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:2.0:1734260098.573447:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260098.573451:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260098.573453:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:0.0:1734260098.573457:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098330496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260108 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260098.573458:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098330368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260114 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260098.573465:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098330368/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260114 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260098.573494:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bd600. 02000000:00000010:2.0:1734260098.573498:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:2.0:1734260098.573500:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000400:00000010:1.0:1734260098.573519:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260098.573522:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260098.573523:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260098.573528:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098330496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260108 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260098.573534:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098330496/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260108 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260098.573549:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260098.573552:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734260098.573555:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000100:00000010:0.0:1734260103.579695:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734260103.579714:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4200. 00000100:00000010:0.0:1734260103.579850:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734260103.579857:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:3.0:1734260103.579948:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260103.579954:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260103.579959:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260103.579965:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098330624, portal 25 00000400:00000010:3.0:1734260103.579969:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000100:00000200:3.0:1734260103.579971:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098330624, offset 0 00000400:00000200:3.0:1734260103.579980:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260103.579990:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260103.579994:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260103.579998:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260103.580000:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260103.580002:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260103.580004:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1315:1315:256:4294967295] 192.168.202.108@tcp LPNI seq info [1314:1314:8:4294967295] 00000400:00000200:3.0:1734260103.580011:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260103.580015:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260103.580018:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734260103.580023:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260103.580039:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260103.580042:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734260103.580129:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260103.580134:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260103.580137:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260103.580140:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098330752, portal 10 00000400:00000010:1.0:1734260103.580144:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:1.0:1734260103.580145:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098330752, offset 0 00000400:00000200:1.0:1734260103.580149:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260103.580153:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260103.580155:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260103.580157:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260103.580159:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260103.580160:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260103.580162:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1316:1316:255:4294967295] 192.168.202.108@tcp LPNI seq info [1315:1315:7:4294967295] 00000400:00000200:1.0:1734260103.580168:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260103.580171:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260103.580173:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734260103.580175:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260103.580179:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260103.580180:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260103.580240:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260103.580242:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734260103.580246:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260103.580249:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260103.580252:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734260103.580252:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734260103.580257:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098330624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260119 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260103.580305:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260103.580306:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734260103.580307:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260103.580309:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260103.580310:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:0.0:1734260103.580311:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734260103.580312:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098330752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260113 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260103.581860:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260103.581873:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629000 00000400:00000200:0.0:1734260103.581879:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a09 [1] + 224 00000400:00000200:0.0:1734260103.581888:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260103.581891:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260103.581899:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098330624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260119 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260103.581931:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260103.581943:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629080 00000400:00000200:0.0:1734260103.581947:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2a11 [1] + 0 00000400:00000200:0.0:1734260103.581960:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260103.581963:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260103.581967:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098330752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260113 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260103.582026:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260103.582034:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260103.582035:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260103.582041:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098330752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260113 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260103.582048:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098330752/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260113 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260103.582050:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260103.582053:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260103.582054:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260103.582057:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098330624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260119 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260103.582062:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098330624/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260119 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260103.582069:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:3.0:1734260103.582072:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:1.0:1734260103.582073:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 00000100:00000010:1.0:1734260103.582076:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 02000000:00000010:3.0:1734260103.582076:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4200. 00000100:00000010:3.0:1734260103.582077:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734260108.587705:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734260108.587724:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734260108.587778:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734260108.587784:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734260108.587842:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260108.587854:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260108.587862:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260108.587869:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098330880, portal 25 02000000:00000010:1.0:1734260108.587870:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:3.0:1734260108.587874:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000400:00000010:1.0:1734260108.587876:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000100:00000200:3.0:1734260108.587876:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098330880, offset 0 00000400:00000010:1.0:1734260108.587881:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000200:3.0:1734260108.587885:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:1.0:1734260108.587893:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098331008, portal 10 00000400:00000010:1.0:1734260108.587898:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000100:00000200:1.0:1734260108.587900:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098331008, offset 0 00000400:00000200:3.0:1734260108.587900:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260108.587906:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260108.587907:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260108.587910:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260108.587913:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260108.587915:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260108.587918:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1317:1317:256:4294967295] 192.168.202.108@tcp LPNI seq info [1316:1316:8:4294967295] 00000400:00000200:3.0:1734260108.587927:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260108.587932:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260108.587936:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260108.587936:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000400:00000200:1.0:1734260108.587941:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:3.0:1734260108.587942:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260108.587944:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260108.587947:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260108.587948:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260108.587951:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1318:1318:255:4294967295] 192.168.202.108@tcp LPNI seq info [1317:1317:7:4294967295] 00000800:00000200:3.0:1734260108.587951:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260108.587959:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260108.587964:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260108.587967:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:3.0:1734260108.587969:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260108.587976:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260108.587983:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260108.587986:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260108.588060:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260108.588063:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734260108.588068:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260108.588073:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260108.588077:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734260108.588078:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734260108.588091:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098330880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260124 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260108.588166:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260108.588168:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734260108.588170:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260108.588174:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260108.588176:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:0.0:1734260108.588177:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:0.0:1734260108.588181:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098331008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260118 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260108.589616:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260108.589631:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629100 00000400:00000200:0.0:1734260108.589638:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a19 [1] + 224 00000400:00000200:0.0:1734260108.589646:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260108.589655:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260108.589661:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098330880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260124 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260108.589694:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260108.589698:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629180 00000400:00000200:0.0:1734260108.589702:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2a21 [1] + 0 00000400:00000200:0.0:1734260108.589715:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260108.589718:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260108.589723:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098331008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260118 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260108.589782:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260108.589793:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260108.589794:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260108.589798:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098331008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260118 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260108.589798:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260108.589802:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260108.589803:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734260108.589806:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098331008/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260118 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260108.589808:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098330880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260124 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260108.589815:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098330880/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260124 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:1.0:1734260108.589827:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 02000000:00000010:3.0:1734260108.589830:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:1.0:1734260108.589835:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:3.0:1734260108.589836:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 02000000:00000010:1.0:1734260108.589840:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:3.0:1734260108.589841:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:1.0:1734260108.589843:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000100:00000010:0.0:1734260113.595733:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734260113.595757:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4a00. 02000000:00000010:2.0:1734260113.596005:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000100:00000010:0.0:1734260113.596008:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 00000400:00000010:2.0:1734260113.596011:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 02000000:00000010:0.0:1734260113.596015:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 00000400:00000010:2.0:1734260113.596017:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260113.596023:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098331136, portal 25 00000400:00000010:2.0:1734260113.596026:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e660. 00000100:00000200:2.0:1734260113.596028:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098331136, offset 0 00000400:00000200:2.0:1734260113.596035:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260113.596045:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260113.596050:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260113.596054:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260113.596056:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260113.596058:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260113.596061:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1319:1319:256:4294967295] 192.168.202.108@tcp LPNI seq info [1318:1318:8:4294967295] 00000400:00000200:2.0:1734260113.596068:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260113.596074:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260113.596077:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 02000000:00000010:1.0:1734260113.596079:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000800:00000200:2.0:1734260113.596082:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:1.0:1734260113.596084:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260113.596087:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000800:00000200:2.0:1734260113.596087:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:1.0:1734260113.596090:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098331264, portal 10 00000400:00000010:1.0:1734260113.596094:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734260113.596095:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098331264, offset 0 00000800:00000200:2.0:1734260113.596098:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260113.596099:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260113.596104:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260113.596106:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260113.596108:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260113.596109:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260113.596111:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260113.596113:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1320:1320:255:4294967295] 192.168.202.108@tcp LPNI seq info [1319:1319:7:4294967295] 00000400:00000200:1.0:1734260113.596118:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260113.596121:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260113.596124:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734260113.596126:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260113.596129:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260113.596131:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260113.596158:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260113.596160:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734260113.596166:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260113.596169:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260113.596172:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e660 00000400:00000010:0.0:1734260113.596173:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e660. 00000100:00000200:0.0:1734260113.596178:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098331136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260129 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260113.596234:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260113.596236:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734260113.596239:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260113.596241:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260113.596243:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:0.0:1734260113.596244:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:0.0:1734260113.596247:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098331264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260123 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260113.597687:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260113.597707:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629200 00000400:00000200:0.0:1734260113.597714:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a29 [1] + 224 00000400:00000200:0.0:1734260113.597724:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260113.597726:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260113.597738:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098331136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260129 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260113.597768:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260113.597772:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629280 00000400:00000200:0.0:1734260113.597775:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2a31 [1] + 0 00000400:00000200:0.0:1734260113.597788:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260113.597791:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260113.597795:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098331264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260123 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260113.597806:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260113.597811:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260113.597813:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260113.597818:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098331136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260129 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260113.597825:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098331136/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260129 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260113.597841:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260113.597845:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4a00. 00000100:00000010:2.0:1734260113.597848:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000010:1.0:1734260113.598004:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260113.598016:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260113.598017:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260113.598021:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098331264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260123 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260113.598028:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098331264/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260123 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260113.598044:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260113.598047:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734260113.598049:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734260118.604165:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734260118.604183:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4500. 00000100:00000010:0.0:1734260118.604231:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734260118.604235:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:2.0:1734260118.604312:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734260118.604317:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260118.604323:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260118.604329:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098331392, portal 25 00000400:00000010:2.0:1734260118.604333:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e550. 00000100:00000200:2.0:1734260118.604345:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098331392, offset 0 02000000:00000010:1.0:1734260118.604351:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:2.0:1734260118.604354:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734260118.604356:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260118.604359:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260118.604362:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098331520, portal 10 00000400:00000200:2.0:1734260118.604365:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734260118.604366:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:1.0:1734260118.604367:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098331520, offset 0 00000400:00000200:2.0:1734260118.604371:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260118.604372:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260118.604374:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260118.604377:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260118.604379:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260118.604442:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1321:1321:256:4294967295] 192.168.202.108@tcp LPNI seq info [1320:1320:8:4294967295] 00000400:00000200:2.0:1734260118.604450:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260118.604455:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260118.604458:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734260118.604463:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260118.604470:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260118.604473:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260118.604619:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:0.0:1734260118.604620:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:1.0:1734260118.604622:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734260118.604623:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:1.0:1734260118.604624:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260118.604626:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260118.604626:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260118.604628:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260118.604630:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260118.604630:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1322:1322:255:4294967295] 192.168.202.108@tcp LPNI seq info [1321:1321:7:4294967295] 00000400:00000200:0.0:1734260118.604634:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e550 00000400:00000010:0.0:1734260118.604635:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e550. 00000400:00000200:1.0:1734260118.604636:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260118.604640:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734260118.604641:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098331392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260134 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000010:1.0:1734260118.604643:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734260118.604646:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260118.604649:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260118.604651:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260118.604712:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260118.604714:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:2.0:1734260118.604716:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260118.604719:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260118.604721:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:2.0:1734260118.604722:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:2.0:1734260118.604726:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098331520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260128 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260118.606229:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260118.606242:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629300 00000400:00000200:0.0:1734260118.606247:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a39 [1] + 224 00000400:00000200:0.0:1734260118.606255:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260118.606265:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260118.606272:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098331392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260134 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260118.606308:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260118.606312:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629380 00000400:00000200:0.0:1734260118.606316:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2a41 [1] + 0 00000400:00000200:0.0:1734260118.606327:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260118.606330:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260118.606334:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098331520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260128 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260118.606431:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260118.606435:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260118.606436:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260118.606440:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098331392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260134 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260118.606446:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098331392/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260134 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260118.606464:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260118.606467:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4500. 00000100:00000010:2.0:1734260118.606470:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:1.0:1734260118.606533:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260118.606536:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260118.606541:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260118.606545:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098331520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260128 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260118.606551:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098331520/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260128 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260118.606565:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260118.606585:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734260118.606588:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734260123.611718:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3b80. 02000000:00000010:0.0:1734260123.611736:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4d00. 00000100:00000010:0.0:1734260123.611796:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3480. 02000000:00000010:0.0:1734260123.611802:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:2.0:1734260123.611850:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734260123.611856:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260123.611861:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260123.611868:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098331648, portal 25 00000400:00000010:2.0:1734260123.611871:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ebb0. 00000100:00000200:2.0:1734260123.611873:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098331648, offset 0 00000400:00000200:2.0:1734260123.611881:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260123.611892:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260123.611895:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260123.611899:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260123.611902:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260123.611904:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260123.611906:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1323:1323:256:4294967295] 192.168.202.108@tcp LPNI seq info [1322:1322:8:4294967295] 00000400:00000200:2.0:1734260123.611913:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260123.611927:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260123.611930:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734260123.611935:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:1.0:1734260123.611938:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000800:00000200:2.0:1734260123.611941:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:1.0:1734260123.611942:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000800:00000200:2.0:1734260123.611944:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:1.0:1734260123.611946:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260123.611948:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098331776, portal 10 00000400:00000010:1.0:1734260123.611952:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734260123.611954:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098331776, offset 0 00000400:00000200:1.0:1734260123.611961:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260123.611966:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260123.611968:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260123.611970:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260123.611972:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260123.611973:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260123.611975:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1324:1324:255:4294967295] 192.168.202.108@tcp LPNI seq info [1323:1323:7:4294967295] 00000800:00000200:0.0:1734260123.612040:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260123.612043:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734260123.612047:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260123.612051:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260123.612054:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ebb0 00000400:00000010:0.0:1734260123.612056:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ebb0. 00000100:00000200:0.0:1734260123.612062:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3b80 x1818500098331648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260139 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734260123.612067:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260123.612071:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260123.612073:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734260123.612076:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260123.612079:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260123.612081:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260123.612138:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260123.612140:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:2.0:1734260123.612143:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260123.612145:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260123.612147:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:2.0:1734260123.612148:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:2.0:1734260123.612152:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3480 x1818500098331776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260133 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260123.613610:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260123.613622:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629480 00000400:00000200:0.0:1734260123.613629:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2a51 [1] + 0 00000400:00000200:0.0:1734260123.613637:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260123.613640:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260123.613646:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3480 x1818500098331776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260133 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260123.613692:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260123.613696:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629400 00000400:00000200:0.0:1734260123.613701:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a49 [1] + 224 00000400:00000200:0.0:1734260123.613711:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260123.613714:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260123.613719:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3b80 x1818500098331648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260139 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260123.613796:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260123.613800:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260123.613801:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260123.613810:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3480 x1818500098331776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260133 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260123.613816:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3480 x1818500098331776/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260133 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260123.613837:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260123.613841:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:1.0:1734260123.613845:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3480. 00000400:00000010:2.0:1734260123.613902:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260123.613906:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260123.613907:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260123.613910:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3b80 x1818500098331648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260139 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260123.613916:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3b80 x1818500098331648/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260139 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260123.613925:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260123.613927:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4d00. 00000100:00000010:2.0:1734260123.613929:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3b80. 00000100:00000010:0.0:1734260128.619689:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2a00. 02000000:00000010:0.0:1734260128.619708:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734260128.619754:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3800. 02000000:00000010:0.0:1734260128.619760:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732400. 02000000:00000010:3.0:1734260128.619774:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260128.619782:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260128.619787:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260128.619792:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098331904, portal 25 00000400:00000010:3.0:1734260128.619795:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000100:00000200:3.0:1734260128.619796:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098331904, offset 0 00000400:00000200:3.0:1734260128.619803:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260128.619811:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260128.619815:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260128.619818:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260128.619821:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260128.619822:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260128.619824:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1325:1325:256:4294967295] 192.168.202.108@tcp LPNI seq info [1324:1324:8:4294967295] 00000400:00000200:3.0:1734260128.619829:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260128.619832:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260128.619834:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734260128.619839:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:1.0:1734260128.619844:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000800:00000200:3.0:1734260128.619844:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260128.619847:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:1.0:1734260128.619848:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260128.619852:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260128.619854:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098332032, portal 10 00000400:00000010:1.0:1734260128.619858:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734260128.619859:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098332032, offset 0 00000400:00000200:1.0:1734260128.619863:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260128.619867:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260128.619870:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260128.619872:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260128.619874:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260128.619875:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260128.619877:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1326:1326:255:4294967295] 192.168.202.108@tcp LPNI seq info [1325:1325:7:4294967295] 00000400:00000200:1.0:1734260128.619883:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260128.619886:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260128.619889:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734260128.619892:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260128.619895:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260128.619898:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260128.619955:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260128.619957:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734260128.619961:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260128.619964:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260128.619966:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734260128.619967:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734260128.619972:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2a00 x1818500098331904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260144 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260128.620019:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260128.620021:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734260128.620022:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260128.620024:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260128.620025:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734260128.620025:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734260128.620027:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3800 x1818500098332032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260138 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260128.621644:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260128.621658:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629580 00000400:00000200:0.0:1734260128.621671:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2a61 [1] + 0 00000400:00000200:0.0:1734260128.621680:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260128.621683:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260128.621691:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3800 x1818500098332032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260138 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260128.621755:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260128.621759:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260128.621761:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260128.621766:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3800 x1818500098332032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260138 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260128.621776:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3800 x1818500098332032/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260138 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260128.621798:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260128.621802:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732400. 00000100:00000010:1.0:1734260128.621806:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3800. 00000400:00000200:0.0:1734260128.622381:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260128.622387:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629500 00000400:00000200:0.0:1734260128.622393:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a59 [1] + 224 00000400:00000200:0.0:1734260128.622404:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260128.622406:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260128.622411:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2a00 x1818500098331904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260144 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260128.622461:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260128.622464:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260128.622465:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260128.622468:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2a00 x1818500098331904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260144 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260128.622472:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2a00 x1818500098331904/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260144 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260128.622480:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260128.622484:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:3.0:1734260128.622485:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2a00. 00000100:00000010:0.0:1734260133.627683:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe3100. 02000000:00000010:0.0:1734260133.627703:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734260133.627760:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2d80. 02000000:00000010:0.0:1734260133.627766:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733000. 02000000:00000010:2.0:1734260133.627868:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734260133.627875:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260133.627880:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260133.627887:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098332160, portal 25 00000400:00000010:2.0:1734260133.627890:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e2a8. 00000100:00000200:2.0:1734260133.627892:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098332160, offset 0 00000400:00000200:2.0:1734260133.627900:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260133.627912:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260133.627926:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260133.627930:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260133.627932:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260133.627934:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260133.627936:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1327:1327:256:4294967295] 192.168.202.108@tcp LPNI seq info [1326:1326:8:4294967295] 00000400:00000200:2.0:1734260133.627944:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260133.627948:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260133.627952:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734260133.627956:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260133.627962:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260133.627966:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:1.0:1734260133.628042:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260133.628046:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260133.628049:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260133.628051:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098332288, portal 10 00000400:00000010:1.0:1734260133.628055:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734260133.628056:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098332288, offset 0 00000400:00000200:1.0:1734260133.628060:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260133.628064:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260133.628066:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260133.628068:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260133.628069:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260133.628071:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260133.628073:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1328:1328:255:4294967295] 192.168.202.108@tcp LPNI seq info [1327:1327:7:4294967295] 00000400:00000200:1.0:1734260133.628078:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260133.628081:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260133.628084:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734260133.628087:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260133.628090:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260133.628091:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260133.628197:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260133.628200:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734260133.628204:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260133.628208:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260133.628211:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e2a8 00000400:00000010:0.0:1734260133.628213:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e2a8. 00000100:00000200:0.0:1734260133.628219:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe3100 x1818500098332160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260149 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260133.628281:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260133.628283:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734260133.628285:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260133.628287:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260133.628289:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:0.0:1734260133.628290:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:0.0:1734260133.628298:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2d80 x1818500098332288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260143 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260133.630335:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260133.630350:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629600 00000400:00000200:0.0:1734260133.630357:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a69 [1] + 224 00000400:00000200:0.0:1734260133.630366:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260133.630369:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260133.630377:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe3100 x1818500098332160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260149 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260133.630411:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260133.630415:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629680 00000400:00000200:0.0:1734260133.630418:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2a71 [1] + 0 00000400:00000200:0.0:1734260133.630431:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260133.630433:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260133.630438:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2d80 x1818500098332288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260143 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260133.630530:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260133.630534:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260133.630536:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260133.630540:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe3100 x1818500098332160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260149 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260133.630546:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe3100 x1818500098332160/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260149 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260133.630563:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260133.630567:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:2.0:1734260133.630592:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe3100. 00000400:00000010:1.0:1734260133.630640:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260133.630644:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260133.630645:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260133.630650:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2d80 x1818500098332288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260143 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260133.630669:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2d80 x1818500098332288/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260143 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260133.630685:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260133.630688:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733000. 00000100:00000010:1.0:1734260133.630690:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2d80. 00000100:00000010:0.0:1734260138.635684:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2300. 02000000:00000010:0.0:1734260138.635703:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734260138.635757:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe2680. 02000000:00000010:0.0:1734260138.635763:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:1.0:1734260138.635846:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 02000000:00000010:2.0:1734260138.635847:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:1.0:1734260138.635853:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:2.0:1734260138.635853:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260138.635858:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000400:00000010:1.0:1734260138.635859:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260138.635865:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098332544, portal 10 00000400:00000010:1.0:1734260138.635871:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734260138.635938:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098332544, offset 0 00000100:00000200:2.0:1734260138.635939:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098332416, portal 25 00000400:00000010:2.0:1734260138.635943:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e770. 00000400:00000200:1.0:1734260138.635947:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734260138.635950:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098332416, offset 0 00000400:00000200:2.0:1734260138.635955:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260138.635963:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260138.635968:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260138.635971:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260138.635974:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260138.635976:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260138.635979:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1329:1329:256:4294967295] 192.168.202.108@tcp LPNI seq info [1328:1328:8:4294967295] 00000400:00000200:1.0:1734260138.635987:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260138.635992:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260138.635993:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734260138.635996:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000400:00000200:2.0:1734260138.635996:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1734260138.636002:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260138.636009:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734260138.636010:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260138.636011:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734260138.636012:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734260138.636013:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260138.636015:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1330:1330:255:4294967295] 192.168.202.108@tcp LPNI seq info [1329:1329:7:4294967295] 00000400:00000200:2.0:1734260138.636022:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260138.636025:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260138.636028:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734260138.636035:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260138.636039:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260138.636041:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260138.636075:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260138.636078:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734260138.636082:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260138.636087:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260138.636090:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:0.0:1734260138.636092:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:0.0:1734260138.636097:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2680 x1818500098332544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260148 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260138.636149:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260138.636155:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734260138.636158:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260138.636161:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260138.636162:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e770 00000400:00000010:0.0:1734260138.636164:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e770. 00000100:00000200:0.0:1734260138.636168:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe2300 x1818500098332416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260154 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260138.637412:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260138.637424:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629780 00000400:00000200:0.0:1734260138.637429:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2a79 [1] + 0 00000400:00000200:0.0:1734260138.637438:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260138.637440:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260138.637446:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2680 x1818500098332544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260138.637482:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260138.637487:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629700 00000400:00000200:0.0:1734260138.637490:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a7d [1] + 224 00000400:00000200:0.0:1734260138.637505:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260138.637508:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260138.637512:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe2300 x1818500098332416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260154 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260138.637591:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260138.637595:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260138.637596:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260138.637600:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2680 x1818500098332544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260148 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260138.637602:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260138.637605:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260138.637605:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260138.637608:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe2300 x1818500098332416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260154 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260138.637614:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2300 x1818500098332416/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260154 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260138.637615:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe2680 x1818500098332544/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260148 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260138.637630:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:2.0:1734260138.637630:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:1.0:1734260138.637634:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734260138.637634:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:1.0:1734260138.637636:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2680. 00000100:00000010:2.0:1734260138.637636:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe2300. 00000100:00000010:0.0:1734260143.643705:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1c00. 02000000:00000010:0.0:1734260143.643724:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4100. 00000100:00000010:0.0:1734260143.644612:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1500. 02000000:00000010:0.0:1734260143.644620:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734260143.644690:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260143.644697:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260143.644703:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260143.644708:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098332800, portal 10 00000400:00000010:1.0:1734260143.644713:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734260143.644715:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098332800, offset 0 02000000:00000010:2.0:1734260143.644720:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000200:1.0:1734260143.644722:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734260143.644724:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260143.644727:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260143.644730:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098332672, portal 25 00000400:00000200:1.0:1734260143.644732:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:2.0:1734260143.644732:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e088. 00000100:00000200:2.0:1734260143.644734:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098332672, offset 0 00000400:00000200:1.0:1734260143.644736:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260143.644738:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260143.644739:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260143.644742:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260143.644744:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260143.644747:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1331:1331:256:4294967295] 192.168.202.108@tcp LPNI seq info [1330:1330:8:4294967295] 00000400:00000200:1.0:1734260143.644753:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260143.644757:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260143.644759:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734260143.644760:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000400:00000200:2.0:1734260143.644761:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260143.644763:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734260143.644765:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734260143.644765:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734260143.644770:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260143.644773:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734260143.644777:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260143.644779:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1332:1332:255:4294967295] 192.168.202.108@tcp LPNI seq info [1331:1331:7:4294967295] 00000400:00000200:2.0:1734260143.644785:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260143.644879:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260143.644882:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734260143.644885:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260143.644888:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260143.644891:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:0.0:1734260143.644896:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:0.0:1734260143.644903:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1500 x1818500098332800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260153 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734260143.644938:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260143.644941:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734260143.644944:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260143.644948:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260143.644950:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260143.645002:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260143.645004:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734260143.645006:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260143.645009:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260143.645011:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e088 00000400:00000010:0.0:1734260143.645012:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e088. 00000100:00000200:0.0:1734260143.645015:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1c00 x1818500098332672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260159 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260143.647176:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260143.647189:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629800 00000400:00000200:0.0:1734260143.647196:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a91 [1] + 224 00000400:00000200:0.0:1734260143.647206:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260143.647208:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260143.647216:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1c00 x1818500098332672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260159 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260143.647376:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000010:2.0:1734260143.647379:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:0.0:1734260143.647381:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629880 00000400:00000200:2.0:1734260143.647383:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260143.647384:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260143.647388:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1c00 x1818500098332672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260159 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260143.647390:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2a89 [1] + 0 00000100:00000200:2.0:1734260143.647395:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1c00 x1818500098332672/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260159 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260143.647404:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260143.647406:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260143.647410:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1500 x1818500098332800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260143.647411:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260143.647414:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4100. 00000100:00000010:2.0:1734260143.647417:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1c00. 00000400:00000010:1.0:1734260143.647465:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260143.647470:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260143.647471:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260143.647476:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1500 x1818500098332800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260153 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260143.647494:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1500 x1818500098332800/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260153 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260143.647510:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260143.647513:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:1.0:1734260143.647515:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1500. 00000100:00000010:0.0:1734260148.651677:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1880. 02000000:00000010:0.0:1734260148.651696:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4800. 00000100:00000010:0.0:1734260148.651743:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1180. 02000000:00000010:0.0:1734260148.651749:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732000. 02000000:00000010:3.0:1734260148.651772:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260148.651778:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260148.651784:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260148.651789:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098332928, portal 25 00000400:00000010:3.0:1734260148.651793:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734260148.651795:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098332928, offset 0 00000400:00000200:3.0:1734260148.651807:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260148.651817:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260148.651822:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260148.651826:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260148.651829:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 02000000:00000010:1.0:1734260148.651831:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:3.0:1734260148.651831:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260148.651834:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1333:1333:256:4294967295] 192.168.202.108@tcp LPNI seq info [1332:1332:8:4294967295] 00000400:00000010:1.0:1734260148.651835:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260148.651837:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260148.651839:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098333056, portal 10 00000400:00000200:3.0:1734260148.651841:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734260148.651843:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734260148.651844:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098333056, offset 0 00000800:00000200:3.0:1734260148.651846:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260148.651848:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260148.651849:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000400:00000200:1.0:1734260148.651852:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260148.651853:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260148.651855:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734260148.651855:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260148.651856:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260148.651858:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260148.651859:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1334:1334:255:4294967295] 192.168.202.108@tcp LPNI seq info [1333:1333:7:4294967295] 00000800:00000200:3.0:1734260148.651862:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260148.651863:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260148.651865:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260148.651866:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260148.651869:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734260148.651871:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260148.651875:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260148.651876:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260148.651929:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260148.651931:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734260148.651935:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260148.651939:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260148.651942:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734260148.651944:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734260148.651950:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1880 x1818500098332928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260164 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260148.652005:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260148.652007:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734260148.652010:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260148.652013:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260148.652014:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:0.0:1734260148.652015:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:0.0:1734260148.652018:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1180 x1818500098333056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260158 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260148.653534:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260148.653548:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629980 00000400:00000200:0.0:1734260148.653555:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2aa1 [1] + 0 00000400:00000200:0.0:1734260148.653565:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260148.653586:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260148.653594:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1180 x1818500098333056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260158 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260148.653624:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260148.653628:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629900 00000400:00000200:0.0:1734260148.653632:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2a99 [1] + 224 00000400:00000200:0.0:1734260148.653646:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260148.653649:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260148.653653:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1880 x1818500098332928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260164 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260148.653661:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260148.653665:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260148.653667:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260148.653672:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1180 x1818500098333056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260158 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260148.653690:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1180 x1818500098333056/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260158 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260148.653714:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260148.653718:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732000. 00000100:00000010:1.0:1734260148.653722:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1180. 00000400:00000010:3.0:1734260148.653771:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260148.653778:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260148.653779:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260148.653782:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1880 x1818500098332928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260164 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260148.653788:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1880 x1818500098332928/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260164 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260148.653797:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260148.653801:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4800. 00000100:00000010:3.0:1734260148.653803:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1880. 00000100:00000010:2.0:1734260153.660559:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734260153.660596:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734260153.660644:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734260153.660651:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734260153.660725:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3ae00. 02000000:00000010:1.0:1734260153.660726:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:0.0:1734260153.660732:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50268. 00000400:00000010:1.0:1734260153.660732:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:0.0:1734260153.660738:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000400:00000010:1.0:1734260153.660738:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734260153.660743:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098333184, portal 25 00000100:00000200:1.0:1734260153.660743:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098333312, portal 10 00000400:00000010:0.0:1734260153.660746:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000400:00000010:1.0:1734260153.660747:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734260153.660748:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098333184, offset 0 00000100:00000200:1.0:1734260153.660749:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098333312, offset 0 00000400:00000200:0.0:1734260153.660756:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260153.660773:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260153.660778:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260153.660782:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260153.660784:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260153.660786:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260153.660789:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1335:1335:256:4294967295] 192.168.202.108@tcp LPNI seq info [1334:1334:8:4294967295] 00000400:00000200:0.0:1734260153.660796:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260153.660801:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260153.660805:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000800:00000200:0.0:1734260153.660810:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260153.660816:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260153.660819:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260153.660898:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260153.660903:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260153.660906:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260153.660908:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260153.660909:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260153.660911:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260153.660913:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1336:1336:255:4294967295] 192.168.202.108@tcp LPNI seq info [1335:1335:7:4294967295] 00000800:00000200:0.0:1734260153.660914:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260153.660917:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:0.0:1734260153.660919:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260153.660919:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260153.660922:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260153.660923:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000800:00000010:1.0:1734260153.660925:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734260153.660926:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:0.0:1734260153.660928:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000800:00000200:1.0:1734260153.660928:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260153.660931:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000100:00000200:0.0:1734260153.660933:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098333184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260169 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260153.660933:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260153.660960:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260153.660962:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734260153.660964:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260153.660977:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260153.660980:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:0.0:1734260153.660981:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734260153.660984:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098333312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260163 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260153.663398:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260153.663416:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629a00 00000400:00000200:0.0:1734260153.663423:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2aad [1] + 224 00000400:00000200:0.0:1734260153.663433:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260153.663436:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260153.663445:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098333184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260169 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260153.663481:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260153.663485:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629a80 00000400:00000200:0.0:1734260153.663490:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2aa9 [1] + 0 00000400:00000200:0.0:1734260153.663505:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260153.663508:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260153.663513:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098333312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260163 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260153.663694:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260153.663699:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260153.663701:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260153.663706:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098333312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260163 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260153.663723:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098333312/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260163 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260153.663746:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260153.663751:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734260153.663755:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:2.0:1734260153.663921:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50268. 00000400:00000200:2.0:1734260153.663925:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:2.0:1734260153.663927:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:2.0:1734260153.663931:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098333184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260169 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260153.663937:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098333184/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260169 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260153.663947:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3ae00. 02000000:00000010:2.0:1734260153.663955:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734260153.663958:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000100:00000010:2.0:1734260158.667680:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734260158.667700:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734260158.667754:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734260158.667760:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734260158.667786:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734260158.667794:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50210. 00000400:00000010:0.0:1734260158.667799:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1d48. 00000100:00000200:0.0:1734260158.667805:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098333440, portal 25 00000400:00000010:0.0:1734260158.667810:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1f68. 00000100:00000200:0.0:1734260158.667812:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098333440, offset 0 00000400:00000200:0.0:1734260158.667819:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260158.667829:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260158.667834:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260158.667837:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 02000000:00000010:1.0:1734260158.667845:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:0.0:1734260158.667849:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000010:1.0:1734260158.667849:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000200:0.0:1734260158.667851:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:1.0:1734260158.667852:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000200:0.0:1734260158.667854:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1337:1337:256:4294967295] 192.168.202.108@tcp LPNI seq info [1336:1336:8:4294967295] 00000100:00000200:1.0:1734260158.667855:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098333568, portal 10 00000400:00000010:1.0:1734260158.667859:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734260158.667860:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098333568, offset 0 00000400:00000200:0.0:1734260158.667861:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734260158.667865:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734260158.667867:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260158.667869:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734260158.667870:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734260158.667872:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260158.667874:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:0.0:1734260158.667875:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260158.667876:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260158.667877:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260158.667879:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1338:1338:255:4294967295] 192.168.202.108@tcp LPNI seq info [1337:1337:7:4294967295] 00000800:00000200:0.0:1734260158.667882:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260158.667885:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260158.667885:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260158.667889:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260158.667891:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734260158.667894:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260158.667897:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260158.667899:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260158.667971:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260158.667974:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:2.0:1734260158.667978:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260158.667981:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260158.667985:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1f68 00000400:00000010:2.0:1734260158.667986:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1f68. 00000100:00000200:2.0:1734260158.667993:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098333440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260174 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734260158.668073:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260158.668075:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:2.0:1734260158.668077:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260158.668080:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260158.668082:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:2.0:1734260158.668083:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:2.0:1734260158.668086:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098333568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260168 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260158.669225:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260158.669236:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629b00 00000400:00000200:0.0:1734260158.669242:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2ab9 [1] + 224 00000400:00000200:0.0:1734260158.669250:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260158.669253:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260158.669260:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098333440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260174 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260158.669288:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260158.669291:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629b80 00000400:00000200:0.0:1734260158.669295:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2ac1 [1] + 0 00000400:00000200:0.0:1734260158.669307:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260158.669310:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260158.669313:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098333568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260168 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260158.669318:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50210. 00000400:00000200:2.0:1734260158.669322:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1d48 00000400:00000010:2.0:1734260158.669324:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1d48. 00000100:00000200:2.0:1734260158.669328:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098333440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260174 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260158.669335:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098333440/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260174 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260158.669351:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734260158.669355:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734260158.669358:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000400:00000010:1.0:1734260158.669387:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260158.669390:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260158.669392:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260158.669396:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098333568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260168 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260158.669411:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098333568/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260168 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260158.669425:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260158.669429:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734260158.669432:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734260163.675712:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734260163.675731:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734260163.675789:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734260163.675796:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:3.0:1734260163.675806:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260163.675813:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260163.675818:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260163.675824:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098333696, portal 25 00000400:00000010:3.0:1734260163.675828:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:3.0:1734260163.675829:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098333696, offset 0 00000400:00000200:3.0:1734260163.675837:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260163.675846:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260163.675851:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260163.675854:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 02000000:00000010:1.0:1734260163.675855:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:3.0:1734260163.675857:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260163.675858:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:1.0:1734260163.675860:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000200:3.0:1734260163.675861:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1339:1339:256:4294967295] 192.168.202.108@tcp LPNI seq info [1338:1338:8:4294967295] 00000400:00000010:1.0:1734260163.675863:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260163.675866:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098333824, portal 10 00000400:00000010:1.0:1734260163.675870:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000100:00000200:1.0:1734260163.675871:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098333824, offset 0 00000400:00000200:3.0:1734260163.675873:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734260163.675876:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734260163.675878:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260163.675881:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260163.675881:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000400:00000200:1.0:1734260163.675883:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260163.675885:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734260163.675886:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260163.675887:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260163.675889:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260163.675891:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1340:1340:255:4294967295] 192.168.202.108@tcp LPNI seq info [1339:1339:7:4294967295] 00000800:00000200:3.0:1734260163.675892:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260163.675894:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260163.675897:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260163.675901:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260163.675903:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734260163.675906:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260163.675909:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260163.675911:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260163.675956:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260163.675960:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734260163.675964:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260163.675968:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260163.675971:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734260163.675985:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734260163.675992:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098333696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260179 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260163.676079:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260163.676081:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734260163.676083:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260163.676086:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260163.676088:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:0.0:1734260163.676090:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:0.0:1734260163.676093:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098333824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260173 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260163.677479:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260163.677491:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629c00 00000400:00000200:0.0:1734260163.677497:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2ac9 [1] + 224 00000400:00000200:0.0:1734260163.677505:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260163.677508:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260163.677514:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098333696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260179 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260163.677545:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260163.677549:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629c80 00000400:00000200:0.0:1734260163.677553:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2ad1 [1] + 0 00000400:00000200:0.0:1734260163.677565:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260163.677595:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260163.677600:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098333824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260173 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260163.677652:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260163.677656:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260163.677658:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260163.677668:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098333696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260179 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260163.677675:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098333696/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260179 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260163.677677:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260163.677680:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260163.677682:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260163.677686:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098333824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260173 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260163.677694:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260163.677699:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000200:1.0:1734260163.677700:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098333824/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260173 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260163.677714:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 00000100:00000010:3.0:1734260163.677715:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 02000000:00000010:1.0:1734260163.677717:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734260163.677721:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000100:00000010:2.0:1734260168.683712:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734260168.683730:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734260168.683785:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734260168.683791:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734260168.683814:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260168.683821:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260168.683828:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260168.683833:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098333952, portal 25 00000400:00000010:3.0:1734260168.683836:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734260168.683838:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098333952, offset 0 00000400:00000200:3.0:1734260168.683845:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260168.683855:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260168.683859:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260168.683863:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260168.683865:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260168.683867:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260168.683869:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1341:1341:256:4294967295] 192.168.202.108@tcp LPNI seq info [1340:1340:8:4294967295] 00000400:00000200:3.0:1734260168.683877:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:1.0:1734260168.683879:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000800:00000200:3.0:1734260168.683882:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734260168.683883:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000800:00000010:3.0:1734260168.683884:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000400:00000010:1.0:1734260168.683886:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260168.683889:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098334080, portal 10 00000800:00000200:3.0:1734260168.683889:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:1.0:1734260168.683893:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734260168.683895:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098334080, offset 0 00000800:00000200:3.0:1734260168.683896:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260168.683899:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734260168.683899:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260168.683904:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260168.683906:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260168.683908:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260168.683910:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260168.683912:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260168.683913:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1342:1342:255:4294967295] 192.168.202.108@tcp LPNI seq info [1341:1341:7:4294967295] 00000400:00000200:1.0:1734260168.683919:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260168.683923:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260168.683926:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734260168.683928:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260168.683931:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260168.683933:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260168.683954:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260168.683957:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734260168.683961:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260168.683965:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260168.683981:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734260168.683992:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734260168.683998:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098333952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260184 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260168.684058:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260168.684060:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734260168.684062:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260168.684065:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260168.684067:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734260168.684068:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734260168.684071:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098334080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260178 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260168.686279:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260168.686294:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629d80 00000400:00000200:0.0:1734260168.686300:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2ae1 [1] + 0 00000400:00000200:0.0:1734260168.686318:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260168.686321:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260168.686330:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098334080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260168.686408:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260168.686412:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260168.686414:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260168.686419:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098334080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260178 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260168.686437:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098334080/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260178 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260168.686461:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260168.686466:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734260168.686471:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000400:00000200:0.0:1734260168.686482:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260168.686488:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629d00 00000400:00000200:0.0:1734260168.686492:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2ad9 [1] + 224 00000400:00000200:0.0:1734260168.686501:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260168.686504:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260168.686509:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098333952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260184 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260168.686563:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260168.686594:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260168.686596:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260168.686601:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098333952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260184 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260168.686617:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098333952/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260184 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260168.686628:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260168.686632:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734260168.686635:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000010:2.0:1734260173.691708:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734260173.691727:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c600. 00000100:00000010:2.0:1734260173.691778:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734260173.691785:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734260173.691884:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260173.691891:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260173.691896:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260173.691902:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098334336, portal 10 00000400:00000010:1.0:1734260173.691907:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734260173.691909:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098334336, offset 0 00000400:00000200:1.0:1734260173.691916:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260173.691926:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260173.691930:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260173.691946:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260173.691948:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260173.691950:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260173.691952:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1343:1343:256:4294967295] 192.168.202.108@tcp LPNI seq info [1342:1342:8:4294967295] 00000400:00000200:1.0:1734260173.691959:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260173.691963:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260173.691966:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734260173.691971:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260173.691977:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260173.691980:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734260173.692131:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e5a00. 00000400:00000010:3.0:1734260173.692136:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260173.692139:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260173.692141:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098334208, portal 25 00000400:00000010:3.0:1734260173.692144:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000100:00000200:3.0:1734260173.692145:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098334208, offset 0 00000400:00000200:3.0:1734260173.692150:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260173.692154:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260173.692156:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260173.692158:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260173.692160:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260173.692162:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260173.692164:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1344:1344:255:4294967295] 192.168.202.108@tcp LPNI seq info [1343:1343:7:4294967295] 00000400:00000200:3.0:1734260173.692169:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260173.692172:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260173.692174:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000800:00000200:3.0:1734260173.692177:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260173.692180:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000200:3.0:1734260173.692181:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000010:1.0:1734260173.692183:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000800:00000200:3.0:1734260173.692183:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260173.692186:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260173.692190:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260173.692193:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:1.0:1734260173.692204:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734260173.692210:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098334336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260183 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260173.692246:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260173.692248:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:1.0:1734260173.692250:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260173.692253:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260173.692254:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:1.0:1734260173.692255:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:1.0:1734260173.692258:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098334208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260189 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260173.693470:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260173.693480:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629e80 00000400:00000200:0.0:1734260173.693484:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2ae9 [1] + 0 00000400:00000200:0.0:1734260173.693491:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260173.693498:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260173.693503:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098334336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260173.693525:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260173.693529:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629e00 00000400:00000200:0.0:1734260173.693532:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2af1 [1] + 224 00000400:00000200:0.0:1734260173.693542:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260173.693545:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:1.0:1734260173.693548:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260173.693551:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260173.693553:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:0.0:1734260173.693556:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098334208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260189 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260173.693556:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098334336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260183 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260173.693562:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098334336/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260183 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260173.693647:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260173.693650:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260173.693651:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260173.693655:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098334208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260189 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260173.693668:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098334208/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260189 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260173.693684:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e5a00. 02000000:00000010:3.0:1734260173.693688:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c600. 00000100:00000010:3.0:1734260173.693692:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 02000000:00000010:1.0:1734260173.693838:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260173.693842:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734260173.693845:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000100:00000010:2.0:1734260178.699715:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734260178.699732:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 02000000:00000010:0.0:1734260178.699814:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3a600. 00000400:00000010:0.0:1734260178.699820:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d501b8. 00000400:00000010:0.0:1734260178.699825:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1b28. 00000100:00000200:0.0:1734260178.699829:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098334464, portal 25 00000400:00000010:0.0:1734260178.699832:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000100:00000200:0.0:1734260178.699833:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098334464, offset 0 00000400:00000200:0.0:1734260178.699838:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260178.699848:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260178.699851:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260178.699854:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260178.699856:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260178.699858:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260178.699860:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1345:1345:256:4294967295] 192.168.202.108@tcp LPNI seq info [1344:1344:8:4294967295] 00000400:00000200:0.0:1734260178.699865:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260178.699868:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260178.699870:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734260178.699874:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000010:2.0:1734260178.699875:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 00000800:00000200:0.0:1734260178.699879:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260178.699881:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 320 niov 1 nkiov 1 02000000:00000010:2.0:1734260178.699882:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734260178.699952:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260178.699956:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260178.699958:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260178.699960:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098334592, portal 10 00000400:00000010:1.0:1734260178.699964:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:1.0:1734260178.699964:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098334592, offset 0 00000400:00000200:1.0:1734260178.699968:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734260178.699971:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:1.0:1734260178.699972:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:0.0:1734260178.699973:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:1.0:1734260178.699973:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260178.699974:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260178.699975:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260178.699976:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260178.699977:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260178.699980:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:0.0:1734260178.699981:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000400:00000200:1.0:1734260178.699981:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260178.699983:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1346:1346:255:4294967295] 192.168.202.108@tcp LPNI seq info [1345:1345:7:4294967295] 00000100:00000200:0.0:1734260178.699986:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098334464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260194 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734260178.699987:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260178.699990:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260178.699992:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:1.0:1734260178.699993:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260178.699996:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260178.699998:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260178.700250:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260178.700252:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:2.0:1734260178.700255:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260178.700258:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260178.700260:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:2.0:1734260178.700262:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:2.0:1734260178.700265:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098334592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260188 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260178.701106:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260178.701115:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c629f00 00000400:00000200:0.0:1734260178.701120:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2af9 [1] + 224 00000400:00000200:0.0:1734260178.701128:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260178.701130:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260178.701136:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098334464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260178.701167:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260178.701171:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c629f80 00000400:00000200:0.0:1734260178.701175:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b01 [1] + 0 00000400:00000200:0.0:1734260178.701186:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000010:2.0:1734260178.701187:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d501b8. 00000400:00000200:0.0:1734260178.701189:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260178.701191:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1b28 00000400:00000010:2.0:1734260178.701193:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1b28. 00000100:00000200:2.0:1734260178.701197:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098334464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260194 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734260178.701199:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098334592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260178.701204:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098334464/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260194 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260178.701230:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3a600. 02000000:00000010:2.0:1734260178.701234:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734260178.701237:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000400:00000010:1.0:1734260178.701240:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260178.701244:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260178.701245:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260178.701249:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098334592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260188 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260178.701255:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098334592/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260188 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260178.701273:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260178.701277:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734260178.701280:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734260183.707976:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734260183.707994:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734260183.708047:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734260183.708055:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734260183.708098:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3ae00. 00000400:00000010:0.0:1734260183.708105:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50160. 00000400:00000010:0.0:1734260183.708110:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1908. 00000100:00000200:0.0:1734260183.708116:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098334720, portal 25 00000400:00000010:0.0:1734260183.708120:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1e58. 00000100:00000200:0.0:1734260183.708121:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098334720, offset 0 00000400:00000200:0.0:1734260183.708129:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260183.708148:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:1.0:1734260183.708148:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:0.0:1734260183.708152:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:1.0:1734260183.708152:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000200:0.0:1734260183.708155:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:1.0:1734260183.708155:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260183.708157:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098334848, portal 10 00000400:00000200:0.0:1734260183.708158:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260183.708160:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260183.708162:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1347:1347:256:4294967295] 192.168.202.108@tcp LPNI seq info [1346:1346:8:4294967295] 00000400:00000010:1.0:1734260183.708162:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:1.0:1734260183.708163:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098334848, offset 0 00000400:00000200:1.0:1734260183.708167:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260183.708170:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260183.708175:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260183.708178:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4e00. 00000400:00000200:1.0:1734260183.708180:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260183.708182:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1734260183.708183:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260183.708184:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260183.708186:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260183.708188:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734260183.708189:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260183.708192:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4e00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260183.708200:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1348:1348:255:4294967295] 192.168.202.108@tcp LPNI seq info [1347:1347:7:4294967295] 00000400:00000200:1.0:1734260183.708207:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260183.708210:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260183.708213:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734260183.708216:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260183.708219:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260183.708221:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260183.708282:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260183.708285:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4e00. 00000400:00000200:2.0:1734260183.708289:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260183.708293:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260183.708296:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1e58 00000400:00000010:2.0:1734260183.708297:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1e58. 00000100:00000200:2.0:1734260183.708304:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098334720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260199 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734260183.708363:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260183.708365:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:2.0:1734260183.708367:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260183.708370:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260183.708372:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:2.0:1734260183.708373:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:2.0:1734260183.708376:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098334848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260193 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260183.710733:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260183.711614:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a080 00000400:00000200:0.0:1734260183.711622:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b11 [1] + 0 00000400:00000200:0.0:1734260183.711635:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260183.711639:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260183.711647:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098334848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260193 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260183.711730:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260183.711735:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a000 00000400:00000200:0.0:1734260183.711739:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b09 [1] + 224 00000400:00000200:0.0:1734260183.711753:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260183.711756:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260183.711760:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098334720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260199 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260183.711828:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50160. 00000400:00000200:2.0:1734260183.711833:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1908 00000400:00000010:2.0:1734260183.711835:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1908. 00000400:00000010:1.0:1734260183.711839:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000100:00000200:2.0:1734260183.711840:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098334720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260199 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734260183.711842:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260183.711843:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:2.0:1734260183.711847:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098334720/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260199 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260183.711848:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098334848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260193 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260183.711853:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098334848/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260193 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260183.711877:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3ae00. 02000000:00000010:1.0:1734260183.711882:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260183.711886:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734260183.711888:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 00000100:00000010:1.0:1734260183.711891:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:2.0:1734260183.711891:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734260188.715654:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18e00. 02000000:00000010:2.0:1734260188.715670:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c300. 00000100:00000010:2.0:1734260188.715713:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19500. 02000000:00000010:2.0:1734260188.715717:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:1.0:1734260188.715857:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260188.715864:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260188.715870:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260188.715876:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098335104, portal 10 00000400:00000010:1.0:1734260188.715881:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734260188.715883:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098335104, offset 0 00000400:00000200:1.0:1734260188.715889:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260188.715900:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260188.715904:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260188.715907:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260188.715909:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260188.715911:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260188.715913:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1349:1349:256:4294967295] 192.168.202.108@tcp LPNI seq info [1348:1348:8:4294967295] 00000400:00000200:1.0:1734260188.715930:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260188.715935:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260188.715938:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734260188.715943:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260188.715949:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260188.715952:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:3.0:1734260188.715957:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734260188.715962:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260188.715965:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260188.715968:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098334976, portal 25 00000400:00000010:3.0:1734260188.715970:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734260188.715971:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098334976, offset 0 00000400:00000200:3.0:1734260188.715975:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260188.715979:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260188.715982:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260188.715983:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260188.715985:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260188.715987:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260188.715989:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1350:1350:255:4294967295] 192.168.202.108@tcp LPNI seq info [1349:1349:7:4294967295] 00000400:00000200:3.0:1734260188.715994:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260188.715997:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260188.715999:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734260188.716002:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260188.716006:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260188.716008:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260188.716046:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260188.716049:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:1.0:1734260188.716051:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260188.716055:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260188.716058:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:1.0:1734260188.716059:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734260188.716065:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19500 x1818500098335104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260198 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260188.716088:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260188.716089:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734260188.716091:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260188.716094:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260188.716095:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:1.0:1734260188.716096:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:1.0:1734260188.716099:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18e00 x1818500098334976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260204 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260188.717999:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260188.718737:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a180 00000400:00000200:0.0:1734260188.718755:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b19 [1] + 0 00000400:00000200:0.0:1734260188.718768:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260188.718772:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260188.718781:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19500 x1818500098335104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260188.718815:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260188.718820:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a100 00000400:00000200:0.0:1734260188.718833:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b21 [1] + 224 00000400:00000200:0.0:1734260188.718845:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260188.718848:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260188.718853:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18e00 x1818500098334976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260204 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260188.718947:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260188.718952:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260188.718954:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260188.718959:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18e00 x1818500098334976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260204 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260188.718974:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18e00 x1818500098334976/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260204 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260188.719062:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260188.719065:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260188.719066:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260188.719071:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19500 x1818500098335104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260198 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260188.719076:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19500 x1818500098335104/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260198 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260188.719091:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:3.0:1734260188.719091:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734260188.719097:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c300. 02000000:00000010:1.0:1734260188.719098:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734260188.719101:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19500. 00000100:00000010:3.0:1734260188.719101:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18e00. 00000100:00000010:2.0:1734260193.723932:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734260193.723958:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734260193.724027:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19880. 02000000:00000010:2.0:1734260193.724036:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:0.0:1734260193.724060:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734260193.724068:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50108. 00000400:00000010:0.0:1734260193.724075:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1c38. 00000100:00000200:0.0:1734260193.724086:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098335232, portal 25 00000400:00000010:0.0:1734260193.724091:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000100:00000200:0.0:1734260193.724093:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098335232, offset 0 00000400:00000200:0.0:1734260193.724102:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260193.724116:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260193.724121:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260193.724125:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260193.724129:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260193.724131:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 02000000:00000010:1.0:1734260193.724133:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000200:0.0:1734260193.724134:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1351:1351:256:4294967295] 192.168.202.108@tcp LPNI seq info [1350:1350:8:4294967295] 00000400:00000200:0.0:1734260193.724143:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734260193.724144:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000800:00000200:0.0:1734260193.724149:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734260193.724149:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000800:00000010:0.0:1734260193.724152:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000100:00000200:1.0:1734260193.724155:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098335360, portal 10 00000800:00000200:0.0:1734260193.724158:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:1.0:1734260193.724160:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734260193.724162:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098335360, offset 0 00000400:00000200:1.0:1734260193.724169:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260193.724179:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:0.0:1734260193.724180:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260193.724183:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1734260193.724184:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260193.724186:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260193.724188:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260193.724190:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260193.724192:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1352:1352:255:4294967295] 192.168.202.108@tcp LPNI seq info [1351:1351:7:4294967295] 00000400:00000200:1.0:1734260193.724199:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260193.724203:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260193.724207:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734260193.724211:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260193.724217:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260193.724221:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260193.724246:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260193.724250:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:0.0:1734260193.724253:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260193.724258:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260193.724261:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:0.0:1734260193.724263:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:0.0:1734260193.724271:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098335232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260209 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260193.724343:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260193.724345:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734260193.724348:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260193.724351:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260193.724353:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:0.0:1734260193.724355:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:0.0:1734260193.724359:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19880 x1818500098335360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260203 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260193.726415:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260193.726432:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a200 00000400:00000200:0.0:1734260193.726439:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b29 [1] + 224 00000400:00000200:0.0:1734260193.726448:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260193.726451:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260193.726460:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098335232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260209 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260193.726493:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260193.726498:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a280 00000400:00000200:0.0:1734260193.726502:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b31 [1] + 0 00000400:00000200:0.0:1734260193.726515:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260193.726518:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260193.726529:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19880 x1818500098335360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260203 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260193.726703:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260193.726708:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260193.726709:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260193.726714:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19880 x1818500098335360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260203 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260193.726721:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19880 x1818500098335360/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260203 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260193.726743:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260193.726752:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734260193.726762:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19880. 00000400:00000010:2.0:1734260193.726919:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50108. 00000400:00000200:2.0:1734260193.726927:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1c38 00000400:00000010:2.0:1734260193.726929:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1c38. 00000100:00000200:2.0:1734260193.726937:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098335232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260209 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260193.726945:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098335232/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260209 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260193.726962:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734260193.726967:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734260193.726971:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734260198.731690:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734260198.731708:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734260198.731774:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19180. 02000000:00000010:2.0:1734260198.731780:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734260198.731796:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3a600. 00000400:00000010:0.0:1734260198.731804:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50108. 00000400:00000010:0.0:1734260198.731809:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1110. 00000100:00000200:0.0:1734260198.731815:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098335488, portal 25 00000400:00000010:0.0:1734260198.731818:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734260198.731820:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098335488, offset 0 00000400:00000200:0.0:1734260198.731826:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260198.731836:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260198.731840:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260198.731844:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260198.731846:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260198.731848:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260198.731850:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1353:1353:256:4294967295] 192.168.202.108@tcp LPNI seq info [1352:1352:8:4294967295] 00000400:00000200:0.0:1734260198.731857:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260198.731862:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260198.731865:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4900. 00000800:00000200:0.0:1734260198.731870:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 02000000:00000010:1.0:1734260198.731872:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000800:00000200:0.0:1734260198.731877:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000010:1.0:1734260198.731877:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000800:00000200:0.0:1734260198.731880:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4900 type 1, nob 320 niov 1 nkiov 1 00000400:00000010:1.0:1734260198.731880:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260198.731883:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098335616, portal 10 00000400:00000010:1.0:1734260198.731887:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734260198.731888:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098335616, offset 0 00000400:00000200:1.0:1734260198.731893:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260198.731897:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260198.731900:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260198.731902:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260198.731904:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260198.731905:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260198.731908:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1354:1354:255:4294967295] 192.168.202.108@tcp LPNI seq info [1353:1353:7:4294967295] 00000400:00000200:1.0:1734260198.731913:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260198.731917:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260198.731919:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734260198.731922:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260198.731926:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260198.731928:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260198.731971:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260198.731973:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4900. 00000400:00000200:0.0:1734260198.731976:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260198.731980:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260198.731983:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:0.0:1734260198.731985:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734260198.731990:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098335488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260214 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260198.732013:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260198.732022:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:0.0:1734260198.732024:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260198.732027:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260198.732029:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:0.0:1734260198.732030:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:0.0:1734260198.732033:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19180 x1818500098335616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260208 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260198.733622:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260198.733636:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a300 00000400:00000200:0.0:1734260198.733642:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b39 [1] + 224 00000400:00000200:0.0:1734260198.733651:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260198.733654:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260198.733662:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098335488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260214 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260198.733698:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260198.733702:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a380 00000400:00000200:0.0:1734260198.733706:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b41 [1] + 0 00000400:00000200:0.0:1734260198.733719:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260198.733723:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:2.0:1734260198.733726:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50108. 00000400:00000200:2.0:1734260198.733731:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1110 00000400:00000010:2.0:1734260198.733732:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1110. 00000100:00000200:0.0:1734260198.733738:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19180 x1818500098335616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260208 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260198.733738:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098335488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260214 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260198.733744:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098335488/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260214 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260198.733792:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3a600. 02000000:00000010:2.0:1734260198.733796:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734260198.733802:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000400:00000010:1.0:1734260198.733827:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260198.733831:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260198.733832:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260198.733836:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19180 x1818500098335616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260208 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260198.733842:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19180 x1818500098335616/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260208 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260198.733856:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260198.733860:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734260198.733863:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19180. 00000100:00000010:2.0:1734260203.739749:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18380. 02000000:00000010:2.0:1734260203.739769:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734260203.739826:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a680. 02000000:00000010:2.0:1734260203.739833:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:1.0:1734260203.739900:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260203.739907:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260203.739913:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260203.739918:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098335872, portal 10 00000400:00000010:1.0:1734260203.739923:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734260203.739924:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098335872, offset 0 00000400:00000200:1.0:1734260203.739931:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260203.739940:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260203.739944:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260203.739947:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260203.739950:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260203.739952:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260203.739954:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1355:1355:256:4294967295] 192.168.202.108@tcp LPNI seq info [1354:1354:8:4294967295] 00000400:00000200:1.0:1734260203.739962:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260203.739966:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260203.739970:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734260203.739974:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260203.739981:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260203.739984:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260203.740081:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260203.740084:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:1.0:1734260203.740087:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260203.740090:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260203.740093:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:1.0:1734260203.740095:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:1.0:1734260203.740100:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a680 x1818500098335872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260213 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260203.740158:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734260203.740163:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260203.740166:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260203.740169:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098335744, portal 25 00000400:00000010:3.0:1734260203.740171:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734260203.740173:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098335744, offset 0 00000400:00000200:3.0:1734260203.740177:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260203.740182:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260203.740184:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260203.740186:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260203.740188:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260203.740189:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260203.740191:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1356:1356:256:4294967295] 192.168.202.108@tcp LPNI seq info [1355:1355:8:4294967295] 00000400:00000200:3.0:1734260203.740197:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260203.740201:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260203.740203:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734260203.740206:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260203.740209:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260203.740211:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260203.740288:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260203.740291:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734260203.740294:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260203.740298:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260203.741027:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734260203.741029:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734260203.741035:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18380 x1818500098335744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260219 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260203.742042:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260203.743686:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a400 00000400:00000200:0.0:1734260203.743696:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b51 [1] + 224 00000400:00000200:0.0:1734260203.743723:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260203.743726:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260203.743733:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18380 x1818500098335744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260219 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260203.743766:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260203.743771:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a480 00000400:00000200:0.0:1734260203.743775:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b49 [1] + 0 00000400:00000200:0.0:1734260203.743789:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260203.743792:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260203.743797:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a680 x1818500098335872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260213 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260203.743895:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260203.743899:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260203.743900:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000400:00000010:1.0:1734260203.743911:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260203.743916:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260203.743917:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260203.743922:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a680 x1818500098335872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260213 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260203.743935:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a680 x1818500098335872/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260213 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260203.743958:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260203.743964:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734260203.743969:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a680. 00000100:00000200:3.0:1734260203.744032:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18380 x1818500098335744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260219 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260203.744048:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18380 x1818500098335744/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260219 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260203.744061:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734260203.744065:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:3.0:1734260203.744067:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18380. 00000100:00000010:2.0:1734260208.747704:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb18000. 02000000:00000010:2.0:1734260208.747724:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734260208.747768:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19f80. 02000000:00000010:2.0:1734260208.747773:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734260208.747794:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734260208.747802:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260208.747807:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260208.747812:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098336000, portal 25 00000400:00000010:3.0:1734260208.747815:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000100:00000200:3.0:1734260208.747817:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098336000, offset 0 00000400:00000200:3.0:1734260208.747825:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:1.0:1734260208.747831:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260208.747836:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000200:3.0:1734260208.747836:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734260208.747839:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000200:3.0:1734260208.747840:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000200:1.0:1734260208.747842:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098336128, portal 10 00000400:00000200:3.0:1734260208.747844:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:1.0:1734260208.747846:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000400:00000200:3.0:1734260208.747846:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:1.0:1734260208.747848:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098336128, offset 0 00000400:00000200:3.0:1734260208.747848:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260208.747851:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1357:1357:256:4294967295] 192.168.202.108@tcp LPNI seq info [1356:1356:8:4294967295] 00000400:00000200:1.0:1734260208.747852:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260208.747858:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260208.747863:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260208.747864:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260208.747866:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000400:00000200:1.0:1734260208.747867:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260208.747869:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260208.747871:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734260208.747871:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260208.747872:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260208.747875:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1358:1358:255:4294967295] 192.168.202.108@tcp LPNI seq info [1357:1357:7:4294967295] 00000800:00000200:3.0:1734260208.747878:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260208.747881:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260208.747881:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260208.747884:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260208.747887:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734260208.747889:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260208.747893:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260208.747895:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260208.747943:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260208.747947:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734260208.747951:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260208.747955:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260208.747958:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734260208.747959:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734260208.747966:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb18000 x1818500098336000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260224 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260208.748026:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260208.748028:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:0.0:1734260208.748029:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260208.748031:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260208.748033:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:0.0:1734260208.748033:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:0.0:1734260208.748036:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19f80 x1818500098336128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260218 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260208.749549:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260208.749598:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a580 00000400:00000200:0.0:1734260208.749604:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b61 [1] + 0 00000400:00000200:0.0:1734260208.749786:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260208.749791:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260208.749798:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19f80 x1818500098336128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260218 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260208.749828:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260208.749833:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a500 00000400:00000200:0.0:1734260208.749837:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b59 [1] + 224 00000400:00000200:0.0:1734260208.749847:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260208.749850:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260208.749853:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb18000 x1818500098336000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260224 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260208.749862:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260208.749867:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260208.749868:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260208.749873:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19f80 x1818500098336128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260218 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260208.749889:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19f80 x1818500098336128/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260218 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260208.749912:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260208.749916:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734260208.749920:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19f80. 00000400:00000010:3.0:1734260208.749927:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260208.749931:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260208.749932:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260208.749937:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb18000 x1818500098336000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260224 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260208.749952:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb18000 x1818500098336000/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260224 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260208.749962:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734260208.749966:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734260208.749968:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb18000. 00000100:00000010:2.0:1734260213.755858:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1bb80. 02000000:00000010:2.0:1734260213.755877:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c400. 00000100:00000010:2.0:1734260213.755933:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb19c00. 02000000:00000010:2.0:1734260213.755941:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734260213.755976:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4a00. 00000400:00000010:3.0:1734260213.755983:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260213.755988:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260213.755994:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098336256, portal 25 02000000:00000010:1.0:1734260213.755995:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:3.0:1734260213.755997:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734260213.755999:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098336256, offset 0 00000400:00000010:1.0:1734260213.756001:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000200:3.0:1734260213.756005:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734260213.756010:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260213.756013:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098336384, portal 10 00000400:00000200:3.0:1734260213.756016:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000010:1.0:1734260213.756017:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734260213.756019:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098336384, offset 0 00000400:00000200:3.0:1734260213.756021:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260213.756023:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260213.756024:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260213.756027:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260213.756029:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260213.756031:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1359:1359:256:4294967295] 192.168.202.108@tcp LPNI seq info [1358:1358:8:4294967295] 00000400:00000200:3.0:1734260213.756038:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260213.756042:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260213.756044:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260213.756045:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db900. 00000400:00000200:1.0:1734260213.756046:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260213.756049:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734260213.756050:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260213.756051:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260213.756052:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260213.756055:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1360:1360:255:4294967295] 192.168.202.108@tcp LPNI seq info [1359:1359:7:4294967295] 00000800:00000200:3.0:1734260213.756057:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260213.756060:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db900 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:1.0:1734260213.756061:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260213.756065:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260213.756067:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000800:00000200:1.0:1734260213.756070:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260213.756074:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260213.756076:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260213.756127:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260213.756131:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db900. 00000400:00000200:0.0:1734260213.756135:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260213.756139:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260213.756142:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:0.0:1734260213.756143:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:0.0:1734260213.756149:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1bb80 x1818500098336256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260229 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260213.756202:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260213.756204:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:0.0:1734260213.756206:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260213.756208:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260213.756210:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:0.0:1734260213.756211:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:0.0:1734260213.756214:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb19c00 x1818500098336384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260223 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260213.758051:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260213.758074:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a600 00000400:00000200:0.0:1734260213.758085:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b69 [1] + 224 00000400:00000200:0.0:1734260213.758095:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260213.758098:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260213.758105:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1bb80 x1818500098336256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260229 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260213.759404:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260213.759414:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a680 00000400:00000200:0.0:1734260213.759420:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b71 [1] + 0 00000400:00000200:0.0:1734260213.759437:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260213.759440:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260213.759447:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb19c00 x1818500098336384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260223 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260213.759509:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260213.759514:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260213.759515:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260213.759520:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1bb80 x1818500098336256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260229 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260213.759536:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1bb80 x1818500098336256/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260229 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260213.759556:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4a00. 02000000:00000010:3.0:1734260213.759560:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c400. 00000100:00000010:3.0:1734260213.759564:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1bb80. 00000400:00000010:1.0:1734260213.759631:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260213.759635:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260213.759636:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260213.759649:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb19c00 x1818500098336384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260223 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260213.759663:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb19c00 x1818500098336384/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260223 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260213.759677:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260213.759680:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32c00. 00000100:00000010:1.0:1734260213.759683:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb19c00. 00000100:00000010:2.0:1734260218.763819:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734260218.763837:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734260218.763893:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1b100. 02000000:00000010:2.0:1734260218.763899:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:0.0:1734260218.763920:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3be00. 00000400:00000010:0.0:1734260218.763927:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50160. 00000400:00000010:0.0:1734260218.763933:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1dd0. 00000100:00000200:0.0:1734260218.763939:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098336512, portal 25 00000400:00000010:0.0:1734260218.763942:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e17f8. 00000100:00000200:0.0:1734260218.763944:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098336512, offset 0 00000400:00000200:0.0:1734260218.763952:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:1.0:1734260218.763967:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260218.763972:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260218.763976:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260218.763978:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098336640, portal 10 00000400:00000010:1.0:1734260218.763983:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720990. 00000100:00000200:1.0:1734260218.763984:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098336640, offset 0 00000400:00000200:1.0:1734260218.763988:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260218.764013:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260218.764019:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260218.764024:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260218.764026:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260218.764028:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260218.764031:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1361:1361:256:4294967295] 192.168.202.108@tcp LPNI seq info [1360:1360:8:4294967295] 00000400:00000200:0.0:1734260218.764039:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260218.764044:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260218.764045:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260218.764047:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:0.0:1734260218.764048:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4100. 00000400:00000200:1.0:1734260218.764049:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260218.764051:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260218.764052:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260218.764054:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1362:1362:255:4294967295] 192.168.202.108@tcp LPNI seq info [1361:1361:7:4294967295] 00000400:00000200:1.0:1734260218.764059:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260218.764062:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260218.764063:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260218.764065:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734260218.764068:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260218.764069:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260218.764071:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260218.764072:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260218.764073:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260218.764789:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260218.764792:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4100. 00000400:00000200:2.0:1734260218.764796:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260218.764799:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260218.764803:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e17f8 00000400:00000010:2.0:1734260218.764804:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e17f8. 00000100:00000200:2.0:1734260218.764809:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098336512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260234 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:2.0:1734260218.765022:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260218.765024:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:2.0:1734260218.765027:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260218.765035:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260218.765038:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720990 00000400:00000010:2.0:1734260218.765039:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720990. 00000100:00000200:2.0:1734260218.765043:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1b100 x1818500098336640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260228 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260218.767204:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260218.767219:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a700 00000400:00000200:0.0:1734260218.767226:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b79 [1] + 224 00000400:00000200:0.0:1734260218.767243:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260218.767247:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260218.767256:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098336512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260234 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260218.767455:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50160. 00000400:00000200:2.0:1734260218.767460:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1dd0 00000400:00000010:2.0:1734260218.767462:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1dd0. 00000100:00000200:2.0:1734260218.767466:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098336512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260234 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260218.767473:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098336512/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260234 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260218.767492:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3be00. 02000000:00000010:2.0:1734260218.767496:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c100. 00000100:00000010:2.0:1734260218.767500:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000200:0.0:1734260218.767673:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260218.767679:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a780 00000400:00000200:0.0:1734260218.767684:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b81 [1] + 0 00000400:00000200:0.0:1734260218.767693:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260218.767696:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260218.767702:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1b100 x1818500098336640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260228 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260218.767783:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260218.767787:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260218.767788:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260218.767791:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1b100 x1818500098336640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260228 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260218.767809:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1b100 x1818500098336640/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260228 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260218.767824:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:1.0:1734260218.767828:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:1.0:1734260218.767877:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1b100. 00000100:00000010:0.0:1734260223.771772:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe1f80. 02000000:00000010:0.0:1734260223.771790:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4600. 00000100:00000010:0.0:1734260223.771839:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0700. 02000000:00000010:0.0:1734260223.771844:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733400. 02000000:00000010:1.0:1734260223.771911:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b6d0ac00. 00000400:00000010:1.0:1734260223.771918:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260223.771924:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260223.771929:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098336896, portal 10 02000000:00000010:2.0:1734260223.771930:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc600. 00000400:00000010:2.0:1734260223.771935:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260223.771938:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000400:00000010:1.0:1734260223.771940:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720a18. 00000100:00000200:2.0:1734260223.771940:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098336768, portal 25 00000100:00000200:1.0:1734260223.771942:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098336896, offset 0 00000400:00000010:2.0:1734260223.771942:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e110. 00000100:00000200:2.0:1734260223.771944:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098336768, offset 0 00000400:00000200:1.0:1734260223.771950:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260223.771961:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260223.771965:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260223.771969:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260223.771972:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260223.771974:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260223.771975:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260223.771976:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1363:1363:256:4294967295] 192.168.202.108@tcp LPNI seq info [1362:1362:8:4294967295] 00000400:00000200:1.0:1734260223.771984:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260223.771989:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260223.771993:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021e00. 00000800:00000200:1.0:1734260223.771998:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260223.772005:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260223.772008:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021e00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734260223.772232:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260223.772234:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260223.772236:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260223.772238:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260223.772240:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260223.772241:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1364:1364:255:4294967295] 192.168.202.108@tcp LPNI seq info [1363:1363:7:4294967295] 00000400:00000200:2.0:1734260223.772247:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260223.772250:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260223.772253:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734260223.772264:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260223.772268:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260223.772270:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734260223.772338:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734260223.772342:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021e00. 00000400:00000200:3.0:1734260223.772345:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734260223.772348:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260223.772351:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720a18 00000400:00000010:3.0:1734260223.772352:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720a18. 00000100:00000200:3.0:1734260223.772358:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0700 x1818500098336896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260233 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734260223.772394:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734260223.772396:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734260223.772398:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734260223.772401:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260223.772402:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e110 00000400:00000010:3.0:1734260223.772403:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e110. 00000100:00000200:3.0:1734260223.772406:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe1f80 x1818500098336768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260239 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260223.774150:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260223.774163:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a880 00000400:00000200:0.0:1734260223.774169:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b89 [1] + 0 00000400:00000200:0.0:1734260223.774177:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260223.774179:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260223.774186:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0700 x1818500098336896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260233 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260223.774231:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260223.774236:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a800 00000400:00000200:0.0:1734260223.774240:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b8d [1] + 224 00000400:00000200:0.0:1734260223.774253:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260223.774256:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260223.774260:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe1f80 x1818500098336768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260239 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260223.774323:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260223.774327:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260223.774329:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260223.774336:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0700 x1818500098336896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260233 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260223.774351:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0700 x1818500098336896/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260233 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260223.774358:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260223.774361:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260223.774362:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260223.774365:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe1f80 x1818500098336768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260239 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260223.774369:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe1f80 x1818500098336768/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260239 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260223.774374:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b6d0ac00. 02000000:00000010:2.0:1734260223.774377:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc600. 02000000:00000010:1.0:1734260223.774378:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733400. 02000000:00000010:2.0:1734260223.774379:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4600. 00000100:00000010:1.0:1734260223.774381:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0700. 00000100:00000010:2.0:1734260223.774381:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe1f80. 00000100:00000010:0.0:1734260228.779928:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0e00. 02000000:00000010:0.0:1734260228.779944:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4e00. 00000100:00000010:0.0:1734260228.779994:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0a80. 02000000:00000010:0.0:1734260228.779999:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137732800. 02000000:00000010:3.0:1734260228.780015:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734260228.780022:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:0.0:1734260228.780026:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732000. 00000400:00000010:3.0:1734260228.780027:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:0.0:1734260228.780028:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d501b8. 00000100:00000200:3.0:1734260228.780032:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098337024, portal 25 00000400:00000010:0.0:1734260228.780033:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1880. 00000100:00000200:0.0:1734260228.780035:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098337152, portal 10 00000400:00000010:3.0:1734260228.780037:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734260228.780038:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098337024, offset 0 00000400:00000010:0.0:1734260228.780039:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1cc0. 00000100:00000200:0.0:1734260228.780040:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098337152, offset 0 00000400:00000200:3.0:1734260228.780046:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260228.780056:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260228.780061:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260228.780064:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260228.780077:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260228.780079:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260228.780081:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1365:1365:256:4294967295] 192.168.202.108@tcp LPNI seq info [1364:1364:8:4294967295] 00000400:00000200:3.0:1734260228.780089:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260228.780094:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260228.780097:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734260228.780102:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260228.780109:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260228.780111:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734260228.780211:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734260228.780213:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:3.0:1734260228.780216:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734260228.780220:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260228.780318:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260228.780323:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260228.780326:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260228.780328:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260228.780330:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260228.780331:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260228.780333:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1366:1366:255:4294967295] 192.168.202.108@tcp LPNI seq info [1365:1365:7:4294967295] 00000400:00000200:0.0:1734260228.780339:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260228.780342:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260228.780346:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4d00. 00000800:00000200:0.0:1734260228.780349:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260228.780357:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260228.780359:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4d00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:3.0:1734260228.780555:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:3.0:1734260228.780557:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734260228.780564:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0e00 x1818500098337024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260244 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734260228.780628:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734260228.780630:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4d00. 00000400:00000200:3.0:1734260228.780632:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734260228.780636:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260228.780638:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1cc0 00000400:00000010:3.0:1734260228.780639:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1cc0. 00000100:00000200:3.0:1734260228.780642:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0a80 x1818500098337152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260238 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260228.782654:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260228.782668:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62a900 00000400:00000200:0.0:1734260228.782676:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2b99 [1] + 224 00000400:00000200:0.0:1734260228.782691:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260228.782694:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260228.782703:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0e00 x1818500098337024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260244 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260228.782829:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260228.782834:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260228.782835:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260228.782840:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0e00 x1818500098337024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260244 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260228.782848:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0e00 x1818500098337024/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260244 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260228.782873:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734260228.782877:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4e00. 00000100:00000010:3.0:1734260228.782880:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0e00. 00000400:00000200:0.0:1734260228.783448:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260228.783455:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62a980 00000400:00000200:0.0:1734260228.783460:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2b9d [1] + 0 00000400:00000200:0.0:1734260228.783470:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260228.783473:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260228.783478:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0a80 x1818500098337152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260238 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260228.783659:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d501b8. 00000400:00000200:2.0:1734260228.783663:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1880 00000400:00000010:2.0:1734260228.783665:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1880. 00000100:00000200:2.0:1734260228.783669:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0a80 x1818500098337152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260238 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260228.783676:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0a80 x1818500098337152/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260238 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260228.783692:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732000. 02000000:00000010:2.0:1734260228.783696:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137732800. 00000100:00000010:2.0:1734260228.783698:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0a80. 00000100:00000010:0.0:1734260233.787815:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734260233.787834:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4300. 00000100:00000010:0.0:1734260233.787892:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734260233.787897:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:1.0:1734260233.788002:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0200. 00000400:00000010:1.0:1734260233.788009:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260233.788015:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260233.788021:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098337280, portal 25 00000400:00000010:1.0:1734260233.788025:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720cc0. 00000100:00000200:1.0:1734260233.788026:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098337280, offset 0 00000400:00000200:1.0:1734260233.788034:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260233.788044:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260233.788048:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:2.0:1734260233.788048:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000200:1.0:1734260233.788052:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:2.0:1734260233.788052:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000200:1.0:1734260233.788054:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260233.788056:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:2.0:1734260233.788056:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260233.788058:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098337408, portal 10 00000400:00000200:1.0:1734260233.788059:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1367:1367:256:4294967295] 192.168.202.108@tcp LPNI seq info [1366:1366:8:4294967295] 00000400:00000010:2.0:1734260233.788062:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e6e8. 00000100:00000200:2.0:1734260233.788063:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098337408, offset 0 00000400:00000200:1.0:1734260233.788065:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:2.0:1734260233.788068:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:1.0:1734260233.788069:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260233.788073:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021a00. 00000400:00000200:2.0:1734260233.788073:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:1.0:1734260233.788078:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260233.788085:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734260233.788085:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260233.788087:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734260233.788088:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021a00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734260233.788089:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260233.788091:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260233.788092:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1368:1368:255:4294967295] 192.168.202.108@tcp LPNI seq info [1367:1367:7:4294967295] 00000400:00000200:2.0:1734260233.788098:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260233.788101:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260233.788104:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734260233.788107:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260233.788110:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260233.788112:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734260233.788181:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734260233.788184:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021a00. 00000400:00000200:3.0:1734260233.788188:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734260233.788192:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260233.788195:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720cc0 00000400:00000010:3.0:1734260233.788197:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720cc0. 00000100:00000200:3.0:1734260233.788203:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098337280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260249 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734260233.788264:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734260233.788266:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:3.0:1734260233.788269:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734260233.788271:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260233.788273:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e6e8 00000400:00000010:3.0:1734260233.788274:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e6e8. 00000100:00000200:3.0:1734260233.788277:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098337408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260243 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260233.790197:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260233.790211:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62aa00 00000400:00000200:0.0:1734260233.790218:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2ba9 [1] + 224 00000400:00000200:0.0:1734260233.790228:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260233.790231:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260233.790238:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098337280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260249 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260233.790272:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260233.790285:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62aa80 00000400:00000200:0.0:1734260233.790289:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2bb1 [1] + 0 00000400:00000200:0.0:1734260233.790301:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260233.790303:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260233.790307:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098337408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260243 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260233.790355:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260233.790360:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260233.790361:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260233.790365:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098337280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260249 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260233.790380:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098337280/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260249 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260233.790397:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0200. 02000000:00000010:1.0:1734260233.790401:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4300. 00000100:00000010:1.0:1734260233.790404:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000400:00000010:2.0:1734260233.790410:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000400:00000200:2.0:1734260233.790414:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:2.0:1734260233.790415:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260233.790420:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098337408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260243 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260233.790427:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098337408/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260243 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260233.790441:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734260233.790444:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734260233.790446:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000100:00000010:2.0:1734260238.795760:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734260238.795781:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734260238.795834:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1aa00. 02000000:00000010:2.0:1734260238.795840:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734260238.795869:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734260238.795875:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58ca50. 00000400:00000010:2.0:1734260238.795881:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349ecc0. 00000100:00000200:2.0:1734260238.795886:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098337664, portal 10 02000000:00000010:0.0:1734260238.795887:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 00000400:00000010:0.0:1734260238.795891:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50210. 00000400:00000010:2.0:1734260238.795891:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e908. 00000400:00000010:0.0:1734260238.795894:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e15d8. 00000100:00000200:0.0:1734260238.795896:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098337536, portal 25 00000400:00000010:0.0:1734260238.795898:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e16e8. 00000100:00000200:0.0:1734260238.795900:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098337536, offset 0 00000100:00000200:2.0:1734260238.795902:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098337664, offset 0 00000400:00000200:0.0:1734260238.795907:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260238.795917:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260238.795921:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260238.795925:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260238.795928:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260238.795930:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260238.795932:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1369:1369:256:4294967295] 192.168.202.108@tcp LPNI seq info [1368:1368:8:4294967295] 00000400:00000200:0.0:1734260238.795939:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260238.795944:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260238.795947:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4400. 00000800:00000200:0.0:1734260238.795951:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260238.795957:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260238.795960:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4400 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1734260238.795982:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260238.795987:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260238.795989:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260238.795990:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260238.795992:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260238.795994:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260238.795995:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1370:1370:255:4294967295] 192.168.202.108@tcp LPNI seq info [1369:1369:7:4294967295] 00000400:00000200:2.0:1734260238.796001:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260238.796004:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260238.796007:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734260238.796009:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260238.796013:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260238.796014:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260238.796545:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260238.796549:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4400. 00000400:00000200:1.0:1734260238.796553:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260238.796558:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260238.796561:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e16e8 00000400:00000010:1.0:1734260238.796563:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e16e8. 00000100:00000200:1.0:1734260238.796709:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098337536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260254 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260238.796769:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260238.796771:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:1.0:1734260238.796774:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260238.796777:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260238.796779:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e908 00000400:00000010:1.0:1734260238.796781:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e908. 00000100:00000200:1.0:1734260238.796785:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1aa00 x1818500098337664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260248 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260238.798268:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260238.798281:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62ab00 00000400:00000200:0.0:1734260238.798288:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2bbd [1] + 224 00000400:00000200:0.0:1734260238.798298:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260238.798310:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260238.798317:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098337536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260254 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260238.798357:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260238.798361:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62ab80 00000400:00000200:0.0:1734260238.798365:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2bb9 [1] + 0 00000400:00000200:0.0:1734260238.798377:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260238.798380:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260238.798384:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1aa00 x1818500098337664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260248 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260238.798476:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50210. 00000400:00000200:2.0:1734260238.798486:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e15d8 00000400:00000010:2.0:1734260238.798489:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e15d8. 00000100:00000200:2.0:1734260238.798499:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098337536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260254 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260238.798504:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58ca50. 00000100:00000200:2.0:1734260238.798507:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098337536/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260254 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:3.0:1734260238.798510:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349ecc0 00000400:00000010:3.0:1734260238.798512:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349ecc0. 00000100:00000200:3.0:1734260238.798518:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1aa00 x1818500098337664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260248 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260238.798525:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1aa00 x1818500098337664/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260248 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260238.798533:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 02000000:00000010:2.0:1734260238.798540:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734260238.798544:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 02000000:00000010:3.0:1734260238.798547:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:3.0:1734260238.798552:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:3.0:1734260238.798555:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1aa00. 00000100:00000010:0.0:1734260243.803872:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0000. 02000000:00000010:0.0:1734260243.803891:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b34d4000. 00000100:00000010:0.0:1734260243.804133:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff8800abfe0380. 02000000:00000010:0.0:1734260243.804140:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff880137733800. 02000000:00000010:3.0:1734260243.804175:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800b60e4e00. 00000400:00000010:3.0:1734260243.804190:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260243.804195:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260243.804201:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098337792, portal 25 00000400:00000010:3.0:1734260243.804204:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734260243.804206:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098337792, offset 0 00000400:00000200:3.0:1734260243.804214:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260243.804224:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260243.804229:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260243.804232:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260243.804235:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260243.804237:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260243.804239:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1371:1371:256:4294967295] 192.168.202.108@tcp LPNI seq info [1370:1370:8:4294967295] 00000400:00000200:3.0:1734260243.804247:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260243.804251:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260243.804255:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734260243.804259:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260243.804265:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260243.804268:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734260243.804357:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734260243.804360:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:3.0:1734260243.804363:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734260243.804367:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260243.804371:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:3.0:1734260243.804372:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734260243.804379:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0000 x1818500098337792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260259 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260243.804560:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734260243.804563:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16e18. 00000400:00000010:3.0:1734260243.804565:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000100:00000200:3.0:1734260243.804588:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098337920, portal 10 00000400:00000010:3.0:1734260243.804593:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:3.0:1734260243.804598:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098337920, offset 0 00000400:00000200:3.0:1734260243.804602:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260243.804606:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260243.804608:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260243.804610:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260243.804612:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260243.804613:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260243.804615:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1372:1372:256:4294967295] 192.168.202.108@tcp LPNI seq info [1371:1371:8:4294967295] 00000400:00000200:3.0:1734260243.804620:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260243.804623:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260243.804625:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734260243.804628:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260243.804631:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260243.804633:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260243.804717:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260243.804720:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734260243.804722:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260243.804725:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260243.804728:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:1.0:1734260243.804729:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:1.0:1734260243.804733:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff8800abfe0380 x1818500098337920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260253 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260243.805796:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260243.805806:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62ac00 00000400:00000200:0.0:1734260243.805811:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2bc9 [1] + 224 00000400:00000200:0.0:1734260243.805819:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260243.805822:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260243.805828:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0000 x1818500098337792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260259 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260243.805860:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260243.805865:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62ac80 00000400:00000200:0.0:1734260243.805868:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2bd1 [1] + 0 00000400:00000200:0.0:1734260243.805878:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260243.805880:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260243.805884:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff8800abfe0380 x1818500098337920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260253 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260243.805905:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260243.805909:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260243.805911:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260243.805915:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0000 x1818500098337792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260259 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260243.805923:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0000 x1818500098337792/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260259 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260243.805941:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800b60e4e00. 02000000:00000010:3.0:1734260243.805944:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b34d4000. 00000100:00000010:3.0:1734260243.805947:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0000. 00000400:00000010:2.0:1734260243.806047:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16e18. 00000400:00000200:2.0:1734260243.806050:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:2.0:1734260243.806052:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:2.0:1734260243.806056:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff8800abfe0380 x1818500098337920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260253 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260243.806061:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff8800abfe0380 x1818500098337920/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260253 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260243.806081:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:2.0:1734260243.806084:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff880137733800. 00000100:00000010:2.0:1734260243.806086:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff8800abfe0380. 00000100:00000010:2.0:1734260248.811764:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1a300. 02000000:00000010:2.0:1734260248.811780:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800b404c000. 00000100:00000010:2.0:1734260248.811825:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012eb1ad80. 02000000:00000010:2.0:1734260248.811830:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734260248.811853:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32c00. 00000400:00000010:2.0:1734260248.811858:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734260248.811862:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260248.811866:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098338176, portal 10 00000400:00000010:2.0:1734260248.811870:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734260248.811872:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098338176, offset 0 00000400:00000200:2.0:1734260248.811878:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260248.811886:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260248.811890:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260248.811893:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260248.811895:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260248.811896:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260248.811898:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1373:1373:256:4294967295] 192.168.202.108@tcp LPNI seq info [1372:1372:8:4294967295] 00000400:00000200:2.0:1734260248.811903:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260248.811907:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260248.811909:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734260248.811913:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260248.811918:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260248.811920:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260248.811999:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260248.812001:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:2.0:1734260248.812005:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260248.812017:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260248.812020:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:2.0:1734260248.812022:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734260248.812027:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1ad80 x1818500098338176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260258 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260248.812106:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734260248.812110:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260248.812118:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260248.812120:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098338048, portal 25 00000400:00000010:1.0:1734260248.812123:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720d48. 00000100:00000200:1.0:1734260248.812124:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098338048, offset 0 00000400:00000200:1.0:1734260248.812127:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260248.812131:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260248.812133:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260248.812135:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260248.812136:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260248.812138:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260248.812140:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1374:1374:256:4294967295] 192.168.202.108@tcp LPNI seq info [1373:1373:8:4294967295] 00000400:00000200:1.0:1734260248.812145:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260248.812148:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260248.812427:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021500. 00000800:00000200:1.0:1734260248.812433:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260248.812437:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260248.812438:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1734260248.812915:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260248.812917:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021500. 00000400:00000200:2.0:1734260248.812920:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260248.812923:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260248.812926:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720d48 00000400:00000010:2.0:1734260248.812927:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720d48. 00000100:00000200:2.0:1734260248.812931:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012eb1a300 x1818500098338048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260264 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260248.813856:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260248.813867:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62ad80 00000400:00000200:0.0:1734260248.813872:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2bd9 [1] + 0 00000400:00000200:0.0:1734260248.813879:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260248.813881:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260248.813888:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1ad80 x1818500098338176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260258 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260248.813919:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260248.813923:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62ad00 00000400:00000200:0.0:1734260248.813926:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2be1 [1] + 224 00000400:00000200:0.0:1734260248.813937:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260248.813940:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260248.813944:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012eb1a300 x1818500098338048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260264 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260248.814079:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260248.814083:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260248.814085:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260248.814089:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1a300 x1818500098338048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260264 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260248.814095:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1a300 x1818500098338048/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260264 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260248.814112:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734260248.814115:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800b404c000. 00000100:00000010:1.0:1734260248.814118:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1a300. 00000400:00000010:2.0:1734260248.814174:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260248.814177:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260248.814178:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260248.814181:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012eb1ad80 x1818500098338176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260258 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260248.814187:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012eb1ad80 x1818500098338176/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260258 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260248.814201:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32c00. 02000000:00000010:2.0:1734260248.814204:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff88012aa32400. 00000100:00000010:2.0:1734260248.814206:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012eb1ad80. 00000100:00000010:3.0:1734260253.819741:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260253.819761:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbb00. 00000100:00000010:3.0:1734260253.819962:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260253.819968:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260253.820003:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734260253.820009:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260253.820024:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260253.820029:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098338432, portal 10 00000400:00000010:3.0:1734260253.820034:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734260253.820035:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098338432, offset 0 00000400:00000200:3.0:1734260253.820042:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260253.820052:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260253.820056:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260253.820059:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260253.820062:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260253.820064:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260253.820066:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1375:1375:256:4294967295] 192.168.202.108@tcp LPNI seq info [1374:1374:8:4294967295] 00000400:00000200:3.0:1734260253.820072:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260253.820077:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260253.820079:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734260253.820084:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260253.820090:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260253.820094:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:3.0:1734260253.820182:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734260253.820184:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:3.0:1734260253.820186:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734260253.820190:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 02000000:00000010:1.0:1734260253.820238:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1a00. 00000400:00000010:1.0:1734260253.820242:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260253.820245:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260253.820247:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098338304, portal 25 00000400:00000010:1.0:1734260253.820255:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720aa0. 00000100:00000200:1.0:1734260253.820256:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098338304, offset 0 00000400:00000200:1.0:1734260253.820260:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260253.820264:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260253.820266:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260253.820268:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260253.820269:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260253.820270:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260253.820272:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1376:1376:255:4294967295] 192.168.202.108@tcp LPNI seq info [1375:1375:7:4294967295] 00000400:00000200:1.0:1734260253.820277:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260253.820280:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260253.820283:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021000. 00000800:00000200:1.0:1734260253.820285:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260253.820288:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260253.820290:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734260253.820761:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:3.0:1734260253.820764:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734260253.820770:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098338432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260263 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:3.0:1734260253.820819:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1734260253.820820:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021000. 00000400:00000200:3.0:1734260253.820823:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1734260253.820826:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260253.820828:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720aa0 00000400:00000010:3.0:1734260253.820829:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720aa0. 00000100:00000200:3.0:1734260253.820838:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098338304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260269 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260253.822508:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260253.822520:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62ae80 00000400:00000200:0.0:1734260253.822527:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2be9 [1] + 0 00000400:00000200:0.0:1734260253.822535:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260253.822538:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260253.822544:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098338432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260263 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260253.822610:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260253.822614:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62ae00 00000400:00000200:0.0:1734260253.822618:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2bf1 [1] + 224 00000400:00000010:3.0:1734260253.822623:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260253.822627:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260253.822628:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000400:00000200:0.0:1734260253.822631:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000200:3.0:1734260253.822633:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098338432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260263 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260253.822634:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:3.0:1734260253.822639:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098338432/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260263 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:0.0:1734260253.822642:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098338304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260269 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260253.822659:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260253.822663:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260253.822666:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:1.0:1734260253.822839:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260253.822842:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260253.822843:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260253.822847:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098338304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260269 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260253.822853:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098338304/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260269 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260253.822863:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1a00. 02000000:00000010:1.0:1734260253.822866:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbb00. 00000100:00000010:1.0:1734260253.822868:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260258.827686:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260258.827705:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db500. 00000100:00000010:3.0:1734260258.827765:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260258.827771:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260258.827800:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734260258.827805:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260258.827811:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260258.827816:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098338688, portal 10 00000400:00000010:3.0:1734260258.827820:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:3.0:1734260258.827822:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098338688, offset 0 00000400:00000200:3.0:1734260258.827829:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260258.827840:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260258.827845:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000010:0.0:1734260258.827846:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3ae00. 00000400:00000200:3.0:1734260258.827848:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260258.827851:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260258.827853:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260258.827855:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1377:1377:256:4294967295] 192.168.202.108@tcp LPNI seq info [1376:1376:8:4294967295] 00000400:00000010:0.0:1734260258.827857:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50268. 00000400:00000200:3.0:1734260258.827862:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:0.0:1734260258.827863:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1550. 00000800:00000200:3.0:1734260258.827867:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734260258.827869:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098338560, portal 25 00000400:00000010:0.0:1734260258.827873:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1bb0. 00000100:00000200:0.0:1734260258.827879:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098338560, offset 0 00000800:00000010:3.0:1734260258.827879:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734260258.827884:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734260258.827887:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734260258.827891:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260258.827895:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734260258.827896:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260258.827901:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260258.827904:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260258.827907:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260258.827909:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260258.827911:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1378:1378:255:4294967295] 192.168.202.108@tcp LPNI seq info [1377:1377:7:4294967295] 00000400:00000200:0.0:1734260258.827919:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260258.827923:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260258.827926:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4500. 00000800:00000200:0.0:1734260258.827929:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260258.827934:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260258.827937:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4500 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260258.827996:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260258.828000:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:1.0:1734260258.828005:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260258.828009:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260258.828013:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:1.0:1734260258.828014:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:1.0:1734260258.828025:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098338688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260268 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260258.828226:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260258.828229:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4500. 00000400:00000200:1.0:1734260258.828231:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260258.828234:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260258.828237:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1bb0 00000400:00000010:1.0:1734260258.828238:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1bb0. 00000100:00000200:1.0:1734260258.828242:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098338560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260274 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260258.829614:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260258.829626:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62af00 00000400:00000200:0.0:1734260258.829633:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c01 [1] + 224 00000400:00000200:0.0:1734260258.829641:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260258.829643:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260258.829650:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098338560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260258.829683:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260258.829695:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62af80 00000400:00000200:0.0:1734260258.829699:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2bf9 [1] + 0 00000400:00000200:0.0:1734260258.829711:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260258.829714:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260258.829718:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098338688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260268 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260258.829750:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50268. 00000400:00000200:2.0:1734260258.829754:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1550 00000400:00000010:2.0:1734260258.829756:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1550. 00000100:00000200:2.0:1734260258.829760:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098338560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260274 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260258.829767:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098338560/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260274 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260258.829770:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260258.829773:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260258.829774:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260258.829778:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098338688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260268 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260258.829785:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3ae00. 00000100:00000200:3.0:1734260258.829785:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098338688/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260268 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260258.829794:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db500. 00000100:02020000:3.0:1734260258.829795:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 00000100:00000010:2.0:1734260258.829797:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260258.829802:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260258.829805:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260258.829807:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260263.836013:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260263.836032:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbe00. 00000100:00000010:3.0:1734260263.836083:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260263.836088:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:0.0:1734260263.836099:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 00000400:00000010:0.0:1734260263.836106:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d502c0. 02000000:00000010:3.0:1734260263.836109:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:0.0:1734260263.836112:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1440. 00000400:00000010:3.0:1734260263.836112:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000100:00000200:0.0:1734260263.836117:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098338816, portal 25 00000400:00000010:3.0:1734260263.836117:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260263.836120:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098338944, portal 10 00000400:00000010:0.0:1734260263.836121:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1198. 00000100:00000200:0.0:1734260263.836123:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098338816, offset 0 00000400:00000010:3.0:1734260263.836124:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000100:00000200:3.0:1734260263.836126:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098338944, offset 0 00000400:00000200:0.0:1734260263.836130:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260263.836141:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260263.836141:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260263.836146:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260263.836150:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260263.836152:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260263.836154:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260263.836157:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1379:1379:256:4294967295] 192.168.202.108@tcp LPNI seq info [1378:1378:8:4294967295] 00000400:00000200:0.0:1734260263.836164:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260263.836169:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260263.836172:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000400:00000200:3.0:1734260263.836172:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260263.836174:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1734260263.836177:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260263.836177:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260263.836178:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260263.836180:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:0.0:1734260263.836184:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260263.836187:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734260263.836192:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1380:1380:255:4294967295] 192.168.202.108@tcp LPNI seq info [1379:1379:7:4294967295] 00000400:00000200:3.0:1734260263.836198:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260263.836202:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260263.836204:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000800:00000200:3.0:1734260263.836207:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260263.836211:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260263.836213:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260263.836320:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260263.836323:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:1.0:1734260263.836327:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260263.836331:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260263.836334:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1198 00000400:00000010:1.0:1734260263.836336:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1198. 00000100:00000200:1.0:1734260263.836342:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098338816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260279 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260263.836553:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260263.836555:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734260263.836557:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260263.836560:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260263.836563:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:1.0:1734260263.836564:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:1.0:1734260263.836592:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098338944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260273 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260263.837966:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260263.837979:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b000 00000400:00000200:0.0:1734260263.837986:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c09 [1] + 224 00000400:00000200:0.0:1734260263.838008:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260263.838017:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260263.838025:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098338816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260263.838151:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d502c0. 00000400:00000200:2.0:1734260263.838156:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1440 00000400:00000010:2.0:1734260263.838157:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1440. 00000100:00000200:2.0:1734260263.838162:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098338816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260279 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260263.838168:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098338816/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260279 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260263.838187:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734260263.838191:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbe00. 00000100:00000010:2.0:1734260263.838194:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000200:0.0:1734260263.838788:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260263.838795:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b080 00000400:00000200:0.0:1734260263.838800:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c0d [1] + 0 00000400:00000200:0.0:1734260263.838812:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260263.838815:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260263.838821:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098338944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260263.838966:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260263.838970:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260263.838971:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260263.838975:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098338944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260273 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260263.838982:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098338944/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260273 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260263.838998:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260263.839000:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260263.839002:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260268.844006:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260268.844025:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db000. 00000100:00000010:3.0:1734260268.844082:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260268.844087:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260268.844118:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 02000000:00000010:1.0:1734260268.844119:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1c00. 00000400:00000010:3.0:1734260268.844124:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:1.0:1734260268.844125:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260268.844130:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260268.844130:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734260268.844140:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098339072, portal 25 00000400:00000010:1.0:1734260268.844143:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720110. 00000100:00000200:3.0:1734260268.844265:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098339200, portal 10 00000100:00000200:1.0:1734260268.844266:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098339072, offset 0 00000400:00000010:3.0:1734260268.844271:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734260268.844273:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098339200, offset 0 00000400:00000200:3.0:1734260268.844280:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260268.844286:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260268.844290:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260268.844295:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260268.844303:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260268.844306:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260268.844308:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260268.844310:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1381:1381:256:4294967295] 192.168.202.108@tcp LPNI seq info [1380:1380:8:4294967295] 00000400:00000200:3.0:1734260268.844318:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260268.844323:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260268.844324:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260268.844325:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000400:00000200:1.0:1734260268.844327:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260268.844329:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260268.844331:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734260268.844331:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260268.844333:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260268.844335:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1382:1382:255:4294967295] 192.168.202.108@tcp LPNI seq info [1381:1381:7:4294967295] 00000800:00000200:3.0:1734260268.844337:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260268.844340:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734260268.844342:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260268.844345:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260268.844348:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021100. 00000800:00000200:1.0:1734260268.844351:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260268.844354:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260268.844356:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021100 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260268.844427:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260268.844430:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734260268.844434:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260268.844438:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260268.844442:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734260268.844443:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734260268.844450:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098339200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260268.844507:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260268.844510:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021100. 00000400:00000200:0.0:1734260268.844512:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260268.844515:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260268.844516:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720110 00000400:00000010:0.0:1734260268.844517:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720110. 00000100:00000200:0.0:1734260268.844521:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098339072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260284 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260268.846145:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260268.846158:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b180 00000400:00000200:0.0:1734260268.846164:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c1d [1] + 0 00000400:00000200:0.0:1734260268.846173:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260268.846183:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260268.846191:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098339200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260268.846217:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260268.846220:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b100 00000400:00000200:0.0:1734260268.846222:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c19 [1] + 224 00000400:00000200:0.0:1734260268.846232:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260268.846245:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260268.846249:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098339072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260284 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260268.846263:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260268.846267:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260268.846268:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260268.846273:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098339200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260268.846280:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098339200/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260278 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260268.846303:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260268.846307:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000400:00000010:1.0:1734260268.846308:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000100:00000010:3.0:1734260268.846310:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000200:1.0:1734260268.846312:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260268.846313:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260268.846317:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098339072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260284 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260268.846323:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098339072/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260284 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260268.846334:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1c00. 02000000:00000010:1.0:1734260268.846337:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db000. 00000100:00000010:1.0:1734260268.846339:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260273.851680:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260273.851699:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db200. 00000100:00000010:3.0:1734260273.851749:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260273.851755:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260273.851784:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734260273.851789:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:2.0:1734260273.851790:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734260273.851795:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734260273.851795:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:2.0:1734260273.851800:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:3.0:1734260273.851800:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098339456, portal 10 00000100:00000200:2.0:1734260273.851803:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098339328, portal 25 00000400:00000010:2.0:1734260273.851805:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000400:00000010:3.0:1734260273.851805:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610add0. 00000100:00000200:3.0:1734260273.851806:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098339456, offset 0 00000100:00000200:2.0:1734260273.851807:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098339328, offset 0 00000400:00000200:2.0:1734260273.851814:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260273.851821:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260273.851824:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260273.851829:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260273.851832:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260273.851835:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260273.851837:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260273.851839:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1383:1383:256:4294967295] 192.168.202.108@tcp LPNI seq info [1382:1382:8:4294967295] 00000400:00000200:2.0:1734260273.851846:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260273.851849:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260273.851851:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734260273.851852:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000400:00000200:3.0:1734260273.851853:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260273.851855:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734260273.851857:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260273.851857:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260273.851859:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260273.851862:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1384:1384:255:4294967295] 192.168.202.108@tcp LPNI seq info [1383:1383:7:4294967295] 00000800:00000200:2.0:1734260273.851864:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260273.851866:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734260273.851867:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260273.851871:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260273.851874:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734260273.851876:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260273.851880:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260273.851882:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260273.851962:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260273.851966:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734260273.851971:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260273.851975:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260273.851978:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734260273.851980:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734260273.851987:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098339328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260289 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260273.852056:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260273.852058:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734260273.852060:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260273.852063:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260273.852065:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610add0 00000400:00000010:0.0:1734260273.852066:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610add0. 00000100:00000200:0.0:1734260273.852070:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098339456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260273.853849:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260273.853861:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b200 00000400:00000200:0.0:1734260273.853865:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c2d [1] + 224 00000400:00000200:0.0:1734260273.853873:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260273.853884:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260273.853892:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098339328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260289 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260273.853931:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260273.853938:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b280 00000400:00000200:0.0:1734260273.853942:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c29 [1] + 0 00000400:00000200:0.0:1734260273.853952:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260273.853955:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260273.853959:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098339456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260283 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260273.854034:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260273.854038:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260273.854040:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260273.854044:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098339328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260289 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260273.854050:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098339328/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260289 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260273.854066:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260273.854070:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db200. 00000100:00000010:2.0:1734260273.854072:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:3.0:1734260273.854114:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260273.854119:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260273.854120:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260273.854125:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098339456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260273.854131:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098339456/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260283 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260273.854146:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260273.854149:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260273.854151:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260278.859718:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260278.859737:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db000. 00000100:00000010:3.0:1734260278.859802:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260278.859809:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:0.0:1734260278.859833:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b600. 02000000:00000010:3.0:1734260278.859835:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:0.0:1734260278.859840:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50318. 00000400:00000010:3.0:1734260278.859840:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:0.0:1734260278.859845:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1a18. 00000400:00000010:3.0:1734260278.859845:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734260278.859851:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098339584, portal 25 00000400:00000010:0.0:1734260278.859854:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e13b8. 00000100:00000200:0.0:1734260278.859856:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098339584, offset 0 00000100:00000200:3.0:1734260278.859858:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098339712, portal 10 00000400:00000010:3.0:1734260278.859862:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a220. 00000400:00000200:0.0:1734260278.859867:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260278.859877:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260278.859884:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260278.859888:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260278.859890:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260278.859892:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260278.859895:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1385:1385:256:4294967295] 192.168.202.108@tcp LPNI seq info [1384:1384:8:4294967295] 00000400:00000200:0.0:1734260278.859900:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260278.859904:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260278.859906:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4a00. 00000800:00000200:0.0:1734260278.859910:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260278.859916:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260278.859918:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4a00 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:3.0:1734260278.860043:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098339712, offset 0 00000400:00000200:3.0:1734260278.860049:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260278.860054:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260278.860056:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260278.860058:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260278.860060:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260278.860062:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260278.860064:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1386:1386:255:4294967295] 192.168.202.108@tcp LPNI seq info [1385:1385:7:4294967295] 00000800:00000200:1.0:1734260278.860067:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000400:00000200:3.0:1734260278.860069:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000010:1.0:1734260278.860070:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4a00. 00000400:00000200:1.0:1734260278.860073:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000800:00000200:3.0:1734260278.860073:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260278.860075:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734260278.860078:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260278.860081:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000800:00000200:3.0:1734260278.860082:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260278.860084:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e13b8 00000800:00000200:3.0:1734260278.860084:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 616 niov 1 nkiov 1 00000400:00000010:1.0:1734260278.860086:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e13b8. 00000100:00000200:1.0:1734260278.860092:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098339584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260278.860129:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260278.860130:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:1.0:1734260278.860132:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260278.860135:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260278.860137:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a220 00000400:00000010:1.0:1734260278.860142:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a220. 00000100:00000200:1.0:1734260278.860146:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098339712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260288 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260278.861801:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260278.861819:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b300 00000400:00000200:0.0:1734260278.861825:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c39 [1] + 224 00000400:00000200:0.0:1734260278.861835:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260278.861838:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260278.861846:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098339584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260294 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260278.861880:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260278.861884:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b380 00000400:00000200:0.0:1734260278.861888:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c41 [1] + 0 00000400:00000200:0.0:1734260278.861902:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260278.861905:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260278.861909:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098339712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260288 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260278.861913:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50318. 00000400:00000200:2.0:1734260278.861918:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1a18 00000400:00000010:2.0:1734260278.861919:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1a18. 00000100:00000200:2.0:1734260278.861925:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098339584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260278.861932:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098339584/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260294 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260278.861951:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b600. 02000000:00000010:2.0:1734260278.861955:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db000. 00000100:00000010:2.0:1734260278.861958:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:3.0:1734260278.861992:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260278.861996:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260278.861997:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260278.862001:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098339712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260288 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260278.862007:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098339712/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260288 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260278.862021:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260278.862024:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260278.862026:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260283.867713:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260283.867731:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbf00. 00000100:00000010:3.0:1734260283.867782:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260283.867788:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:2.0:1734260283.867818:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734260283.867825:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 02000000:00000010:3.0:1734260283.867826:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734260283.867829:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:2.0:1734260283.867831:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734260283.867832:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:2.0:1734260283.867837:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098339840, portal 25 00000100:00000200:3.0:1734260283.867838:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098339968, portal 10 00000400:00000010:2.0:1734260283.867841:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000400:00000010:3.0:1734260283.867841:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610acc0. 00000100:00000200:2.0:1734260283.867842:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098339840, offset 0 00000100:00000200:3.0:1734260283.867843:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098339968, offset 0 00000400:00000200:2.0:1734260283.867850:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260283.867855:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260283.867860:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260283.867865:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260283.867896:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260283.867899:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260283.867902:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260283.867910:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1387:1387:256:4294967295] 192.168.202.108@tcp LPNI seq info [1386:1386:8:4294967295] 00000400:00000200:2.0:1734260283.867917:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260283.867923:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260283.867925:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734260283.867927:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000400:00000200:3.0:1734260283.867927:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260283.867929:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260283.867931:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734260283.867932:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260283.867933:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260283.867935:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1388:1388:255:4294967295] 192.168.202.108@tcp LPNI seq info [1387:1387:7:4294967295] 00000800:00000200:2.0:1734260283.867939:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734260283.867941:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260283.867942:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734260283.867944:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260283.867946:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734260283.867949:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260283.867952:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260283.867954:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260283.868006:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260283.868010:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734260283.868014:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260283.868018:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260283.868021:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734260283.868023:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734260283.868029:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098339840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260299 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260283.868084:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260283.868086:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734260283.868087:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260283.868089:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260283.868091:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610acc0 00000400:00000010:0.0:1734260283.868092:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610acc0. 00000100:00000200:0.0:1734260283.868095:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098339968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260283.869869:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260283.869885:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b480 00000400:00000200:0.0:1734260283.869891:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c4d [1] + 0 00000400:00000200:0.0:1734260283.869901:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260283.869904:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260283.869911:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098339968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260293 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260283.869944:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260283.869948:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b400 00000400:00000200:0.0:1734260283.869952:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c49 [1] + 224 00000400:00000200:0.0:1734260283.869966:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260283.869969:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260283.869974:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098339840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260299 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260283.869977:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260283.869981:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260283.869983:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260283.869987:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098339968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260283.869993:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098339968/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260293 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260283.870014:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260283.870018:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260283.870021:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:2.0:1734260283.870062:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260283.870066:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260283.870067:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260283.870071:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098339840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260299 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260283.870077:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098339840/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260299 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260283.870089:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260283.870091:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbf00. 00000100:00000010:2.0:1734260283.870093:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260288.875680:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260288.875709:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db400. 00000100:00000010:3.0:1734260288.875768:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260288.875774:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:1.0:1734260288.875805:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 02000000:00000010:3.0:1734260288.875805:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:1.0:1734260288.875811:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:3.0:1734260288.875811:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:1.0:1734260288.875816:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260288.875817:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734260288.875821:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098340096, portal 25 00000400:00000010:1.0:1734260288.875824:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37203b8. 00000100:00000200:1.0:1734260288.875826:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098340096, offset 0 00000100:00000200:3.0:1734260288.875826:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098340224, portal 10 00000400:00000010:3.0:1734260288.875829:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a7f8. 00000400:00000200:1.0:1734260288.875832:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260288.875842:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260288.875846:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260288.875849:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260288.875852:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260288.875854:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260288.875856:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1389:1389:256:4294967295] 192.168.202.108@tcp LPNI seq info [1388:1388:8:4294967295] 00000400:00000200:1.0:1734260288.875863:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260288.875867:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260288.875870:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021700. 00000800:00000200:1.0:1734260288.875875:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260288.875882:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260288.875886:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021700 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:3.0:1734260288.875905:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098340224, offset 0 00000400:00000200:3.0:1734260288.875911:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260288.875916:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260288.875919:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260288.875921:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260288.875923:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260288.875925:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260288.875927:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1390:1390:255:4294967295] 192.168.202.108@tcp LPNI seq info [1389:1389:7:4294967295] 00000400:00000200:3.0:1734260288.875932:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260288.875935:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260288.875937:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734260288.875940:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260288.875943:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260288.875945:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260288.875985:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260288.875988:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021700. 00000400:00000200:0.0:1734260288.875991:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260288.875996:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260288.875999:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37203b8 00000400:00000010:0.0:1734260288.876000:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37203b8. 00000100:00000200:0.0:1734260288.876007:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098340096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260304 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260288.876061:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260288.876064:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734260288.876065:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260288.876068:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260288.876070:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a7f8 00000400:00000010:0.0:1734260288.876071:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a7f8. 00000100:00000200:0.0:1734260288.876081:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098340224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260298 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260288.877508:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260288.877522:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b500 00000400:00000200:0.0:1734260288.877528:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c59 [1] + 224 00000400:00000200:0.0:1734260288.877538:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260288.877541:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260288.877548:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098340096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260304 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260288.877600:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260288.877605:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b580 00000400:00000200:0.0:1734260288.877609:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c5d [1] + 0 00000400:00000200:0.0:1734260288.877622:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260288.877625:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260288.877629:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098340224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260298 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260288.877631:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260288.877641:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260288.877642:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260288.877653:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098340096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260304 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260288.877660:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098340096/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260304 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260288.877678:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734260288.877681:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db400. 00000100:00000010:1.0:1734260288.877685:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:3.0:1734260288.877709:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260288.877713:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260288.877714:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260288.877719:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098340224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260298 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260288.877726:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098340224/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260298 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260288.877742:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260288.877750:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260288.877752:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260293.883678:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260293.883710:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbb00. 00000100:00000010:3.0:1734260293.883766:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260293.883772:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:1.0:1734260293.883789:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1000. 00000400:00000010:1.0:1734260293.883796:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 02000000:00000010:3.0:1734260293.883796:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734260293.883800:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:1.0:1734260293.883802:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260293.883803:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734260293.883807:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098340352, portal 25 00000100:00000200:3.0:1734260293.883808:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098340480, portal 10 00000400:00000010:1.0:1734260293.883811:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720e58. 00000400:00000010:3.0:1734260293.883812:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a088. 00000100:00000200:1.0:1734260293.883813:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098340352, offset 0 00000100:00000200:3.0:1734260293.883814:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098340480, offset 0 00000400:00000200:3.0:1734260293.883820:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260293.883825:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260293.883830:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260293.883834:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260293.883838:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260293.883841:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260293.883843:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260293.883845:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1391:1391:256:4294967295] 192.168.202.108@tcp LPNI seq info [1390:1390:8:4294967295] 00000400:00000200:3.0:1734260293.883853:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260293.883857:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260293.883858:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260293.883860:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734260293.883860:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000400:00000200:1.0:1734260293.883862:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260293.883863:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260293.883864:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734260293.883865:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260293.883866:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1392:1392:255:4294967295] 192.168.202.108@tcp LPNI seq info [1391:1391:7:4294967295] 00000400:00000200:1.0:1734260293.883870:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260293.883871:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260293.883872:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260293.883874:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021300. 00000800:00000200:3.0:1734260293.883874:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260293.883876:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260293.883879:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260293.883881:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260293.883966:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260293.883969:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734260293.883973:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260293.883977:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260293.883981:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a088 00000400:00000010:0.0:1734260293.883982:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a088. 00000100:00000200:0.0:1734260293.883989:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098340480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260303 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260293.884042:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260293.884044:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021300. 00000400:00000200:0.0:1734260293.884047:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260293.884077:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260293.884080:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720e58 00000400:00000010:0.0:1734260293.884090:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720e58. 00000100:00000200:0.0:1734260293.884095:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098340352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260309 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260293.885681:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260293.885694:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b600 00000400:00000200:0.0:1734260293.885700:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c69 [1] + 224 00000400:00000200:0.0:1734260293.885711:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260293.885713:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260293.885720:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098340352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260293.885751:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260293.885755:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b680 00000400:00000200:0.0:1734260293.885759:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c6d [1] + 0 00000400:00000200:0.0:1734260293.885772:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260293.885779:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260293.885783:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098340480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260293.885840:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260293.885845:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260293.885846:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260293.885851:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098340480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260303 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260293.885858:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000100:00000200:3.0:1734260293.885858:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098340480/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260303 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:1.0:1734260293.885862:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260293.885863:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260293.885868:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098340352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260309 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260293.885882:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098340352/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260309 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260293.885885:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260293.885888:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260293.885890:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 02000000:00000010:1.0:1734260293.885892:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1000. 02000000:00000010:1.0:1734260293.885894:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbb00. 00000100:00000010:1.0:1734260293.885895:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260298.891714:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260298.891784:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbc00. 00000100:00000010:3.0:1734260298.891850:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260298.891857:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260298.891896:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734260298.891903:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260298.891909:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260298.891916:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098340736, portal 10 00000400:00000010:3.0:1734260298.891923:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a990. 00000100:00000200:3.0:1734260298.891925:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098340736, offset 0 00000400:00000200:3.0:1734260298.891934:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260298.891948:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260298.891953:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260298.891956:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260298.891959:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260298.891961:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260298.891964:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1393:1393:256:4294967295] 192.168.202.108@tcp LPNI seq info [1392:1392:8:4294967295] 00000400:00000200:3.0:1734260298.891973:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 02000000:00000010:2.0:1734260298.891977:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000800:00000200:3.0:1734260298.891978:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260298.891981:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734260298.891987:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000010:2.0:1734260298.891988:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734260298.891994:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000800:00000200:3.0:1734260298.891995:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260298.891998:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000100:00000200:2.0:1734260298.891999:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098340608, portal 25 00000400:00000010:2.0:1734260298.892004:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:2.0:1734260298.892006:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098340608, offset 0 00000400:00000200:2.0:1734260298.892039:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260298.892050:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260298.892054:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260298.892057:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260298.892060:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260298.892061:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260298.892064:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1394:1394:255:4294967295] 192.168.202.108@tcp LPNI seq info [1393:1393:7:4294967295] 00000400:00000200:2.0:1734260298.892085:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260298.892090:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260298.892093:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734260298.892097:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260298.892103:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260298.892106:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260298.892128:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260298.892134:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:1.0:1734260298.892137:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260298.892142:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260298.892145:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a990 00000400:00000010:1.0:1734260298.892146:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a990. 00000100:00000200:1.0:1734260298.892161:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098340736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260308 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260298.892185:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260298.892187:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:1.0:1734260298.892189:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260298.892192:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260298.892193:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:1.0:1734260298.892194:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:1.0:1734260298.892197:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098340608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260314 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260298.894362:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260298.894374:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b700 00000400:00000200:0.0:1734260298.894380:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c81 [1] + 224 00000400:00000200:0.0:1734260298.894388:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260298.894391:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260298.894399:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098340608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260314 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260298.894437:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260298.894442:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b780 00000400:00000200:0.0:1734260298.894447:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c79 [1] + 0 00000400:00000200:0.0:1734260298.894491:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260298.894494:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260298.894498:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098340736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260308 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260298.894592:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260298.894598:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260298.894599:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260298.894604:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098340608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260314 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260298.894606:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260298.894610:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000100:00000200:2.0:1734260298.894611:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098340608/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260314 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260298.894612:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260298.894620:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098340736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260308 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260298.894628:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098340736/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260308 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260298.894631:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260298.894634:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbc00. 00000100:00000010:2.0:1734260298.894638:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260298.894644:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260298.894646:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260298.894648:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260303.899827:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260303.899851:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db300. 02000000:00000010:2.0:1734260303.900077:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734260303.900095:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734260303.900101:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000010:3.0:1734260303.900102:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 00000100:00000200:2.0:1734260303.900109:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098340864, portal 25 02000000:00000010:3.0:1734260303.900109:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:2.0:1734260303.900113:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000100:00000200:2.0:1734260303.900115:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098340864, offset 0 00000400:00000200:2.0:1734260303.900123:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260303.900138:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 02000000:00000010:3.0:1734260303.900140:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000200:2.0:1734260303.900143:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000010:3.0:1734260303.900144:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:2.0:1734260303.900146:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000010:3.0:1734260303.900147:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000200:2.0:1734260303.900150:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000100:00000200:3.0:1734260303.900150:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098340992, portal 10 00000400:00000200:2.0:1734260303.900152:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:3.0:1734260303.900154:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a440. 00000400:00000200:2.0:1734260303.900155:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1395:1395:256:4294967295] 192.168.202.108@tcp LPNI seq info [1394:1394:8:4294967295] 00000100:00000200:3.0:1734260303.900156:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098340992, offset 0 00000400:00000200:3.0:1734260303.900160:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260303.900163:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260303.900181:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260303.900185:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734260303.900191:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260303.900199:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260303.900203:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734260303.900433:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260303.900436:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260303.900438:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260303.900440:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260303.900442:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260303.900444:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1396:1396:255:4294967295] 192.168.202.108@tcp LPNI seq info [1395:1395:7:4294967295] 00000400:00000200:3.0:1734260303.900450:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260303.900454:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260303.900456:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000800:00000200:3.0:1734260303.900459:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260303.900463:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260303.900465:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260303.900691:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260303.900694:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734260303.900699:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260303.900704:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260303.900707:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734260303.900709:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734260303.900716:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098340864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260319 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260303.900753:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260303.900755:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734260303.900757:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260303.900760:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260303.900762:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a440 00000400:00000010:0.0:1734260303.900763:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a440. 00000100:00000200:0.0:1734260303.900766:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098340992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260313 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260303.903538:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260303.903558:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b800 00000400:00000200:0.0:1734260303.903594:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2c89 [1] + 224 00000400:00000200:0.0:1734260303.903608:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260303.903611:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260303.903621:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098340864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260319 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260303.903656:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260303.903660:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b880 00000400:00000200:0.0:1734260303.903665:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c91 [1] + 0 00000400:00000200:0.0:1734260303.903692:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260303.903694:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260303.903699:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098340992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260313 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260303.903718:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260303.903723:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260303.903724:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260303.903729:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098340864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260319 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260303.903734:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098340864/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260319 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260303.903758:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260303.903761:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db300. 00000100:00000010:2.0:1734260303.903765:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:3.0:1734260303.903804:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260303.903809:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260303.903810:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260303.903816:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098340992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260313 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260303.903822:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098340992/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260313 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260303.903840:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260303.903843:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260303.903845:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260308.908185:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260308.908204:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbd00. 00000100:00000010:3.0:1734260308.908263:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260308.908269:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260308.908307:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734260308.908313:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260308.908319:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260308.908324:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098341248, portal 10 00000400:00000010:3.0:1734260308.908329:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a660. 00000100:00000200:3.0:1734260308.908330:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098341248, offset 0 00000400:00000200:3.0:1734260308.908337:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260308.908352:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260308.908356:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260308.908360:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260308.908363:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260308.908365:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260308.908367:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1397:1397:256:4294967295] 192.168.202.108@tcp LPNI seq info [1396:1396:8:4294967295] 00000400:00000200:3.0:1734260308.908378:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260308.908383:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260308.908386:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000800:00000200:3.0:1734260308.908401:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260308.908407:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260308.908411:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260308.908744:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260308.908748:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734260308.908752:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260308.908756:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260308.908759:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a660 00000400:00000010:0.0:1734260308.908761:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a660. 00000100:00000200:0.0:1734260308.908767:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098341248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260318 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260308.908839:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0000. 00000400:00000010:1.0:1734260308.908844:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260308.908847:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260308.908850:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098341120, portal 25 00000400:00000010:1.0:1734260308.908852:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720b28. 00000100:00000200:1.0:1734260308.908853:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098341120, offset 0 00000400:00000200:1.0:1734260308.908857:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260308.908861:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260308.908864:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260308.908866:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260308.908871:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260308.908872:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260308.908875:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1398:1398:256:4294967295] 192.168.202.108@tcp LPNI seq info [1397:1397:8:4294967295] 00000400:00000200:1.0:1734260308.908880:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260308.908884:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260308.908886:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:1.0:1734260308.908888:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260308.908892:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260308.908894:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260308.909003:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260308.909005:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734260308.909007:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260308.909010:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260308.909012:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720b28 00000400:00000010:0.0:1734260308.909013:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720b28. 00000100:00000200:0.0:1734260308.909016:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098341120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260324 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260308.912616:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260308.912633:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62b900 00000400:00000200:0.0:1734260308.912640:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2ca1 [1] + 224 00000400:00000200:0.0:1734260308.912658:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260308.912662:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260308.912671:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098341120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260324 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260308.912955:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260308.912960:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260308.912961:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260308.912966:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098341120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260324 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260308.912972:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098341120/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260324 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260308.912993:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0000. 02000000:00000010:1.0:1734260308.912997:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbd00. 00000100:00000010:1.0:1734260308.913000:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000200:0.0:1734260308.913608:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260308.913614:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62b980 00000400:00000200:0.0:1734260308.913619:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2c99 [1] + 0 00000400:00000200:0.0:1734260308.913637:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260308.913640:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260308.913644:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098341248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260318 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260308.913921:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260308.913925:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260308.913926:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260308.913931:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098341248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260318 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260308.913937:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098341248/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260318 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260308.913966:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260308.913969:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260308.913971:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260313.915779:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260313.915797:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db900. 00000100:00000010:3.0:1734260313.915849:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260313.915854:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260313.915883:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5807000. 00000400:00000010:3.0:1734260313.915888:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260313.915893:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260313.915899:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098341504, portal 10 02000000:00000010:2.0:1734260313.915917:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:3.0:1734260313.915918:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a3b8. 00000100:00000200:3.0:1734260313.915920:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098341504, offset 0 00000400:00000010:2.0:1734260313.915923:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:3.0:1734260313.915930:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:2.0:1734260313.915936:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260313.915939:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098341376, portal 25 00000400:00000010:2.0:1734260313.915941:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000400:00000200:3.0:1734260313.915941:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000100:00000200:2.0:1734260313.915943:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098341376, offset 0 00000400:00000200:3.0:1734260313.915946:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260313.915947:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260313.915950:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260313.915952:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260313.915954:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260313.915957:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1399:1399:256:4294967295] 192.168.202.108@tcp LPNI seq info [1398:1398:8:4294967295] 00000400:00000200:3.0:1734260313.915964:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260313.915979:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260313.915980:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260313.915982:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734260313.915982:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000400:00000200:2.0:1734260313.915985:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:3.0:1734260313.915986:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734260313.915987:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260313.915989:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260313.915991:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1400:1400:255:4294967295] 192.168.202.108@tcp LPNI seq info [1399:1399:7:4294967295] 00000800:00000200:3.0:1734260313.915993:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260313.915996:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734260313.915997:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260313.916001:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260313.916008:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734260313.916011:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260313.916015:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260313.916017:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260313.916100:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260313.916102:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734260313.916106:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260313.916109:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260313.916112:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a3b8 00000400:00000010:0.0:1734260313.916113:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a3b8. 00000100:00000200:0.0:1734260313.916118:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098341504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260323 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260313.916277:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260313.916279:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734260313.916280:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260313.916283:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260313.916284:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:0.0:1734260313.916285:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:0.0:1734260313.916287:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098341376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260329 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260313.919076:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260313.919092:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62ba80 00000400:00000200:0.0:1734260313.919099:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2ca9 [1] + 0 00000400:00000200:0.0:1734260313.919117:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260313.919120:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260313.919128:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098341504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260323 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260313.919369:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260313.919373:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260313.919375:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260313.919379:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098341504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260323 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260313.919385:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098341504/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260323 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260313.919410:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260313.919414:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260313.919417:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000200:0.0:1734260313.919748:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260313.919753:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62ba00 00000400:00000200:0.0:1734260313.919758:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2cb1 [1] + 224 00000400:00000200:0.0:1734260313.919775:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260313.919777:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260313.919783:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098341376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260329 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260313.920010:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260313.920014:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260313.920015:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260313.920019:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098341376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260329 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260313.920024:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098341376/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260329 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260313.920035:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260313.920037:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db900. 00000100:00000010:2.0:1734260313.920039:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260318.924110:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260318.924129:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dba00. 00000100:00000010:3.0:1734260318.924193:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260318.924199:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:0.0:1734260318.924293:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3ae00. 00000400:00000010:0.0:1734260318.924300:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50370. 00000400:00000010:0.0:1734260318.924306:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1aa0. 00000100:00000200:0.0:1734260318.924311:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098341632, portal 25 00000400:00000010:0.0:1734260318.924315:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734260318.924317:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098341632, offset 0 00000400:00000200:0.0:1734260318.924324:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260318.924335:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260318.924339:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260318.924343:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260318.924346:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260318.924347:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260318.924350:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1401:1401:256:4294967295] 192.168.202.108@tcp LPNI seq info [1400:1400:8:4294967295] 00000400:00000200:0.0:1734260318.924357:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260318.924363:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260318.924366:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734260318.924371:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260318.924377:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260318.924380:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260318.924477:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260318.924481:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:0.0:1734260318.924483:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260318.924487:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260318.924490:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:0.0:1734260318.924491:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734260318.924497:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098341632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260334 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260318.924650:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734260318.924655:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734260318.924658:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260318.924660:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098341760, portal 10 00000400:00000010:2.0:1734260318.924664:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734260318.924666:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098341760, offset 0 00000400:00000200:2.0:1734260318.924669:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260318.924674:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260318.924676:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260318.924678:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260318.924680:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260318.924681:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260318.924683:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1402:1402:256:4294967295] 192.168.202.108@tcp LPNI seq info [1401:1401:8:4294967295] 00000400:00000200:2.0:1734260318.924688:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260318.924691:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260318.924694:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734260318.924701:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260318.924704:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260318.924707:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260318.925067:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260318.925070:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734260318.925073:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260318.925076:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260318.925078:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734260318.925079:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734260318.925083:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098341760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260328 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260318.927045:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260318.927060:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62bb00 00000400:00000200:0.0:1734260318.927068:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2cb9 [1] + 224 00000400:00000200:0.0:1734260318.927086:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260318.927090:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260318.927098:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098341632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260334 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260318.927437:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50370. 00000400:00000200:2.0:1734260318.927442:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1aa0 00000400:00000010:2.0:1734260318.927444:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1aa0. 00000100:00000200:2.0:1734260318.927449:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098341632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260334 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260318.927456:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098341632/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260334 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260318.927474:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3ae00. 02000000:00000010:2.0:1734260318.927478:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dba00. 00000100:00000010:2.0:1734260318.927481:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000200:0.0:1734260318.927955:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260318.927963:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62bb80 00000400:00000200:0.0:1734260318.927968:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2cc1 [1] + 0 00000400:00000200:0.0:1734260318.927979:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260318.927982:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260318.927987:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098341760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260328 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260318.928041:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260318.928045:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260318.928046:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260318.928051:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098341760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260328 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260318.928058:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098341760/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260328 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260318.928073:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734260318.928077:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:2.0:1734260318.928080:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260323.931920:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260323.931941:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db100. 02000000:00000010:1.0:1734260323.932026:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734260323.932033:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260323.932040:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260323.932045:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098341888, portal 25 00000400:00000010:1.0:1734260323.932049:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37207f8. 00000100:00000200:1.0:1734260323.932050:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098341888, offset 0 00000400:00000200:1.0:1734260323.932058:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260323.932069:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260323.932073:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260323.932077:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260323.932080:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260323.932082:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260323.932095:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1403:1403:256:4294967295] 192.168.202.108@tcp LPNI seq info [1402:1402:8:4294967295] 00000400:00000200:1.0:1734260323.932103:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260323.932107:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260323.932111:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000800:00000200:1.0:1734260323.932116:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260323.932122:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260323.932125:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260323.932275:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260323.932278:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734260323.932282:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260323.932285:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260323.932288:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37207f8 00000400:00000010:0.0:1734260323.932290:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37207f8. 00000100:00000200:0.0:1734260323.932306:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098341888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:3.0:1734260323.932732:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260323.932741:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:2.0:1734260323.932782:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff88012aa32400. 00000400:00000010:2.0:1734260323.932787:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734260323.932789:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260323.932792:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098342016, portal 10 00000400:00000010:2.0:1734260323.932795:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:2.0:1734260323.932796:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098342016, offset 0 00000400:00000200:2.0:1734260323.932799:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260323.932803:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260323.932809:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260323.932811:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260323.932812:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260323.932813:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260323.932815:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1404:1404:256:4294967295] 192.168.202.108@tcp LPNI seq info [1403:1403:8:4294967295] 00000400:00000200:2.0:1734260323.932819:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260323.932821:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260323.932823:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c100. 00000800:00000200:2.0:1734260323.932825:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260323.932829:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260323.932855:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c100 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260323.932935:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260323.932938:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c100. 00000400:00000200:0.0:1734260323.932940:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260323.932944:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260323.932946:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734260323.932947:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734260323.932952:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098342016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260333 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260323.934361:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260323.934374:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62bc80 00000400:00000200:0.0:1734260323.934379:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2cd1 [1] + 0 00000400:00000200:0.0:1734260323.934392:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260323.934395:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260323.934402:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098342016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260333 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260323.934431:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260323.934435:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62bc00 00000400:00000200:0.0:1734260323.934439:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2cc9 [1] + 224 00000400:00000200:0.0:1734260323.934452:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260323.934454:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260323.934458:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098341888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260339 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260323.934464:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260323.934469:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260323.934470:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260323.934475:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098342016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260333 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260323.934492:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098342016/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260333 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260323.934512:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff88012aa32400. 02000000:00000010:2.0:1734260323.934517:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:2.0:1734260323.934520:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:1.0:1734260323.934798:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260323.934803:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260323.934804:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260323.934808:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098341888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260323.934813:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098341888/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260339 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260323.934824:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260323.934827:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db100. 00000100:00000010:1.0:1734260323.934829:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260328.939830:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260328.939849:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbf00. 00000100:00000010:3.0:1734260328.939904:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260328.939911:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260328.939951:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:1.0:1734260328.939952:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734260328.939957:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:3.0:1734260328.939957:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:1.0:1734260328.939962:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260328.939962:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734260328.939969:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098342144, portal 25 00000400:00000010:1.0:1734260328.939973:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720198. 00000100:00000200:1.0:1734260328.939975:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098342144, offset 0 00000100:00000200:3.0:1734260328.939975:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098342272, portal 10 00000400:00000010:3.0:1734260328.939979:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aa18. 00000400:00000200:1.0:1734260328.939983:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260328.939994:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260328.939998:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260328.940001:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260328.940004:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260328.940006:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260328.940008:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1405:1405:256:4294967295] 192.168.202.108@tcp LPNI seq info [1404:1404:8:4294967295] 00000400:00000200:1.0:1734260328.940021:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260328.940026:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260328.940030:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021400. 00000800:00000200:1.0:1734260328.940035:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260328.940041:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260328.940044:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021400 type 1, nob 320 niov 1 nkiov 1 00000100:00000200:3.0:1734260328.940063:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098342272, offset 0 00000400:00000200:3.0:1734260328.940068:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260328.940072:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260328.940074:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260328.940076:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260328.940078:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260328.940080:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260328.940082:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1406:1406:255:4294967295] 192.168.202.108@tcp LPNI seq info [1405:1405:7:4294967295] 00000400:00000200:3.0:1734260328.940088:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260328.940091:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260328.940093:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734260328.940096:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260328.940100:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260328.940102:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260328.940174:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260328.940176:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021400. 00000400:00000200:0.0:1734260328.940181:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260328.940185:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260328.940188:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720198 00000400:00000010:0.0:1734260328.940193:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720198. 00000100:00000200:0.0:1734260328.940200:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098342144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260328.940256:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260328.940258:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734260328.940260:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260328.940262:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260328.940264:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aa18 00000400:00000010:0.0:1734260328.940265:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aa18. 00000100:00000200:0.0:1734260328.940268:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098342272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260338 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260328.942152:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260328.942167:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62bd00 00000400:00000200:0.0:1734260328.942174:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2cd9 [1] + 224 00000400:00000200:0.0:1734260328.942183:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260328.942186:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260328.942194:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098342144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260344 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260328.942231:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260328.942236:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62bd80 00000400:00000200:0.0:1734260328.942241:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2cdd [1] + 0 00000400:00000200:0.0:1734260328.942253:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260328.942256:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260328.942260:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098342272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260338 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260328.942355:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260328.942359:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260328.942361:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260328.942365:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098342144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260328.942371:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098342144/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260344 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260328.942389:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260328.942393:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbf00. 00000100:00000010:1.0:1734260328.942396:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:3.0:1734260328.942451:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260328.942455:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260328.942456:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260328.942459:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098342272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260338 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260328.942465:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098342272/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260338 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260328.942479:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260328.942482:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:3.0:1734260328.942484:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260333.947721:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260333.947739:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbe00. 00000100:00000010:3.0:1734260333.947827:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260333.947833:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260333.947879:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734260333.947885:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260333.947891:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260333.947897:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098342528, portal 10 00000400:00000010:3.0:1734260333.947902:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a880. 00000100:00000200:3.0:1734260333.947903:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098342528, offset 0 00000400:00000200:3.0:1734260333.947911:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260333.947922:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260333.947927:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260333.947931:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260333.947934:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260333.947936:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260333.947939:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1407:1407:256:4294967295] 192.168.202.108@tcp LPNI seq info [1406:1406:8:4294967295] 00000400:00000200:3.0:1734260333.947946:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260333.947951:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260333.947955:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000800:00000200:3.0:1734260333.947960:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260333.947966:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260333.947969:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734260333.948065:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734260333.948070:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260333.948073:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260333.948075:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098342400, portal 25 00000400:00000010:1.0:1734260333.948078:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720088. 00000100:00000200:1.0:1734260333.948079:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098342400, offset 0 00000400:00000200:1.0:1734260333.948083:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260333.948087:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260333.948089:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260333.948091:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260333.948093:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260333.948094:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260333.948096:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1408:1408:255:4294967295] 192.168.202.108@tcp LPNI seq info [1407:1407:7:4294967295] 00000400:00000200:1.0:1734260333.948102:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260333.948108:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000200:1.0:1734260333.948111:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260333.948112:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000800:00000010:1.0:1734260333.948113:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021800. 00000800:00000200:1.0:1734260333.948116:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734260333.948117:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000800:00000200:1.0:1734260333.948120:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734260333.948121:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000800:00000200:1.0:1734260333.948122:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021800 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734260333.948125:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a880 00000400:00000010:0.0:1734260333.948130:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a880. 00000100:00000200:0.0:1734260333.948137:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098342528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260343 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260333.948166:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260333.948167:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021800. 00000400:00000200:0.0:1734260333.948169:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260333.948172:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260333.948174:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720088 00000400:00000010:0.0:1734260333.948175:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720088. 00000100:00000200:0.0:1734260333.948178:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098342400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260349 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260333.950465:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260333.950493:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62be00 00000400:00000200:0.0:1734260333.950501:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2cf1 [1] + 224 00000400:00000200:0.0:1734260333.950513:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260333.950516:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260333.950524:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098342400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260349 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260333.950559:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260333.950565:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62be80 00000400:00000200:0.0:1734260333.950611:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2ce9 [1] + 0 00000400:00000200:0.0:1734260333.950626:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260333.950630:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260333.950634:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098342528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260343 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260333.950695:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260333.950700:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260333.950701:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260333.950706:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098342400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260349 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260333.950713:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098342400/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260349 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260333.950730:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260333.950734:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbe00. 00000100:00000010:1.0:1734260333.950737:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:3.0:1734260333.950769:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260333.950772:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260333.950773:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260333.950777:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098342528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260343 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260333.950782:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098342528/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260343 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260333.950797:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260333.950800:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:3.0:1734260333.950802:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260338.955674:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260338.955703:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db200. 00000100:00000010:3.0:1734260338.955767:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260338.955773:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:2.0:1734260338.955788:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734260338.955797:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 02000000:00000010:3.0:1734260338.955797:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734260338.955800:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:2.0:1734260338.955802:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734260338.955804:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:2.0:1734260338.955808:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098342656, portal 25 00000100:00000200:3.0:1734260338.955808:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098342784, portal 10 00000400:00000010:2.0:1734260338.955812:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000400:00000010:3.0:1734260338.955812:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a2a8. 00000100:00000200:2.0:1734260338.955813:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098342656, offset 0 00000100:00000200:3.0:1734260338.955814:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098342784, offset 0 00000400:00000200:2.0:1734260338.955821:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260338.955827:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260338.955832:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260338.955836:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260338.955843:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260338.955846:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260338.955848:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260338.955850:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1409:1409:256:4294967295] 192.168.202.108@tcp LPNI seq info [1408:1408:8:4294967295] 00000400:00000200:2.0:1734260338.955857:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260338.955861:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260338.955862:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734260338.955865:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000400:00000200:3.0:1734260338.955865:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260338.955866:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260338.955868:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734260338.955869:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260338.955870:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260338.955872:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1410:1410:255:4294967295] 192.168.202.108@tcp LPNI seq info [1409:1409:7:4294967295] 00000800:00000200:2.0:1734260338.955877:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734260338.955878:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260338.955879:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734260338.955881:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260338.955884:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734260338.955886:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260338.955889:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260338.955891:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260338.955985:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260338.955988:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734260338.955993:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260338.955997:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260338.956000:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734260338.956006:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734260338.956013:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098342656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260354 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260338.956070:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260338.956072:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000400:00000200:0.0:1734260338.956074:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260338.956077:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260338.956079:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a2a8 00000400:00000010:0.0:1734260338.956080:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a2a8. 00000100:00000200:0.0:1734260338.956084:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098342784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260348 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260338.961238:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260338.961259:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62bf80 00000400:00000200:0.0:1734260338.961269:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2cfd [1] + 0 00000400:00000200:0.0:1734260338.961293:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260338.961298:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260338.961308:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098342784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260348 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260338.961422:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260338.961427:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260338.961429:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260338.961434:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098342784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260348 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260338.961441:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098342784/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260348 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260338.961472:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260338.961485:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:3.0:1734260338.961489:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000200:0.0:1734260338.964717:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260338.964745:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62bf00 00000400:00000200:0.0:1734260338.964755:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2cf9 [1] + 224 00000400:00000200:0.0:1734260338.964776:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260338.964780:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260338.964790:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098342656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260354 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260338.967080:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260338.967091:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260338.967093:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260338.967104:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098342656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260354 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260338.967113:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098342656/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260354 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260338.967140:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260338.967145:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db200. 00000100:00000010:2.0:1734260338.967149:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260343.963985:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260343.964007:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db200. 00000100:00000010:3.0:1734260343.964130:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260343.964136:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260343.964168:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734260343.964174:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260343.964180:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260343.964185:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098343040, portal 10 00000400:00000010:3.0:1734260343.964190:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a000. 00000100:00000200:3.0:1734260343.964192:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098343040, offset 0 00000400:00000200:3.0:1734260343.964200:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260343.964210:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260343.964214:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260343.964217:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260343.964220:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260343.964222:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260343.964224:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1411:1411:256:4294967295] 192.168.202.108@tcp LPNI seq info [1410:1410:8:4294967295] 00000400:00000200:3.0:1734260343.964232:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260343.964238:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260343.964241:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db700. 00000800:00000200:3.0:1734260343.964245:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260343.964258:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260343.964263:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db700 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734260343.964330:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734260343.964335:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260343.964338:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260343.964341:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098342912, portal 25 00000400:00000010:1.0:1734260343.964343:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720ee0. 00000100:00000200:1.0:1734260343.964344:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098342912, offset 0 00000400:00000200:1.0:1734260343.964349:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260343.964353:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260343.964356:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260343.964358:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260343.964359:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260343.964361:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260343.964363:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1412:1412:255:4294967295] 192.168.202.108@tcp LPNI seq info [1411:1411:7:4294967295] 00000400:00000200:1.0:1734260343.964369:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260343.964372:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000200:0.0:1734260343.964381:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260343.964384:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db700. 00000800:00000010:1.0:1734260343.964384:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734260343.964387:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734260343.964388:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260343.964392:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000800:00000200:1.0:1734260343.964392:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260343.964393:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1734260343.964395:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a000 00000400:00000010:0.0:1734260343.964401:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a000. 00000100:00000200:0.0:1734260343.964407:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098343040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260343.964431:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260343.964433:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734260343.964435:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260343.964437:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260343.964439:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720ee0 00000400:00000010:0.0:1734260343.964440:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720ee0. 00000100:00000200:0.0:1734260343.964442:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098342912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260359 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260343.966366:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260343.966382:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c080 00000400:00000200:0.0:1734260343.966388:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d09 [1] + 0 00000400:00000200:0.0:1734260343.966397:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260343.966399:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260343.966406:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098343040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260353 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260343.966439:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260343.966443:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c000 00000400:00000200:0.0:1734260343.966447:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d11 [1] + 224 00000400:00000200:0.0:1734260343.966460:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260343.966463:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260343.966467:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098342912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260359 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260343.966475:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260343.966479:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260343.966480:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260343.966485:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098343040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260343.966491:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098343040/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260353 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260343.966527:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 02000000:00000010:3.0:1734260343.966528:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 00000400:00000200:1.0:1734260343.966531:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 02000000:00000010:3.0:1734260343.966532:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000400:00000010:1.0:1734260343.966533:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000010:3.0:1734260343.966535:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000200:1.0:1734260343.966537:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098342912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260359 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260343.966544:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098342912/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260359 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260343.966556:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260343.966559:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db200. 00000100:00000010:1.0:1734260343.966561:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260348.971798:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260348.971817:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db600. 00000100:00000010:3.0:1734260348.971872:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260348.971878:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:3.0:1734260348.971904:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:2.0:1734260348.971905:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734260348.971909:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734260348.971909:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260348.971914:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:2.0:1734260348.971915:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260348.971920:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098343168, portal 25 00000100:00000200:3.0:1734260348.971926:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098343296, portal 10 00000400:00000010:3.0:1734260348.971930:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aee0. 00000400:00000010:2.0:1734260348.971931:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e000. 00000100:00000200:3.0:1734260348.971932:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098343296, offset 0 00000100:00000200:2.0:1734260348.971933:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098343168, offset 0 00000400:00000200:3.0:1734260348.971939:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260348.971942:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260348.971949:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260348.971960:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260348.971964:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260348.971966:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260348.971968:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260348.971970:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1413:1413:256:4294967295] 192.168.202.108@tcp LPNI seq info [1412:1412:8:4294967295] 00000400:00000200:3.0:1734260348.971977:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:2.0:1734260348.971982:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734260348.971982:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260348.971984:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260348.971985:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000010:3.0:1734260348.971985:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000400:00000200:2.0:1734260348.971987:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734260348.971990:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260348.971997:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734260348.971999:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734260348.972000:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:2.0:1734260348.972001:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1414:1414:255:4294967295] 192.168.202.108@tcp LPNI seq info [1413:1413:7:4294967295] 00000400:00000200:2.0:1734260348.972006:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260348.972009:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260348.972011:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000800:00000200:2.0:1734260348.972013:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260348.972016:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260348.972018:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260348.972105:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260348.972107:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734260348.972111:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260348.972114:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260348.972116:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aee0 00000400:00000010:0.0:1734260348.972121:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aee0. 00000100:00000200:0.0:1734260348.972126:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098343296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260358 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260348.972176:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260348.972177:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734260348.972179:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260348.972181:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260348.972182:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e000 00000400:00000010:0.0:1734260348.972183:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e000. 00000100:00000200:0.0:1734260348.972185:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098343168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260364 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260348.973772:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260348.973786:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c100 00000400:00000200:0.0:1734260348.973793:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d19 [1] + 224 00000400:00000200:0.0:1734260348.973808:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260348.973811:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260348.973818:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098343168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260348.973856:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260348.973860:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c180 00000400:00000200:0.0:1734260348.973864:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d1d [1] + 0 00000400:00000200:0.0:1734260348.973877:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260348.973880:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260348.973885:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098343296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260358 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260348.973981:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260348.973992:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260348.973996:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260348.974001:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098343168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260364 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260348.974001:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260348.974006:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000100:00000200:2.0:1734260348.974007:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098343168/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260364 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260348.974007:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260348.974018:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098343296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260358 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260348.974024:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 00000100:00000200:3.0:1734260348.974025:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098343296/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260358 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260348.974027:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db600. 00000100:00000010:2.0:1734260348.974030:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260348.974040:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260348.974043:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:3.0:1734260348.974045:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260353.979746:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260353.979763:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbf00. 00000100:00000010:3.0:1734260353.979816:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260353.979821:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:1.0:1734260353.979846:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 02000000:00000010:3.0:1734260353.979846:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:1.0:1734260353.979852:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:3.0:1734260353.979852:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:1.0:1734260353.979857:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260353.979857:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734260353.979862:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098343424, portal 25 00000400:00000010:1.0:1734260353.979866:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720f68. 00000100:00000200:1.0:1734260353.979937:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098343424, offset 0 00000100:00000200:3.0:1734260353.979937:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098343552, portal 10 00000400:00000010:3.0:1734260353.979943:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a5d8. 00000400:00000200:1.0:1734260353.979946:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734260353.979949:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098343552, offset 0 00000400:00000200:3.0:1734260353.979954:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260353.979957:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260353.979962:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260353.979965:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260353.979968:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260353.979970:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260353.979973:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1415:1415:256:4294967295] 192.168.202.108@tcp LPNI seq info [1414:1414:8:4294967295] 00000400:00000200:1.0:1734260353.979979:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:3.0:1734260353.979984:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260353.979986:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260353.979988:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260353.979990:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260353.979991:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260353.979993:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1416:1416:255:4294967295] 192.168.202.108@tcp LPNI seq info [1415:1415:7:4294967295] 00000800:00000200:1.0:1734260353.979998:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260353.979999:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000010:1.0:1734260353.980002:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:3.0:1734260353.980002:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260353.980004:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db500. 00000800:00000200:3.0:1734260353.980008:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260353.980015:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260353.980018:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260353.980018:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db500 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260353.980022:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260353.980024:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260353.980124:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260353.980127:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db500. 00000400:00000200:0.0:1734260353.980131:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260353.980134:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260353.980137:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a5d8 00000400:00000010:0.0:1734260353.980143:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a5d8. 00000100:00000200:0.0:1734260353.980149:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098343552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260363 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260353.980206:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260353.980208:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734260353.980210:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260353.980212:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260353.980214:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720f68 00000400:00000010:0.0:1734260353.980215:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720f68. 00000100:00000200:0.0:1734260353.980217:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098343424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260369 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260353.982182:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260353.982198:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c280 00000400:00000200:0.0:1734260353.982205:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d2d [1] + 0 00000400:00000200:0.0:1734260353.982215:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260353.982218:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260353.982226:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098343552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260363 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260353.982259:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260353.982264:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c200 00000400:00000200:0.0:1734260353.982272:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d29 [1] + 224 00000400:00000010:3.0:1734260353.982285:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:0.0:1734260353.982287:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260353.982290:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260353.982290:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260353.982292:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734260353.982296:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098343424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260353.982296:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098343552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260363 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260353.982302:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098343552/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260363 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260353.982326:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260353.982329:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:3.0:1734260353.982332:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:1.0:1734260353.982358:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260353.982362:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260353.982363:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260353.982368:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098343424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260369 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260353.982375:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098343424/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260369 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260353.982386:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260353.982389:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbf00. 00000100:00000010:1.0:1734260353.982391:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260358.987704:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260358.987723:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db100. 00000100:00000010:3.0:1734260358.987777:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260358.987783:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:2.0:1734260358.987793:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bca00. 00000400:00000010:2.0:1734260358.987800:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734260358.987806:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 02000000:00000010:3.0:1734260358.987808:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806c00. 00000400:00000010:3.0:1734260358.987812:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000100:00000200:2.0:1734260358.987813:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098343680, portal 25 00000400:00000010:3.0:1734260358.987815:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000400:00000010:2.0:1734260358.987816:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e220. 00000100:00000200:3.0:1734260358.987817:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098343808, portal 10 00000100:00000200:2.0:1734260358.987818:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098343680, offset 0 00000400:00000010:3.0:1734260358.987821:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a330. 00000400:00000200:2.0:1734260358.987826:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734260358.987832:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098343808, offset 0 00000400:00000200:2.0:1734260358.987836:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260358.987837:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260358.987841:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260358.987844:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260358.987848:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260358.987849:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260358.987851:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1417:1417:256:4294967295] 192.168.202.108@tcp LPNI seq info [1416:1416:8:4294967295] 00000400:00000200:2.0:1734260358.987869:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260358.987875:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260358.987876:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734260358.987878:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000400:00000200:3.0:1734260358.987879:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260358.987881:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734260358.987883:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260358.987883:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260358.987884:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260358.987886:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1418:1418:255:4294967295] 192.168.202.108@tcp LPNI seq info [1417:1417:7:4294967295] 00000800:00000200:2.0:1734260358.987889:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260358.987892:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734260358.987896:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260358.987900:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260358.987902:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734260358.987910:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260358.987914:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260358.987916:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260358.987999:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260358.988002:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734260358.988006:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260358.988010:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260358.988013:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e220 00000400:00000010:0.0:1734260358.988018:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e220. 00000100:00000200:0.0:1734260358.988025:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098343680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260358.988083:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260358.988084:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734260358.988087:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260358.988090:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260358.988092:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a330 00000400:00000010:0.0:1734260358.988093:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a330. 00000100:00000200:0.0:1734260358.988096:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098343808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260368 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260358.990937:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260358.990958:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c300 00000400:00000200:0.0:1734260358.990968:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d39 [1] + 224 00000400:00000200:0.0:1734260358.990981:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260358.990984:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260358.990995:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098343680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260358.991639:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260358.991645:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c380 00000400:00000200:0.0:1734260358.991651:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d3d [1] + 0 00000400:00000200:0.0:1734260358.991672:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260358.991675:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260358.991680:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098343808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260368 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260358.991780:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260358.991785:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260358.991787:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260358.991792:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098343680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260358.991798:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098343680/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260374 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260358.991822:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bca00. 02000000:00000010:2.0:1734260358.991827:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db100. 00000100:00000010:2.0:1734260358.991831:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:3.0:1734260358.991955:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260358.991960:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260358.991961:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260358.991966:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098343808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260368 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260358.991972:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098343808/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260368 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260358.991989:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260358.991992:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:3.0:1734260358.991995:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260363.995694:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260363.995711:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db900. 02000000:00000010:1.0:1734260363.995788:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734260363.995794:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260363.995800:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260363.995805:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098343936, portal 25 00000400:00000010:1.0:1734260363.995809:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720550. 00000100:00000200:1.0:1734260363.995811:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098343936, offset 0 00000400:00000200:1.0:1734260363.995819:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260363.995828:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260363.995833:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260363.995836:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260363.995839:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260363.995841:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260363.995844:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1419:1419:256:4294967295] 192.168.202.108@tcp LPNI seq info [1418:1418:8:4294967295] 00000400:00000200:1.0:1734260363.995851:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260363.995856:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260363.995859:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734260363.995862:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260363.995877:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260363.995885:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260363.996152:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260363.996159:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734260363.996164:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260363.996171:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260363.996176:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720550 00000400:00000010:0.0:1734260363.996186:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720550. 00000100:00000200:0.0:1734260363.996196:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098343936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000010:3.0:1734260363.996353:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260363.996361:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5807000. 02000000:00000010:0.0:1734260363.996527:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff880137732800. 00000400:00000010:0.0:1734260363.996533:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d503c8. 00000400:00000010:0.0:1734260363.996604:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1770. 00000100:00000200:0.0:1734260363.996610:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098344064, portal 10 00000400:00000010:0.0:1734260363.996616:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e12a8. 00000100:00000200:0.0:1734260363.996617:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098344064, offset 0 00000400:00000200:0.0:1734260363.996622:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260363.996632:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260363.996636:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260363.996638:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260363.996640:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260363.996643:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260363.996645:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1420:1420:256:4294967295] 192.168.202.108@tcp LPNI seq info [1419:1419:8:4294967295] 00000400:00000200:0.0:1734260363.996651:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260363.996655:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260363.996658:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4600. 00000800:00000200:0.0:1734260363.996662:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260363.996667:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260363.996670:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260363.996793:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1734260363.996796:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4600. 00000400:00000200:2.0:1734260363.996800:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1734260363.996805:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:2.0:1734260363.996808:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e12a8 00000400:00000010:2.0:1734260363.996809:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e12a8. 00000100:00000200:2.0:1734260363.996815:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098344064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260373 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260363.997814:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260363.997826:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c400 00000400:00000200:0.0:1734260363.997832:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d49 [1] + 224 00000400:00000200:0.0:1734260363.997840:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260363.997843:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260363.997849:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098343936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260379 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260363.997884:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260363.997898:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c480 00000400:00000200:0.0:1734260363.997902:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d51 [1] + 0 00000400:00000200:0.0:1734260363.997915:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260363.997918:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260363.997922:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098344064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260373 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260363.997979:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d503c8. 00000400:00000200:2.0:1734260363.997983:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1770 00000400:00000010:2.0:1734260363.997985:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1770. 00000100:00000200:2.0:1734260363.997989:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098344064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260373 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260363.997996:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098344064/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260373 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260363.998034:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff880137732800. 02000000:00000010:2.0:1734260363.998039:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5807000. 00000100:00000010:2.0:1734260363.998043:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:1.0:1734260363.998058:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260363.998062:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260363.998063:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260363.998067:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098343936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260363.998072:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098343936/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260379 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260363.998083:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260363.998085:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db900. 00000100:00000010:1.0:1734260363.998087:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260369.003808:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260369.003827:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db800. 00000100:00000010:3.0:1734260369.003886:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260369.003893:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260369.003930:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734260369.003936:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260369.003942:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260369.003948:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098344320, portal 10 00000400:00000010:3.0:1734260369.003954:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a6e8. 00000100:00000200:3.0:1734260369.003956:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098344320, offset 0 00000400:00000200:3.0:1734260369.003964:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260369.003976:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260369.003981:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260369.003985:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 02000000:00000010:1.0:1734260369.003993:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734260369.003998:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000200:3.0:1734260369.003998:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260369.004000:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000010:1.0:1734260369.004001:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260369.004003:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098344192, portal 25 00000400:00000200:3.0:1734260369.004003:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1421:1421:256:4294967295] 192.168.202.108@tcp LPNI seq info [1420:1420:8:4294967295] 00000400:00000010:1.0:1734260369.004006:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720000. 00000100:00000200:1.0:1734260369.004007:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098344192, offset 0 00000400:00000200:3.0:1734260369.004010:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734260369.004012:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734260369.004015:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260369.004016:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260369.004018:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734260369.004018:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbd00. 00000400:00000200:1.0:1734260369.004020:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260369.004022:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260369.004023:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734260369.004023:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260369.004025:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1422:1422:255:4294967295] 192.168.202.108@tcp LPNI seq info [1421:1421:7:4294967295] 00000800:00000200:3.0:1734260369.004029:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260369.004031:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260369.004032:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbd00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260369.004034:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260369.004037:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000800:00000200:1.0:1734260369.004039:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260369.004042:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260369.004049:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260369.004141:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260369.004145:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbd00. 00000400:00000200:0.0:1734260369.004149:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260369.004153:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260369.004156:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a6e8 00000400:00000010:0.0:1734260369.004157:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a6e8. 00000100:00000200:0.0:1734260369.004164:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098344320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260369.004230:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260369.004232:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734260369.004235:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260369.004238:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260369.004239:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720000 00000400:00000010:0.0:1734260369.004240:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720000. 00000100:00000200:0.0:1734260369.004244:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098344192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260385 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260369.005719:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260369.005732:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c580 00000400:00000200:0.0:1734260369.005738:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d59 [1] + 0 00000400:00000200:0.0:1734260369.005747:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260369.005750:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260369.005756:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098344320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260379 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260369.005786:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260369.005798:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c500 00000400:00000200:0.0:1734260369.005802:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d61 [1] + 224 00000400:00000010:3.0:1734260369.005810:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:0.0:1734260369.005813:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260369.005815:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260369.005815:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260369.005817:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734260369.005821:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098344192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260385 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260369.005822:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098344320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260369.005829:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098344320/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260379 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260369.005851:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260369.005855:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260369.005857:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:1.0:1734260369.005985:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260369.005989:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260369.005990:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260369.005994:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098344192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260385 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260369.006000:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098344192/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260385 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260369.006009:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260369.006012:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db800. 00000100:00000010:1.0:1734260369.006014:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260374.011678:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260374.011703:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbc00. 00000100:00000010:3.0:1734260374.011764:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260374.011770:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260374.011806:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734260374.011812:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260374.011818:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260374.011822:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098344576, portal 10 00000400:00000010:3.0:1734260374.011828:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610aaa0. 00000100:00000200:3.0:1734260374.011829:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098344576, offset 0 00000400:00000200:3.0:1734260374.011837:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 02000000:00000010:2.0:1734260374.011841:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bdc00. 00000400:00000010:2.0:1734260374.011847:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:2.0:1734260374.011853:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260374.011856:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098344448, portal 25 00000400:00000010:2.0:1734260374.011859:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e4c8. 00000100:00000200:2.0:1734260374.011860:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098344448, offset 0 00000400:00000200:3.0:1734260374.011860:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260374.011864:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260374.011864:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260374.011867:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260374.011870:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260374.011872:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260374.011875:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1423:1423:256:4294967295] 192.168.202.108@tcp LPNI seq info [1422:1422:8:4294967295] 00000400:00000200:3.0:1734260374.011882:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260374.011887:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260374.011888:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260374.011890:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000400:00000200:2.0:1734260374.011891:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260374.011892:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260374.011895:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734260374.011895:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734260374.011896:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260374.011898:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1424:1424:255:4294967295] 192.168.202.108@tcp LPNI seq info [1423:1423:7:4294967295] 00000800:00000200:3.0:1734260374.011902:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734260374.011904:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260374.011905:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260374.011908:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260374.011911:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000800:00000200:2.0:1734260374.011914:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260374.011917:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260374.011919:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260374.011987:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260374.011991:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734260374.011996:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260374.012000:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260374.012004:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610aaa0 00000400:00000010:0.0:1734260374.012005:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610aaa0. 00000100:00000200:0.0:1734260374.012012:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098344576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260374.012075:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260374.012077:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734260374.012079:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260374.012082:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260374.012083:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e4c8 00000400:00000010:0.0:1734260374.012084:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e4c8. 00000100:00000200:0.0:1734260374.012087:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098344448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260374.014303:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260374.014317:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c680 00000400:00000200:0.0:1734260374.014324:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d69 [1] + 0 00000400:00000200:0.0:1734260374.014332:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260374.014335:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260374.014346:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098344576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260384 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260374.014379:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260374.014391:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c600 00000400:00000200:0.0:1734260374.014394:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d71 [1] + 224 00000400:00000200:0.0:1734260374.014403:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260374.014405:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260374.014408:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098344448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260390 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260374.014492:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260374.014496:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260374.014498:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260374.014502:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098344576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260374.014503:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260374.014507:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000100:00000200:3.0:1734260374.014508:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098344576/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260384 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260374.014509:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260374.014513:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098344448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260374.014519:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098344448/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260390 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260374.014530:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260374.014534:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260374.014536:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 02000000:00000010:2.0:1734260374.014537:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bdc00. 02000000:00000010:2.0:1734260374.014540:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbc00. 00000100:00000010:2.0:1734260374.014542:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260379.019758:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260379.019777:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db300. 00000100:00000010:3.0:1734260379.019832:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260379.019839:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260379.019868:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 02000000:00000010:1.0:1734260379.019870:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:3.0:1734260379.019874:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:1.0:1734260379.019875:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260379.019879:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260379.019879:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:1.0:1734260379.019885:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098344704, portal 25 00000400:00000010:1.0:1734260379.019889:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b37202a8. 00000100:00000200:3.0:1734260379.020006:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098344832, portal 10 00000100:00000200:1.0:1734260379.020007:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098344704, offset 0 00000400:00000200:1.0:1734260379.020016:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000010:3.0:1734260379.020020:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a110. 00000100:00000200:3.0:1734260379.020022:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098344832, offset 0 00000400:00000200:1.0:1734260379.020026:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260379.020026:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260379.020030:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260379.020033:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260379.020035:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260379.020037:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260379.020040:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1425:1425:256:4294967295] 192.168.202.108@tcp LPNI seq info [1424:1424:8:4294967295] 00000400:00000200:1.0:1734260379.020047:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260379.020051:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260379.020053:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734260379.020055:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021900. 00000400:00000200:3.0:1734260379.020055:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260379.020058:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:1.0:1734260379.020059:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260379.020059:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260379.020061:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260379.020063:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1426:1426:255:4294967295] 192.168.202.108@tcp LPNI seq info [1425:1425:7:4294967295] 00000800:00000200:1.0:1734260379.020066:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260379.020069:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021900 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734260379.020069:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260379.020072:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260379.020075:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db800. 00000800:00000200:3.0:1734260379.020077:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260379.020081:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260379.020083:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db800 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260379.020145:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260379.020148:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021900. 00000400:00000200:0.0:1734260379.020153:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260379.020157:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260379.020160:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b37202a8 00000400:00000010:0.0:1734260379.020161:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b37202a8. 00000100:00000200:0.0:1734260379.020168:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098344704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260395 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260379.020226:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260379.020228:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db800. 00000400:00000200:0.0:1734260379.020230:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260379.020236:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260379.020238:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a110 00000400:00000010:0.0:1734260379.020239:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a110. 00000100:00000200:0.0:1734260379.020242:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098344832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260389 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260379.022353:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260379.022367:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c700 00000400:00000200:0.0:1734260379.022374:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d79 [1] + 224 00000400:00000200:0.0:1734260379.022384:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260379.022387:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260379.022395:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098344704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260395 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260379.022462:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260379.022476:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c780 00000400:00000200:0.0:1734260379.022480:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d7d [1] + 0 00000400:00000200:0.0:1734260379.022494:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260379.022496:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260379.022500:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098344832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260389 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260379.022598:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260379.022601:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260379.022603:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260379.022609:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098344704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260395 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260379.022614:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098344704/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260395 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260379.022634:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260379.022638:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db300. 00000100:00000010:1.0:1734260379.022640:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:3.0:1734260379.022700:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260379.022703:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260379.022704:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260379.022708:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098344832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260389 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260379.022713:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098344832/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260389 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260379.022727:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260379.022730:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260379.022731:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260384.027754:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260384.027774:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbd00. 00000100:00000010:3.0:1734260384.027833:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260384.027838:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260384.027869:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734260384.027884:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260384.027890:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260384.027895:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098345088, portal 10 00000400:00000010:3.0:1734260384.027901:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610af68. 00000100:00000200:3.0:1734260384.027902:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098345088, offset 0 00000400:00000200:3.0:1734260384.027910:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260384.027920:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260384.027924:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260384.027928:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260384.027930:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260384.027932:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260384.027934:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1427:1427:256:4294967295] 192.168.202.108@tcp LPNI seq info [1426:1426:8:4294967295] 00000400:00000200:3.0:1734260384.027941:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260384.027946:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260384.027953:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbb00. 00000800:00000200:3.0:1734260384.027957:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260384.027963:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260384.027966:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbb00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1734260384.027987:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000010:1.0:1734260384.027992:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260384.027995:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260384.027997:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098344960, portal 25 00000400:00000010:1.0:1734260384.028000:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720908. 00000100:00000200:1.0:1734260384.028001:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098344960, offset 0 00000400:00000200:1.0:1734260384.028005:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260384.028009:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260384.028011:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260384.028013:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260384.028015:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260384.028016:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260384.028018:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1428:1428:255:4294967295] 192.168.202.108@tcp LPNI seq info [1427:1427:7:4294967295] 00000400:00000200:1.0:1734260384.028024:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260384.028027:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260384.028030:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021d00. 00000800:00000200:1.0:1734260384.028032:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260384.028036:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260384.028038:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021d00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260384.028114:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260384.028117:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbb00. 00000400:00000200:0.0:1734260384.028121:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260384.028126:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260384.028129:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610af68 00000400:00000010:0.0:1734260384.028131:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610af68. 00000100:00000200:0.0:1734260384.028137:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098345088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260394 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260384.028325:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260384.028328:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021d00. 00000400:00000200:0.0:1734260384.028330:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260384.028333:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260384.028336:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720908 00000400:00000010:0.0:1734260384.028337:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720908. 00000100:00000200:0.0:1734260384.028340:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098344960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260400 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260384.030305:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260384.030320:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c800 00000400:00000200:0.0:1734260384.030326:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2d91 [1] + 224 00000400:00000200:0.0:1734260384.030336:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260384.030339:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260384.030347:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098344960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260400 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260384.030379:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260384.030407:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c880 00000400:00000200:0.0:1734260384.030412:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d89 [1] + 0 00000400:00000200:0.0:1734260384.030424:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260384.030427:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260384.030431:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098345088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260394 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260384.030437:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260384.030446:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260384.030448:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260384.030452:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098344960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260400 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260384.030459:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098344960/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260400 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260384.030480:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260384.030484:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbd00. 00000100:00000010:1.0:1734260384.030488:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:3.0:1734260384.030531:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260384.030535:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260384.030536:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260384.030540:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098345088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260394 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260384.030546:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098345088/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260394 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260384.030560:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260384.030563:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260384.030565:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260389.035722:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260389.035740:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db900. 00000100:00000010:3.0:1734260389.035809:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260389.035815:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260389.035847:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734260389.035853:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260389.035858:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260389.035863:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098345344, portal 10 00000400:00000010:3.0:1734260389.035868:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a908. 00000100:00000200:3.0:1734260389.035869:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098345344, offset 0 00000400:00000200:3.0:1734260389.035878:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260389.035890:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260389.035895:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260389.035898:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260389.035901:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260389.035903:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260389.035906:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1429:1429:256:4294967295] 192.168.202.108@tcp LPNI seq info [1428:1428:8:4294967295] 02000000:00000010:1.0:1734260389.035911:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 00000400:00000200:3.0:1734260389.035913:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000010:1.0:1734260389.035917:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000800:00000200:3.0:1734260389.035917:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000010:1.0:1734260389.035920:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000800:00000010:3.0:1734260389.035920:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000100:00000200:1.0:1734260389.035922:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098345216, portal 25 00000400:00000010:1.0:1734260389.035925:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720bb0. 00000800:00000200:3.0:1734260389.035925:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000100:00000200:1.0:1734260389.035926:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098345216, offset 0 00000400:00000200:1.0:1734260389.035930:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000800:00000200:3.0:1734260389.035931:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260389.035934:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000200:3.0:1734260389.035935:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:1.0:1734260389.035937:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260389.035939:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260389.035940:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260389.035942:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260389.035944:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1430:1430:255:4294967295] 192.168.202.108@tcp LPNI seq info [1429:1429:7:4294967295] 00000400:00000200:1.0:1734260389.035949:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260389.035952:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260389.035954:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021600. 00000800:00000200:1.0:1734260389.035957:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260389.035960:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260389.035962:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021600 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260389.036866:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260389.036869:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734260389.036873:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260389.036877:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260389.036881:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a908 00000400:00000010:0.0:1734260389.036883:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a908. 00000100:00000200:0.0:1734260389.036889:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098345344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260399 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260389.036952:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260389.036954:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021600. 00000400:00000200:0.0:1734260389.036956:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260389.036959:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260389.036961:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720bb0 00000400:00000010:0.0:1734260389.036962:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720bb0. 00000100:00000200:0.0:1734260389.036965:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098345216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260405 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260389.039052:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260389.039068:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62c980 00000400:00000200:0.0:1734260389.039075:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2d99 [1] + 0 00000400:00000200:0.0:1734260389.039086:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260389.039089:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260389.039098:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098345344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260399 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260389.039138:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260389.039151:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62c900 00000400:00000010:3.0:1734260389.039217:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260389.039221:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260389.039223:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260389.039227:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098345344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260399 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260389.039234:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098345344/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260399 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260389.039257:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260389.039261:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000400:00000200:0.0:1734260389.039263:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2da1 [1] + 224 00000100:00000010:3.0:1734260389.039268:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000200:0.0:1734260389.039279:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260389.039281:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260389.039285:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098345216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260405 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:1.0:1734260389.039369:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260389.039372:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260389.039373:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260389.039380:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098345216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260405 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260389.039386:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098345216/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260405 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260389.039396:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260389.039399:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db900. 00000100:00000010:1.0:1734260389.039400:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260394.043676:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260394.043694:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db400. 00000100:00000010:3.0:1734260394.043751:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260394.043757:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:1.0:1734260394.043783:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c0600. 02000000:00000010:3.0:1734260394.043784:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:1.0:1734260394.043790:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:3.0:1734260394.043790:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:1.0:1734260394.043794:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260394.043794:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260394.043800:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098345600, portal 10 00000100:00000200:1.0:1734260394.043803:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098345472, portal 25 00000400:00000010:3.0:1734260394.043805:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ad48. 00000400:00000010:1.0:1734260394.043806:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720880. 00000100:00000200:3.0:1734260394.043807:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098345600, offset 0 00000100:00000200:1.0:1734260394.043808:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098345472, offset 0 00000400:00000200:3.0:1734260394.043814:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260394.043819:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260394.043824:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260394.043828:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260394.043832:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260394.043835:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260394.043837:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260394.043840:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1431:1431:256:4294967295] 192.168.202.108@tcp LPNI seq info [1430:1430:8:4294967295] 00000400:00000200:3.0:1734260394.043847:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260394.043852:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260394.043853:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260394.043855:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:3.0:1734260394.043855:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbf00. 00000400:00000200:1.0:1734260394.043857:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260394.043859:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260394.043860:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734260394.043860:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:1.0:1734260394.043863:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1432:1432:255:4294967295] 192.168.202.108@tcp LPNI seq info [1431:1431:7:4294967295] 00000800:00000200:3.0:1734260394.043866:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:1.0:1734260394.043869:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260394.043869:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbf00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260394.043872:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260394.043874:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021f00. 00000800:00000200:1.0:1734260394.043877:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260394.043880:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260394.043882:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021f00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260394.043974:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260394.043978:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbf00. 00000400:00000200:0.0:1734260394.043982:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260394.043986:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260394.043989:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ad48 00000400:00000010:0.0:1734260394.043991:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ad48. 00000100:00000200:0.0:1734260394.043997:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098345600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260404 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260394.044057:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260394.044059:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021f00. 00000400:00000200:0.0:1734260394.044062:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260394.044065:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260394.044067:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720880 00000400:00000010:0.0:1734260394.044068:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720880. 00000100:00000200:0.0:1734260394.044071:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098345472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260410 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260394.046147:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260394.046163:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62ca80 00000400:00000200:0.0:1734260394.046170:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2da9 [1] + 0 00000400:00000200:0.0:1734260394.046180:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260394.046183:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260394.046191:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098345600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260404 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260394.046225:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260394.046239:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62ca00 00000400:00000200:0.0:1734260394.046243:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2dad [1] + 224 00000400:00000200:0.0:1734260394.046255:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260394.046258:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000010:3.0:1734260394.046259:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260394.046264:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260394.046266:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:0.0:1734260394.046271:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098345472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260410 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260394.046271:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098345600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260404 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260394.046278:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098345600/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260404 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260394.046303:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260394.046307:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260394.046309:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:1.0:1734260394.046360:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260394.046364:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260394.046365:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260394.046370:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098345472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260410 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260394.046390:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098345472/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260410 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260394.046401:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c0600. 02000000:00000010:1.0:1734260394.046404:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db400. 00000100:00000010:1.0:1734260394.046406:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260399.051683:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260399.051702:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db500. 00000100:00000010:3.0:1734260399.051757:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260399.051763:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:2.0:1734260399.051781:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 02000000:00000010:3.0:1734260399.051787:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:2.0:1734260399.051789:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734260399.051790:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:2.0:1734260399.051795:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734260399.051795:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260399.051800:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098345856, portal 10 00000400:00000010:3.0:1734260399.051805:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a550. 00000100:00000200:2.0:1734260399.051807:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098345728, portal 25 00000100:00000200:3.0:1734260399.051807:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098345856, offset 0 00000400:00000010:2.0:1734260399.051810:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e330. 00000400:00000200:3.0:1734260399.051814:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:2.0:1734260399.051818:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098345728, offset 0 00000400:00000200:2.0:1734260399.051822:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260399.051826:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260399.051830:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260399.051834:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260399.051837:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260399.051839:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260399.051846:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1433:1433:256:4294967295] 192.168.202.108@tcp LPNI seq info [1432:1432:8:4294967295] 00000400:00000200:3.0:1734260399.051853:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260399.051858:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260399.051859:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260399.051861:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db000. 00000400:00000200:2.0:1734260399.051862:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260399.051864:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260399.051866:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734260399.051866:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:2.0:1734260399.051868:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260399.051870:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1434:1434:255:4294967295] 192.168.202.108@tcp LPNI seq info [1433:1433:7:4294967295] 00000800:00000200:3.0:1734260399.051873:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:2.0:1734260399.051876:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260399.051877:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db000 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:2.0:1734260399.051879:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260399.051882:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000800:00000200:2.0:1734260399.051885:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260399.051889:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260399.051891:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260399.051933:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260399.051936:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db000. 00000400:00000200:0.0:1734260399.051940:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260399.051943:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260399.051945:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a550 00000400:00000010:0.0:1734260399.051946:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a550. 00000100:00000200:0.0:1734260399.051951:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098345856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260409 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260399.051995:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260399.051997:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734260399.052000:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260399.052003:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260399.052004:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e330 00000400:00000010:0.0:1734260399.052005:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e330. 00000100:00000200:0.0:1734260399.052008:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098345728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260415 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260399.053356:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260399.053369:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62cb80 00000400:00000200:0.0:1734260399.053374:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2db9 [1] + 0 00000400:00000200:0.0:1734260399.053383:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260399.053385:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260399.053396:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098345856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260409 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260399.053427:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260399.053441:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62cb00 00000400:00000200:0.0:1734260399.053445:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2dbd [1] + 224 00000400:00000200:0.0:1734260399.053456:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260399.053459:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260399.053463:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098345728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260415 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260399.053520:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260399.053525:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260399.053527:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260399.053532:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098345728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260415 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260399.053538:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098345728/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260415 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260399.053608:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260399.053610:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260399.053611:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260399.053618:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098345856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260409 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260399.053622:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098345856/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260409 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260399.053641:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260399.053643:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260399.053645:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 02000000:00000010:2.0:1734260399.054131:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734260399.054140:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db500. 00000100:00000010:2.0:1734260399.054143:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260404.059698:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260404.059729:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbe00. 00000100:00000010:3.0:1734260404.059786:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260404.059792:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260404.059827:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734260404.059833:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260404.059839:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260404.059845:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098346112, portal 10 00000400:00000010:3.0:1734260404.059850:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734260404.059852:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098346112, offset 0 00000400:00000200:3.0:1734260404.059859:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260404.059869:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260404.059873:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260404.059877:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260404.059879:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260404.059881:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260404.059884:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1435:1435:256:4294967295] 192.168.202.108@tcp LPNI seq info [1434:1434:8:4294967295] 00000400:00000200:3.0:1734260404.059892:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260404.059897:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260404.059900:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db200. 00000800:00000200:3.0:1734260404.059905:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260404.059912:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260404.059915:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db200 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:0.0:1734260404.059916:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3ae00. 00000400:00000010:0.0:1734260404.059920:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50420. 00000400:00000010:0.0:1734260404.059923:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e14c8. 00000100:00000200:0.0:1734260404.059926:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098345984, portal 25 00000400:00000010:0.0:1734260404.059928:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1990. 00000100:00000200:0.0:1734260404.059930:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098345984, offset 0 00000400:00000200:0.0:1734260404.059934:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260404.059938:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:0.0:1734260404.059940:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260404.059942:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260404.059944:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1734260404.059945:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260404.059947:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1436:1436:255:4294967295] 192.168.202.108@tcp LPNI seq info [1435:1435:7:4294967295] 00000400:00000200:0.0:1734260404.059958:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260404.059961:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260404.059963:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4300. 00000800:00000200:0.0:1734260404.059966:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260404.059970:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260404.059972:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4300 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260404.060392:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260404.060396:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db200. 00000400:00000200:1.0:1734260404.060399:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260404.060404:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260404.060407:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:1.0:1734260404.060409:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:1.0:1734260404.060415:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098346112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260414 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260404.060472:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260404.060474:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4300. 00000400:00000200:1.0:1734260404.060476:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260404.060479:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260404.060480:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1990 00000400:00000010:1.0:1734260404.060481:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1990. 00000100:00000200:1.0:1734260404.060485:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098345984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260420 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260404.062190:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260404.062205:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62cc00 00000400:00000200:0.0:1734260404.062211:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2dd1 [1] + 224 00000400:00000200:0.0:1734260404.062220:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260404.062232:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260404.062240:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098345984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260404.062284:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260404.062288:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62cc80 00000400:00000200:0.0:1734260404.062292:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2dc9 [1] + 0 00000400:00000200:0.0:1734260404.062304:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260404.062307:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260404.062310:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098346112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260414 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260404.062364:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260404.062368:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260404.062370:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260404.062374:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098346112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260414 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260404.062381:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098346112/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260414 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260404.062399:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50420. 02000000:00000010:3.0:1734260404.062402:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 00000400:00000200:2.0:1734260404.062404:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e14c8 00000400:00000010:2.0:1734260404.062405:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e14c8. 02000000:00000010:3.0:1734260404.062406:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260404.062408:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000200:2.0:1734260404.062409:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098345984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260420 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260404.062416:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098345984/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260420 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260404.062428:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3ae00. 02000000:00000010:2.0:1734260404.062432:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbe00. 00000100:00000010:2.0:1734260404.062434:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260409.067715:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260409.067734:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db700. 00000100:00000010:3.0:1734260409.067789:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260409.067795:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:2.0:1734260409.067810:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734260409.067818:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 02000000:00000010:3.0:1734260409.067822:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:2.0:1734260409.067824:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734260409.067826:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000100:00000200:2.0:1734260409.067831:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098346240, portal 25 00000400:00000010:2.0:1734260409.067835:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349edd0. 00000400:00000010:3.0:1734260409.067835:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:2.0:1734260409.067836:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098346240, offset 0 00000100:00000200:3.0:1734260409.067838:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098346368, portal 10 00000400:00000010:3.0:1734260409.067842:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000400:00000200:2.0:1734260409.067844:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734260409.067847:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098346368, offset 0 00000400:00000200:3.0:1734260409.067852:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260409.067854:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260409.067859:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260409.067863:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260409.067865:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260409.067867:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260409.067870:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1437:1437:256:4294967295] 192.168.202.108@tcp LPNI seq info [1436:1436:8:4294967295] 00000400:00000200:2.0:1734260409.067878:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260409.067888:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260409.067889:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260409.067891:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000010:2.0:1734260409.067892:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c400. 00000400:00000200:3.0:1734260409.067893:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260409.067895:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734260409.067897:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260409.067897:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260409.067899:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1438:1438:255:4294967295] 192.168.202.108@tcp LPNI seq info [1437:1437:7:4294967295] 00000800:00000200:2.0:1734260409.067904:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734260409.067905:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260409.067908:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c400 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:3.0:1734260409.067909:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260409.067911:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbe00. 00000800:00000200:3.0:1734260409.067920:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260409.067924:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260409.067926:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbe00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260409.068022:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260409.068026:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c400. 00000400:00000200:0.0:1734260409.068030:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260409.068034:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260409.068037:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349edd0 00000400:00000010:0.0:1734260409.068038:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349edd0. 00000100:00000200:0.0:1734260409.068049:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098346240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260425 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260409.068105:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260409.068108:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbe00. 00000400:00000200:0.0:1734260409.068109:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260409.068112:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260409.068114:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734260409.068115:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734260409.068118:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098346368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260419 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260409.069753:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260409.069769:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62cd80 00000400:00000200:0.0:1734260409.069775:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2de1 [1] + 0 00000400:00000200:0.0:1734260409.069784:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260409.069796:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260409.069804:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098346368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260419 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260409.069838:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260409.069842:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62cd00 00000400:00000200:0.0:1734260409.069846:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2dd9 [1] + 224 00000400:00000200:0.0:1734260409.069860:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260409.069863:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260409.069867:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098346240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260425 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260409.069872:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260409.069877:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260409.069879:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260409.069884:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098346368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260419 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260409.069891:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098346368/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260419 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:02020000:3.0:1734260409.069906:0:6037:0:(client.c:1407:ptlrpc_check_status()) lustre-MDT0000-mdc-ffff88012a598000: operation mds_connect to node 192.168.202.108@tcp failed: rc = -11 00000400:00000010:2.0:1734260409.069951:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260409.069954:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260409.069956:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260409.069960:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098346240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260425 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260409.069966:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098346240/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260425 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260409.069978:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734260409.069982:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db700. 00000100:00000010:2.0:1734260409.069986:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260409.075097:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260409.075107:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260409.075110:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260414.075755:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260414.075837:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db200. 00000100:00000010:3.0:1734260414.075917:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260414.075924:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:2.0:1734260414.075969:0:6040:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 02000000:00000010:3.0:1734260414.075969:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:2.0:1734260414.075974:0:6040:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734260414.075974:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:2.0:1734260414.075979:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734260414.075980:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:2.0:1734260414.075985:0:6040:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098346496, portal 25 00000400:00000010:2.0:1734260414.075989:0:6040:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eb28. 00000100:00000200:3.0:1734260414.075989:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098346624, portal 10 00000100:00000200:2.0:1734260414.075991:0:6040:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098346496, offset 0 00000400:00000010:3.0:1734260414.075994:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000400:00000200:2.0:1734260414.075997:0:6040:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734260414.076003:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098346624, offset 0 00000400:00000200:2.0:1734260414.076007:0:6040:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260414.076007:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260414.076011:0:6040:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260414.076014:0:6040:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260414.076016:0:6040:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260414.076018:0:6040:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260414.076020:0:6040:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1439:1439:256:4294967295] 192.168.202.108@tcp LPNI seq info [1438:1438:8:4294967295] 00000400:00000200:2.0:1734260414.076027:0:6040:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260414.076032:0:6040:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260414.076033:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734260414.076035:0:6040:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c300. 00000400:00000200:3.0:1734260414.076035:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260414.076038:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260414.076039:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734260414.076040:0:6040:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260414.076041:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260414.076043:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1440:1440:255:4294967295] 192.168.202.108@tcp LPNI seq info [1439:1439:7:4294967295] 00000800:00000200:2.0:1734260414.076047:0:6040:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260414.076050:0:6040:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c300 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734260414.076060:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260414.076064:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260414.076066:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db600. 00000800:00000200:3.0:1734260414.076069:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260414.076072:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260414.076074:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db600 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260414.076125:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260414.076128:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c300. 00000400:00000200:0.0:1734260414.076132:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260414.076136:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260414.076140:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eb28 00000400:00000010:0.0:1734260414.076141:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eb28. 00000100:00000200:0.0:1734260414.076148:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098346496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260430 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260414.076233:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260414.076235:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db600. 00000400:00000200:0.0:1734260414.076238:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260414.076241:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260414.076243:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734260414.076244:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:0.0:1734260414.076248:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098346624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260424 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260414.077635:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260414.077719:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62ce00 00000400:00000200:0.0:1734260414.077725:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2de9 [1] + 224 00000400:00000200:0.0:1734260414.077735:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260414.077747:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260414.077754:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098346496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260430 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260414.077791:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260414.077795:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62ce80 00000400:00000200:0.0:1734260414.077800:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2ded [1] + 0 00000400:00000200:0.0:1734260414.077813:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260414.077816:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260414.077820:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098346624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260424 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260414.077896:0:6040:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260414.077902:0:6040:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260414.077903:0:6040:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260414.077906:0:6040:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098346496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260430 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260414.077911:0:6040:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098346496/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260430 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260414.077923:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:2.0:1734260414.077924:0:6040:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734260414.077927:0:6040:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db200. 00000100:00000010:2.0:1734260414.077929:0:6040:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000200:3.0:1734260414.077932:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260414.077934:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260414.077943:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098346624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260424 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260414.077952:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098346624/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260424 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260414.077977:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260414.077981:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260414.077984:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260419.083678:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260419.083696:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db000. 00000100:00000010:3.0:1734260419.083746:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260419.083751:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:2.0:1734260419.083772:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 02000000:00000010:3.0:1734260419.083773:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:2.0:1734260419.083778:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734260419.083778:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:2.0:1734260419.083784:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734260419.083784:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:2.0:1734260419.083789:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098346752, portal 25 00000400:00000010:2.0:1734260419.083793:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e990. 00000100:00000200:3.0:1734260419.083793:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098346880, portal 10 00000100:00000200:2.0:1734260419.083795:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098346752, offset 0 00000400:00000010:3.0:1734260419.083798:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000400:00000200:2.0:1734260419.083802:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734260419.083805:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098346880, offset 0 00000400:00000200:3.0:1734260419.083809:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260419.083812:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260419.083816:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260419.083820:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260419.083823:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260419.083825:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260419.083827:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1441:1441:256:4294967295] 192.168.202.108@tcp LPNI seq info [1440:1440:8:4294967295] 00000400:00000200:2.0:1734260419.083834:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260419.083838:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260419.083839:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:2.0:1734260419.083841:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c600. 00000400:00000200:3.0:1734260419.083841:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260419.083843:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000800:00000200:2.0:1734260419.083846:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260419.083852:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:3.0:1734260419.083854:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:2.0:1734260419.083855:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c600 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734260419.083855:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260419.083857:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1442:1442:255:4294967295] 192.168.202.108@tcp LPNI seq info [1441:1441:7:4294967295] 00000400:00000200:3.0:1734260419.083863:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260419.083866:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260419.083868:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db400. 00000800:00000200:3.0:1734260419.083871:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260419.083874:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260419.083876:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db400 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260419.083966:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260419.083969:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c600. 00000400:00000200:0.0:1734260419.083974:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260419.083978:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260419.083981:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e990 00000400:00000010:0.0:1734260419.083983:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e990. 00000100:00000200:0.0:1734260419.083990:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098346752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260435 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260419.084044:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260419.084045:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db400. 00000400:00000200:0.0:1734260419.084047:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260419.084050:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260419.084052:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734260419.084052:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734260419.084055:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098346880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260429 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260419.085828:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260419.085842:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62cf00 00000400:00000200:0.0:1734260419.085847:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2df9 [1] + 224 00000400:00000200:0.0:1734260419.085856:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260419.085868:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260419.085876:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098346752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260435 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260419.085912:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260419.085916:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62cf80 00000400:00000200:0.0:1734260419.085920:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2dfd [1] + 0 00000400:00000200:0.0:1734260419.085933:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260419.085936:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260419.085940:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098346880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260429 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260419.085988:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260419.085993:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260419.085995:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260419.085999:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098346880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260429 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260419.086006:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098346880/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260429 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260419.086027:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260419.086031:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260419.086034:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:2.0:1734260419.086175:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260419.086179:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260419.086180:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260419.086189:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098346752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260435 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260419.086195:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098346752/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260435 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260419.086206:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734260419.086208:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db000. 00000100:00000010:2.0:1734260419.086210:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260424.091691:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260424.091712:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbf00. 00000100:00000010:3.0:1734260424.091769:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260424.091775:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260424.091807:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 02000000:00000010:2.0:1734260424.091808:0:6038:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800aa9bc200. 00000400:00000010:2.0:1734260424.091813:0:6038:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800ac58c9f8. 00000400:00000010:3.0:1734260424.091813:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:2.0:1734260424.091819:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349eaa0. 00000400:00000010:3.0:1734260424.091819:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:2.0:1734260424.091824:0:6038:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098347008, portal 25 00000100:00000200:3.0:1734260424.091824:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098347136, portal 10 00000400:00000010:2.0:1734260424.091827:0:6038:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b349e198. 00000100:00000200:2.0:1734260424.091829:0:6038:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098347008, offset 0 00000400:00000010:3.0:1734260424.091829:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ab28. 00000100:00000200:3.0:1734260424.091831:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098347136, offset 0 00000400:00000200:2.0:1734260424.091836:0:6038:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:2.0:1734260424.091847:0:6038:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:2.0:1734260424.091852:0:6038:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1734260424.091855:0:6038:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:2.0:1734260424.091858:0:6038:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1734260424.091860:0:6038:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:2.0:1734260424.091862:0:6038:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1443:1443:256:4294967295] 192.168.202.108@tcp LPNI seq info [1442:1442:8:4294967295] 00000400:00000200:2.0:1734260424.091869:0:6038:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:2.0:1734260424.091874:0:6038:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:2.0:1734260424.091878:0:6038:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b404c000. 00000800:00000200:2.0:1734260424.091882:0:6038:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:2.0:1734260424.091889:0:6038:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:2.0:1734260424.091892:0:6038:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b404c000 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260424.091975:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260424.091979:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b404c000. 00000400:00000200:0.0:1734260424.091983:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260424.091988:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:3.0:1734260424.092009:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260424.092022:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260424.092024:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260424.092026:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260424.092028:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260424.092030:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260424.092035:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1444:1444:255:4294967295] 192.168.202.108@tcp LPNI seq info [1443:1443:7:4294967295] 00000400:00000200:3.0:1734260424.092041:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260424.092044:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260424.092047:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db100. 00000800:00000200:3.0:1734260424.092049:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260424.092053:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260424.092054:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db100 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734260424.092087:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349e198 00000400:00000010:0.0:1734260424.092089:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349e198. 00000100:00000200:0.0:1734260424.092095:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098347008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260440 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260424.092161:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260424.092163:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db100. 00000400:00000200:0.0:1734260424.092165:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260424.092167:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260424.092169:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ab28 00000400:00000010:0.0:1734260424.092170:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ab28. 00000100:00000200:0.0:1734260424.092173:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098347136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260434 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260424.093404:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260424.093416:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62d000 00000400:00000200:0.0:1734260424.093422:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2e0d [1] + 224 00000400:00000200:0.0:1734260424.093438:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260424.093446:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260424.093452:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098347008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260440 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:2.0:1734260424.093541:0:6038:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800ac58c9f8. 00000400:00000200:2.0:1734260424.093630:0:6038:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b349eaa0 00000400:00000010:2.0:1734260424.093631:0:6038:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b349eaa0. 00000100:00000200:2.0:1734260424.093636:0:6038:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098347008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260440 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:2.0:1734260424.093653:0:6038:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098347008/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260440 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:2.0:1734260424.093671:0:6038:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800aa9bc200. 02000000:00000010:2.0:1734260424.093675:0:6038:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbf00. 00000100:00000010:2.0:1734260424.093678:0:6038:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000200:0.0:1734260424.093767:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260424.093773:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62d080 00000400:00000200:0.0:1734260424.093777:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2e09 [1] + 0 00000400:00000200:0.0:1734260424.093786:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260424.093789:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260424.093794:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098347136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260434 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260424.094065:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260424.094068:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260424.094070:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260424.094074:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098347136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260434 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260424.094079:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098347136/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260434 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260424.094094:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260424.094107:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260424.094109:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000010:3.0:1734260429.099690:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260429.099709:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db900. 00000100:00000010:3.0:1734260429.099768:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260429.099774:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260429.099806:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734260429.099812:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000400:00000010:3.0:1734260429.099818:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 02000000:00000010:1.0:1734260429.099826:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 00000100:00000200:3.0:1734260429.099829:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098347392, portal 10 00000400:00000010:1.0:1734260429.099831:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260429.099835:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000100:00000200:1.0:1734260429.099837:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098347264, portal 25 00000400:00000010:1.0:1734260429.099840:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720440. 00000100:00000200:1.0:1734260429.099842:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098347264, offset 0 00000400:00000010:3.0:1734260429.099845:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610abb0. 00000400:00000200:1.0:1734260429.099849:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:3.0:1734260429.099854:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098347392, offset 0 00000400:00000200:1.0:1734260429.099859:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260429.099859:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260429.099863:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260429.099866:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260429.099874:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260429.099876:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:1.0:1734260429.099878:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1445:1445:256:4294967295] 192.168.202.108@tcp LPNI seq info [1444:1444:8:4294967295] 00000400:00000200:1.0:1734260429.099885:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:1.0:1734260429.099890:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260429.099891:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:1.0:1734260429.099893:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021b00. 00000400:00000200:3.0:1734260429.099894:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260429.099896:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260429.099897:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:1.0:1734260429.099898:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:3.0:1734260429.099899:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260429.099901:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1446:1446:255:4294967295] 192.168.202.108@tcp LPNI seq info [1445:1445:7:4294967295] 00000800:00000200:1.0:1734260429.099903:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260429.099907:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021b00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1734260429.099907:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260429.099909:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:3.0:1734260429.099912:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dba00. 00000800:00000200:3.0:1734260429.099914:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260429.099917:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:3.0:1734260429.099919:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dba00 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1734260429.099987:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260429.099991:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021b00. 00000400:00000200:0.0:1734260429.099995:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260429.099999:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260429.100002:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720440 00000400:00000010:0.0:1734260429.100003:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720440. 00000100:00000200:0.0:1734260429.100010:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098347264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260445 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260429.100093:0:6032:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260429.100095:0:6032:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dba00. 00000400:00000200:0.0:1734260429.100097:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260429.100100:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260429.100102:0:6032:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610abb0 00000400:00000010:0.0:1734260429.100103:0:6032:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610abb0. 00000100:00000200:0.0:1734260429.100106:0:6032:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098347392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260439 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260429.101494:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260429.101505:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62d100 00000400:00000200:0.0:1734260429.101511:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2e1d [1] + 224 00000400:00000200:0.0:1734260429.101519:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260429.101529:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260429.101535:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098347264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260445 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260429.101564:0:6031:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260429.101589:0:6031:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62d180 00000400:00000200:0.0:1734260429.101593:0:6031:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2e19 [1] + 0 00000400:00000010:1.0:1734260429.101599:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 00000400:00000200:1.0:1734260429.101603:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260429.101605:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000400:00000200:0.0:1734260429.101607:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000200:1.0:1734260429.101609:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098347264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260445 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260429.101610:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260429.101614:0:6031:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098347392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260439 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260429.101616:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098347264/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260445 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260429.101634:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734260429.101638:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db900. 00000100:00000010:1.0:1734260429.101641:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000400:00000010:3.0:1734260429.101693:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260429.101696:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260429.101697:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260429.101702:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098347392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260439 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260429.101708:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098347392/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260439 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260429.101723:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260429.101725:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260429.101727:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260434.107663:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260434.107680:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99dbb00. 00000100:00000010:3.0:1734260434.107737:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260434.107742:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:1.0:1734260434.107764:0:6041:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff88012a4c1400. 02000000:00000010:3.0:1734260434.107766:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:1.0:1734260434.107770:0:6041:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b62b1420. 00000400:00000010:1.0:1734260434.107776:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720dd0. 00000400:00000010:3.0:1734260434.107777:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 00000100:00000200:1.0:1734260434.107781:0:6041:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098347520, portal 25 00000400:00000010:3.0:1734260434.107781:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260434.107783:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098347648, portal 10 00000400:00000010:1.0:1734260434.107786:0:6041:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b3720660. 00000400:00000010:3.0:1734260434.107786:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ae58. 00000100:00000200:1.0:1734260434.107787:0:6041:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098347520, offset 0 00000100:00000200:3.0:1734260434.107788:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098347648, offset 0 00000400:00000200:3.0:1734260434.107793:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260434.107799:0:6041:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260434.107803:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260434.107807:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1734260434.107811:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260434.107814:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260434.107815:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260434.107818:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1447:1447:256:4294967295] 192.168.202.108@tcp LPNI seq info [1446:1446:8:4294967295] 00000400:00000200:3.0:1734260434.107825:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000400:00000200:1.0:1734260434.107830:0:6041:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:1.0:1734260434.107832:0:6041:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1734260434.107834:0:6041:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:1.0:1734260434.107835:0:6041:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1734260434.107837:0:6041:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000800:00000200:3.0:1734260434.107843:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:1.0:1734260434.107844:0:6041:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1448:1448:255:4294967295] 192.168.202.108@tcp LPNI seq info [1447:1447:7:4294967295] 00000800:00000010:3.0:1734260434.107846:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99db300. 00000400:00000200:1.0:1734260434.107850:0:6041:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260434.107851:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:1.0:1734260434.107853:0:6041:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:1.0:1734260434.107856:0:6041:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b4021200. 00000800:00000200:3.0:1734260434.107857:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260434.107859:0:6041:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:3.0:1734260434.107860:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99db300 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:1.0:1734260434.107862:0:6041:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:1.0:1734260434.107864:0:6041:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b4021200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1734260434.108006:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260434.108010:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99db300. 00000400:00000200:0.0:1734260434.108013:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260434.108017:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260434.108021:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ae58 00000400:00000010:0.0:1734260434.108022:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ae58. 00000100:00000200:0.0:1734260434.108054:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098347648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260444 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:0.0:1734260434.108111:0:6033:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1734260434.108113:0:6033:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b4021200. 00000400:00000200:0.0:1734260434.108115:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260434.108118:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:0.0:1734260434.108119:0:6033:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720660 00000400:00000010:0.0:1734260434.108120:0:6033:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720660. 00000100:00000200:0.0:1734260434.108123:0:6033:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098347520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260450 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260434.109409:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260434.109421:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62d280 00000400:00000200:0.0:1734260434.109426:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2e2d [1] + 0 00000400:00000200:0.0:1734260434.109434:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260434.109444:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260434.109451:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098347648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260444 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260434.109481:0:6032:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260434.109485:0:6032:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62d200 00000400:00000200:0.0:1734260434.109488:0:6032:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2e29 [1] + 224 00000400:00000200:0.0:1734260434.109498:0:6032:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260434.109501:0:6032:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260434.109504:0:6032:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098347520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260434.109509:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260434.109514:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260434.109515:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260434.109520:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098347648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260444 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260434.109526:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098347648/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260444 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260434.109547:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 00000400:00000010:1.0:1734260434.109549:0:6041:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b62b1420. 02000000:00000010:3.0:1734260434.109551:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000400:00000200:1.0:1734260434.109553:0:6041:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b3720dd0 00000400:00000010:1.0:1734260434.109554:0:6041:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b3720dd0. 00000100:00000010:3.0:1734260434.109554:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. 00000100:00000200:1.0:1734260434.109558:0:6041:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098347520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260450 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260434.109565:0:6041:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098347520/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260450 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260434.109645:0:6041:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff88012a4c1400. 02000000:00000010:1.0:1734260434.109648:0:6041:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99dbb00. 00000100:00000010:1.0:1734260434.109650:0:6041:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000100:00000010:3.0:1734260439.115912:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243800. 02000000:00000010:3.0:1734260439.115930:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff8800a99db800. 00000100:00000010:3.0:1734260439.116020:0:8870:0:(client.c:578:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff88012b243b80. 02000000:00000010:3.0:1734260439.116026:0:8870:0:(sec_null.c:166:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff8800b5806c00. 02000000:00000010:3.0:1734260439.116060:0:6037:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff8800b5806400. 00000400:00000010:3.0:1734260439.116066:0:6037:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800a8e16dc0. 02000000:00000010:0.0:1734260439.116072:0:6039:0:(sec_null.c:209:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff8800a9c3b400. 00000400:00000010:3.0:1734260439.116072:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260439.116078:0:6037:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1818500098347904, portal 10 00000400:00000010:0.0:1734260439.116082:0:6039:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff8800b6d50478. 00000400:00000010:3.0:1734260439.116083:0:6037:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b610ac38. 00000100:00000200:3.0:1734260439.116085:0:6037:0:(niobuf.c:87:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1818500098347904, offset 0 00000400:00000010:0.0:1734260439.116087:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1220. 00000400:00000200:3.0:1734260439.116092:0:6037:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000100:00000200:0.0:1734260439.116277:0:6039:0:(niobuf.c:951:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1818500098347776, portal 25 00000400:00000010:0.0:1734260439.116281:0:6039:0:(lib-md.c:130:lnet_md_build()) slab-alloced 'lmd': 136 at ffff8800b35e1660. 00000100:00000200:0.0:1734260439.116283:0:6039:0:(niobuf.c:87:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1818500098347776, offset 0 00000400:00000200:3.0:1734260439.116283:0:6037:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000400:00000200:3.0:1734260439.116288:0:6037:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1734260439.116290:0:6039:0:(lib-move.c:5267:LNetPut()) LNetPut -> 12345-192.168.202.108@tcp 00000400:00000200:3.0:1734260439.116292:0:6037:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:3.0:1734260439.116295:0:6037:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1734260439.116297:0:6037:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:3.0:1734260439.116299:0:6037:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1449:1449:256:4294967295] 192.168.202.108@tcp LPNI seq info [1448:1448:8:4294967295] 00000400:00000200:3.0:1734260439.116308:0:6037:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:3.0:1734260439.116312:0:6037:0:(socklnd_cb.c:1000:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.202.108@tcp 00000400:00000200:0.0:1734260439.116316:0:6039:0:(lib-move.c:2937:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.202.108@tcp local destination 00000800:00000010:3.0:1734260439.116316:0:6037:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800a99dbc00. 00000400:00000200:0.0:1734260439.116320:0:6039:0:(lib-move.c:2567:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:3.0:1734260439.116320:0:6037:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000400:00000200:0.0:1734260439.116324:0:6039:0:(lib-move.c:1750:lnet_get_best_ni()) selected best_ni 192.168.202.8@tcp 00000400:00000200:0.0:1734260439.116327:0:6039:0:(lib-move.c:1329:lnet_select_peer_ni()) 192.168.202.8@tcp lpni_is_preferred = 0 00000800:00000200:3.0:1734260439.116328:0:6037:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000400:00000200:0.0:1734260439.116329:0:6039:0:(lib-move.c:1398:lnet_select_peer_ni()) sd_best_lpni = 192.168.202.108@tcp 00000400:00000200:0.0:1734260439.116332:0:6039:0:(lib-move.c:1871:lnet_handle_send()) 192.168.202.8@tcp NI seq info: [1450:1450:255:4294967295] 192.168.202.108@tcp LPNI seq info [1449:1449:7:4294967295] 00000800:00000200:3.0:1734260439.116332:0:6037:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a99dbc00 type 1, nob 616 niov 1 nkiov 1 00000400:00000200:0.0:1734260439.116338:0:6039:0:(lib-move.c:1988:lnet_handle_send()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp:) -> 192.168.202.108@tcp(192.168.202.108@tcp:192.168.202.108@tcp) : PUT try# 0 00000800:00000200:0.0:1734260439.116343:0:6039:0:(socklnd_cb.c:1000:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.202.108@tcp 00000800:00000010:0.0:1734260439.116346:0:6039:0:(socklnd_cb.c:42:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff8800b34d4200. 00000800:00000200:0.0:1734260439.116350:0:6039:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800b401fe40] -> 12345-192.168.202.108@tcp (5) 00000800:00000200:0.0:1734260439.116356:0:6039:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:988 00000800:00000200:0.0:1734260439.116359:0:6039:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b34d4200 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:1.0:1734260439.116438:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260439.116441:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800a99dbc00. 00000400:00000200:1.0:1734260439.116445:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260439.116449:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260439.116452:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610ac38 00000400:00000010:1.0:1734260439.116454:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610ac38. 00000100:00000200:1.0:1734260439.116460:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243b80 x1818500098347904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260449 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000800:00000200:1.0:1734260439.116516:0:6031:0:(socklnd_cb.c:540:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1734260439.116518:0:6031:0:(socklnd_cb.c:99:ksocknal_free_tx()) kfreed 'tx': 248 at ffff8800b34d4200. 00000400:00000200:1.0:1734260439.116520:0:6031:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1734260439.116523:0:6031:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000400:00000200:1.0:1734260439.116525:0:6031:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1660 00000400:00000010:1.0:1734260439.116702:0:6031:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1660. 00000100:00000200:1.0:1734260439.116711:0:6031:0:(events.c:58:request_out_callback()) @@@ type 5, status 0 req@ffff88012b243800 x1818500098347776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260455 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260439.118343:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260439.118358:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 416 into portal 10 MB=0x675ea8c62d380 00000400:00000200:0.0:1734260439.118364:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index a from 12345-192.168.202.108@tcp of length 416/416 into md 0x2e39 [1] + 0 00000400:00000200:0.0:1734260439.118374:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260439.118376:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260439.118384:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243b80 x1818500098347904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260449 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000200:0.0:1734260439.118687:0:6033:0:(lib-move.c:4757:lnet_parse()) TRACE: 192.168.202.8@tcp(192.168.202.8@tcp) <- 192.168.202.108@tcp : PUT - for me 00000400:00000200:0.0:1734260439.118693:0:6033:0:(lib-ptl.c:583:lnet_ptl_match_md()) Request from 12345-192.168.202.108@tcp of length 224 into portal 25 MB=0x675ea8c62d300 00000400:00000200:0.0:1734260439.118697:0:6033:0:(lib-ptl.c:209:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.202.108@tcp of length 224/224 into md 0x2e41 [1] + 224 00000400:00000200:0.0:1734260439.118711:0:6033:0:(lib-msg.c:1025:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1734260439.118714:0:6033:0:(lib-msg.c:797:lnet_health_check()) health check: 192.168.202.8@tcp->192.168.202.108@tcp: PUT: OK 00000100:00000200:0.0:1734260439.118718:0:6033:0:(events.c:99:reply_in_callback()) @@@ type 2, status 0 req@ffff88012b243800 x1818500098347776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260455 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000400:00000010:3.0:1734260439.118803:0:6037:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800a8e16dc0. 00000400:00000200:3.0:1734260439.118807:0:6037:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b610a770 00000400:00000010:3.0:1734260439.118808:0:6037:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b610a770. 00000100:00000200:3.0:1734260439.118812:0:6037:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243b80 x1818500098347904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260449 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:3.0:1734260439.118818:0:6037:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243b80 x1818500098347904/t0(0) o38->lustre-MDT0000-mdc-ffff88012a598000@192.168.202.108@tcp:12/10 lens 520/544 e 0 to 0 dl 1734260449 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:3.0:1734260439.118840:0:6037:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff8800b5806400. 02000000:00000010:3.0:1734260439.118844:0:6037:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 1024 at ffff8800b5806c00. 00000100:00000010:3.0:1734260439.118853:0:6037:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243b80. 00000400:00000010:1.0:1734260439.118952:0:6039:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff8800b6d50478. 00000400:00000200:1.0:1734260439.118956:0:6039:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff8800b35e1220 00000400:00000010:1.0:1734260439.118957:0:6039:0:(lib-lnet.h:297:lnet_md_free()) slab-freed 'md': 136 at ffff8800b35e1220. 00000100:00000200:1.0:1734260439.118961:0:6039:0:(events.c:99:reply_in_callback()) @@@ type 6, status 0 req@ffff88012b243800 x1818500098347776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260455 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 00000100:00000200:1.0:1734260439.118967:0:6039:0:(events.c:121:reply_in_callback()) @@@ unlink req@ffff88012b243800 x1818500098347776/t0(0) o400->MGC192.168.202.108@tcp@192.168.202.108@tcp:26/25 lens 224/224 e 0 to 0 dl 1734260455 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 02000000:00000010:1.0:1734260439.118978:0:6039:0:(sec_null.c:223:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff8800a9c3b400. 02000000:00000010:1.0:1734260439.118981:0:6039:0:(sec_null.c:193:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at ffff8800a99db800. 00000100:00000010:1.0:1734260439.118983:0:6039:0:(client.c:584:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff88012b243800. Debug log: 63005 lines, 63005 kept, 0 dropped, 0 bad.